libX11 segfault at resume when using nvidia driver

Hello,

I have a laptop with two gpu (amd and nvidia) and when using amd I have issue so I disabled it.
When using nvidia its work like a charm except one issue, when I wake up from sleep my session is lost.
When I look into dmesg I got this

[  +0,078454] gnome-shell[50593]: segfault at 0 ip 00007f87ff6fef37 sp 00007ffc34add380 error 4 in libX11.so.6.4.0[7f87ff6d9000+8b000] likely on CPU 9 (core 4, socket 0)

here my inxi

System:
  Kernel: 6.5.3-1-MANJARO arch: x86_64 bits: 64 compiler: gcc v: 13.2.1
    clocksource: hpet available: acpi_pm
    parameters: BOOT_IMAGE=/boot/vmlinuz-6.5-x86_64
    root=UUID=ad6062ba-ce58-45f5-b085-cd65f60d63ee rw quiet splash apparmor=1
    security=apparmor btusb.enable_autosuspend=n udev.log_priority=3
    resume=UUID=f40a723e-7c2b-48cc-b3db-a08be0a0e15
  Desktop: GNOME v: 44.4 tk: GTK v: 3.24.38 wm: gnome-shell dm: GDM v: 44.1
    Distro: Manjaro Linux base: Arch Linux
Machine:
  Type: Laptop System: LENOVO product: 82WM v: Legion Pro 5 16ARX8
    serial: <superuser required> Chassis: type: 10 v: Legion Pro 5 16ARX8
    serial: <superuser required>
  Mobo: LENOVO model: LNVNB161216 v: NO DPK serial: <superuser required>
    UEFI: LENOVO v: LPCN44WW date: 06/28/2023
Battery:
  ID-1: BAT0 charge: 73.2 Wh (94.9%) condition: 77.1/80.0 Wh (96.4%)
    power: 33.1 W volts: 16.8 min: 15.4 model: BYD L22B4PC0 type: Li-poly
    serial: <filter> status: discharging cycles: 15
CPU:
  Info: model: AMD Ryzen 7 7745HX with Radeon Graphics bits: 64 type: MT MCP
    arch: Zen 4 gen: 5 level: v4 note: check built: 2022+ process: TSMC n5 (5nm)
    family: 0x19 (25) model-id: 0x61 (97) stepping: 2 microcode: 0xA601203
  Topology: cpus: 1x cores: 8 tpc: 2 threads: 16 smt: enabled cache:
    L1: 512 KiB desc: d-8x32 KiB; i-8x32 KiB L2: 8 MiB desc: 8x1024 KiB
    L3: 32 MiB desc: 1x32 MiB
  Speed (MHz): avg: 1233 high: 3941 min/max: 400/5151 scaling:
    driver: amd-pstate-epp governor: powersave cores: 1: 3690 2: 3570 3: 3941
    4: 400 5: 400 6: 400 7: 400 8: 400 9: 400 10: 400 11: 400 12: 400 13: 3727
    14: 400 15: 400 16: 400 bogomips: 115037
  Flags: avx avx2 ht lm nx pae sse sse2 sse3 sse4_1 sse4_2 sse4a ssse3 svm
  Vulnerabilities:
  Type: gather_data_sampling status: Not affected
  Type: itlb_multihit status: Not affected
  Type: l1tf status: Not affected
  Type: mds status: Not affected
  Type: meltdown status: Not affected
  Type: mmio_stale_data status: Not affected
  Type: retbleed status: Not affected
  Type: spec_rstack_overflow mitigation: safe RET, no microcode
  Type: spec_store_bypass mitigation: Speculative Store Bypass disabled via
    prctl
  Type: spectre_v1 mitigation: usercopy/swapgs barriers and __user pointer
    sanitization
  Type: spectre_v2 mitigation: Enhanced / Automatic IBRS, IBPB:
    conditional, STIBP: always-on, RSB filling, PBRSB-eIBRS: Not affected
  Type: srbds status: Not affected
  Type: tsx_async_abort status: Not affected
Graphics:
  Device-1: NVIDIA AD106M [GeForce RTX 4070 Max-Q / Mobile] vendor: Lenovo
    driver: nvidia v: 535.104.05 alternate: nouveau,nvidia_drm non-free: 535.xx+
    status: current (as of 2023-08) arch: Lovelace code: AD1xx
    process: TSMC n4 (5nm) built: 2022-23+ pcie: gen: 1 speed: 2.5 GT/s
    lanes: 8 link-max: gen: 4 speed: 16 GT/s bus-ID: 01:00.0
    chip-ID: 10de:2860 class-ID: 0300
  Device-2: Luxvisions Innotech Integrated Camera driver: uvcvideo type: USB
    rev: 2.0 speed: 480 Mb/s lanes: 1 mode: 2.0 bus-ID: 3-2.4:3
    chip-ID: 30c9:00ac class-ID: fe01 serial: <filter>
  Display: x11 server: X.org v: 1.21.1.8 with: Xwayland v: 23.2.0
    compositor: gnome-shell driver: X: loaded: modesetting,nouveau,nvidia
    alternate: fbdev,nv,vesa gpu: nvidia display-ID: :1 screens: 1
  Screen-1: 0 s-res: 5120x1600 s-size: <missing: xdpyinfo>
  Monitor-1: DP-4 pos: primary res: 2560x1600 hz: 60 dpi: 188
    size: 345x215mm (13.58x8.46") diag: 407mm (16") modes: N/A
  Monitor-2: None-1-1 size-res: N/A modes: N/A
  API: OpenGL v: 4.6.0 NVIDIA 535.104.05 renderer: NVIDIA GeForce RTX 4070
    Laptop GPU/PCIe/SSE2 direct-render: Yes
Audio:
  Device-1: NVIDIA driver: snd_hda_intel v: kernel pcie: gen: 3 speed: 8 GT/s
    lanes: 8 link-max: gen: 4 speed: 16 GT/s bus-ID: 01:00.1 chip-ID: 10de:22bd
    class-ID: 0403
  Device-2: AMD ACP/ACP3X/ACP6x Audio Coprocessor vendor: Lenovo
    driver: snd_rpl_pci_acp6x v: kernel alternate: snd_pci_acp3x,
    snd_rn_pci_acp3x, snd_pci_acp5x, snd_pci_acp6x, snd_acp_pci, snd_pci_ps,
    snd_sof_amd_renoir, snd_sof_amd_rembrandt pcie: gen: 4 speed: 16 GT/s
    lanes: 16 bus-ID: 08:00.5 chip-ID: 1022:15e2 class-ID: 0480
  Device-3: AMD Family 17h/19h HD Audio vendor: Lenovo driver: snd_hda_intel
    v: kernel pcie: gen: 4 speed: 16 GT/s lanes: 16 bus-ID: 08:00.6
    chip-ID: 1022:15e3 class-ID: 0403
  API: ALSA v: k6.5.3-1-MANJARO status: kernel-api with: aoss
    type: oss-emulator tools: alsactl,alsamixer,amixer
  Server-1: JACK v: 1.9.22 status: off tools: N/A
  Server-2: PipeWire v: 0.3.80 status: off with: pipewire-media-session
    status: active tools: pw-cli
  Server-3: PulseAudio v: 16.1 status: active with: pulseaudio-alsa
    type: plugin tools: pacat,pactl
Network:
  Device-1: MEDIATEK MT7922 802.11ax PCI Express Wireless Network Adapter
    vendor: Lenovo driver: mt7921e v: kernel pcie: gen: 2 speed: 5 GT/s lanes: 1
    bus-ID: 04:00.0 chip-ID: 14c3:0616 class-ID: 0280
  IF: wlp4s0 state: up mac: <filter>
  Device-2: Realtek RTL8111/8168/8411 PCI Express Gigabit Ethernet
    vendor: Lenovo driver: r8169 v: kernel pcie: gen: 1 speed: 2.5 GT/s lanes: 1
    port: 1000 bus-ID: 07:00.0 chip-ID: 10ec:8168 class-ID: 0200
  IF: enp7s0 state: down mac: <filter>
  IF-ID-1: br-3f79bb2a939c state: down mac: <filter>
  IF-ID-2: br-80258d0e7d1d state: up speed: 10000 Mbps duplex: unknown
    mac: <filter>
  IF-ID-3: br-95e805673acb state: up speed: 10000 Mbps duplex: unknown
    mac: <filter>
  IF-ID-4: docker0 state: down mac: <filter>
  IF-ID-5: veth3b68355 state: up speed: 10000 Mbps duplex: full
    mac: <filter>
  IF-ID-6: veth5532c7f state: up speed: 10000 Mbps duplex: full
    mac: <filter>
  IF-ID-7: vethd2f4fc7 state: up speed: 10000 Mbps duplex: full
    mac: <filter>
Bluetooth:
  Device-1: Foxconn / Hon Hai Wireless_Device driver: btusb v: 0.8 type: USB
    rev: 2.1 speed: 480 Mb/s lanes: 1 mode: 2.0 bus-ID: 5-1.1:3
    chip-ID: 0489:e0d8 class-ID: e001 serial: <filter>
  Report: btmgmt ID: hci0 rfk-id: 5 state: up address: <filter> bt-v: 5.2
    lmp-v: 11 status: discoverable: no pairing: no class-ID: 6c010c
Drives:
  Local Storage: total: 953.87 GiB used: 397.53 GiB (41.7%)
  SMART Message: Required tool smartctl not installed. Check --recommends
  ID-1: /dev/nvme0n1 maj-min: 259:0 vendor: Samsung
    model: MZVL21T0HCLR-00BL2 size: 953.87 GiB block-size: physical: 512 B
    logical: 512 B speed: 63.2 Gb/s lanes: 4 tech: SSD serial: <filter>
    fw-rev: CL1QGXA7 temp: 36.9 C scheme: GPT
Partition:
  ID-1: / raw-size: 531.49 GiB size: 522.08 GiB (98.23%)
    used: 329.72 GiB (63.2%) fs: ext4 dev: /dev/nvme0n1p5 maj-min: 259:5
  ID-2: /boot/efi raw-size: 500 MiB size: 499 MiB (99.80%)
    used: 91.7 MiB (18.4%) fs: vfat dev: /dev/nvme0n1p1 maj-min: 259:1
Swap:
  Kernel: swappiness: 60 (default) cache-pressure: 100 (default) zswap: yes
    compressor: zstd max-pool: 20%
  ID-1: swap-1 type: partition size: 31.25 GiB used: 0 KiB (0.0%)
    priority: -2 dev: /dev/nvme0n1p4 maj-min: 259:4
Sensors:
  System Temperatures: cpu: 40.6 C mobo: N/A gpu: nvidia temp: 31 C
  Fan Speeds (rpm): N/A
Info:
  Processes: 358 Uptime: 21h 32m wakeups: 7 Memory: total: 32 GiB
  available: 31.03 GiB used: 3.91 GiB (12.6%) Init: systemd v: 254
  default: graphical tool: systemctl Compilers: gcc: 13.2.1 alt: 12
  clang: 16.0.6 Packages: pm: pacman pkgs: 1545 libs: 397
  tools: gnome-software,pamac,trizen pm: flatpak pkgs: 0 Shell: Zsh v: 5.9
  running-in: gnome-terminal inxi: 3.3.29

I don’t really want to go back to amd driver because its a pain in the ass (random glitches and freeze/crash) and I’m not really confident trying wayland on nvidia, his support seem really bad from what I read.

If anyone have an idea to dig or got the similar issue, I’m all ears.

Thanks