Xorg & kernel crashes related to NVIDIA graphics driver?

Since the last 2 or 3 weeks or so, I’m having frequent crashes that I think is caused by the NVIDIA driver. It can completely lock up the system/kernel and show segmentation faults in random applications. It can also crash Xorg.

Triggering events seem to be mostly related to HW accelerated graphic applications such as Firefox or design tools. Software applications can run fine for days (e.g. if I remote into a Windows VM).

My system hardware is:

AMD Ryzen 9 3900X
32GB 3200MHz DDR4 RAM
Gigabyte NVIDIA RTX 3080 Gaming OC
Asus X570 Prime Pro

The error in Xorg.0.old today:

[  3342.811] (EE) event6  - Logitech G500s Laser Gaming Mouse: client bug: event processing lagging behind by 21ms, your system is too slow
[  3483.764] (EE) event6  - Logitech G500s Laser Gaming Mouse: client bug: event processing lagging behind by 16ms, your system is too slow
[  3506.747] (EE)
[  3506.747] (EE) Backtrace:
[  3506.747] (EE) 0: /usr/lib/Xorg (xorg_backtrace+0x53) [0x55dfffc26fd3]
[  3506.747] (EE) 1: /usr/lib/Xorg (0x55dfffae0000+0x151df5) [0x55dfffc31df5]
[  3506.747] (EE) 2: /usr/lib/libc.so.6 (0x7ff70fbda000+0x3cda0) [0x7ff70fc16da0]
[  3506.747] (EE) 3: /usr/lib/libc.so.6 (gsignal+0x142) [0x7ff70fc16d22]
[  3506.747] (EE) 4: /usr/lib/libc.so.6 (abort+0x116) [0x7ff70fc00862]
[  3506.747] (EE) 5: /usr/lib/libc.so.6 (0x7ff70fbda000+0x7ed28) [0x7ff70fc58d28]
[  3506.747] (EE) 6: /usr/lib/libc.so.6 (0x7ff70fbda000+0x8692a) [0x7ff70fc6092a]
[  3506.747] (EE) 7: /usr/lib/libc.so.6 (0x7ff70fbda000+0x8a19c) [0x7ff70fc6419c]
[  3506.747] (EE) 8: /usr/lib/libc.so.6 (__libc_calloc+0x85) [0x7ff70fc66175]
[  3506.747] (EE) 9: /usr/lib/Xorg (AllocatePixmap+0x30) [0x55dfffb74130]
[  3506.747] (EE) 10: /usr/lib/xorg/modules/libwfb.so (wfbCreatePixmap+0x8b) [0x7ff70e5e191b]
[  3506.747] (EE) 11: /usr/lib/xorg/modules/drivers/nvidia_drv.so (0x7ff70e5f5000+0x4738f4) [0x7ff70ea688f4]
[  3506.747] (EE)
[  3506.747] (EE)
Fatal server error:
[  3506.747] (EE) Caught signal 6 (Aborted). Server aborting
[  3506.747] (EE)
[  3506.747] (EE)
Please consult the The X.Org Foundation support
     at http://wiki.x.org
 for help.
[  3506.747] (EE) Please also check the log file at "/var/log/Xorg.0.log" for additional information.
[  3506.747] (EE)
[  3506.927] (EE) Server terminated with error (1). Closing log file.

There were no remarkable events before 3342.811, other than initalization and displayport listings.

Here is pacman -Qs nvidia:

local/lib32-libvdpau 1.4-1
Nvidia VDPAU library
local/lib32-nvidia-utils 465.31-1
NVIDIA drivers utilities (32-bit)
local/libvdpau 1.4-1
Nvidia VDPAU library
local/linux414-nvidia 465.31-4 (linux414-extramodules)
NVIDIA drivers for linux.
local/linux419-nvidia 465.31-4 (linux419-extramodules)
NVIDIA drivers for linux.
local/linux510-nvidia 465.31-6 (linux510-extramodules)
NVIDIA drivers for linux.
local/linux513-nvidia 465.31-0.6 (linux513-extramodules)
NVIDIA drivers for linux.
local/linux54-nvidia 465.31-6 (linux54-extramodules)
NVIDIA drivers for linux.
local/mhwd-nvidia 465.31-1
MHWD module-ids for nvidia 465.31
local/mhwd-nvidia-390xx 390.143-1
MHWD module-ids for nvidia 390.143
local/nvidia-utils 465.31-1
NVIDIA drivers utilities

And pacman -Qs linux5

local/linux510 5.10.42-1
    The Linux510 kernel and modules
local/linux510-nvidia 465.31-6 (linux510-extramodules)
    NVIDIA drivers for linux.
local/linux510-virtualbox-host-modules 6.1.22-12 (linux510-extramodules)
    Host kernel modules for VirtualBox
local/linux513 5.13.rc5.d0606.g614124b-1
    The Linux513 kernel and modules
local/linux513-nvidia 465.31-0.6 (linux513-extramodules)
    NVIDIA drivers for linux.
local/linux513-virtualbox-host-modules 6.1.22-0.6 (linux513-extramodules)
    Host kernel modules for VirtualBox
local/linux54 5.4.124-1
    The Linux54 kernel and modules
local/linux54-nvidia 465.31-6 (linux54-extramodules)
    NVIDIA drivers for linux.
local/linux54-virtualbox-host-modules 6.1.22-12 (linux54-extramodules)
    Host kernel modules for VirtualBox

Here is inxi --admin --verbosity=7 --filter --no-host --width:

  System:
  Kernel: 5.13.0-1-MANJARO x86_64 bits: 64 compiler: gcc v: 11.1.0 
  parameters: BOOT_IMAGE=/boot/vmlinuz-5.13-x86_64 
  root=UUID= ro quiet 
  cryptdevice=UUID=:luks-
  root=/dev/mapper/luks- apparmor=1 
  security=apparmor 
  resume=/dev/mapper/luks-
  udev.log_priority=3 
  Desktop: Cinnamon 4.8.6 tk: GTK 3.24.29 info: gnome-panel vt: 1 dm: SDDM 
  Distro: Manjaro Linux base: Arch Linux 
Machine:
  Type: Desktop Mobo: ASUSTeK model: PRIME X570-PRO v: Rev X.0x 
  serial: <filter> UEFI: American Megatrends v: 2203 date: 06/17/2020 
Battery:
  Message: No system battery data found. Is one present? 
Memory:
  RAM: total: 31.27 GiB used: 3.74 GiB (12.0%) 
  RAM Report: permissions: Unable to run dmidecode. Root privileges required. 
CPU:
  Info: 12-Core model: AMD Ryzen 9 3900X bits: 64 type: MT MCP arch: Zen 2 
  family: 17 (23) model-id: 71 (113) stepping: 0 microcode: 8701021 cache: 
  L2: 6 MiB bogomips: 182114 
  Speed: 3771 MHz min/max: 2200/3800 MHz boost: enabled Core speeds (MHz): 
  1: 3771 2: 2052 3: 2196 4: 2194 5: 3593 6: 2049 7: 2135 8: 2195 9: 2195 
  10: 2194 11: 2111 12: 2148 13: 2050 14: 4174 15: 2196 16: 2195 17: 2196 
  18: 2195 19: 2193 20: 2194 21: 2052 22: 2053 23: 3588 24: 2195 
  Flags: 3dnowprefetch abm adx aes aperfmperf apic arat avic avx avx2 bmi1 
  bmi2 bpext cat_l3 cdp_l3 clflush clflushopt clwb clzero cmov cmp_legacy 
  constant_tsc cpb cpuid cqm cqm_llc cqm_mbm_local cqm_mbm_total cqm_occup_llc 
  cr8_legacy cx16 cx8 de decodeassists extapic extd_apicid f16c flushbyasid 
  fma fpu fsgsbase fxsr fxsr_opt ht hw_pstate ibpb ibs irperf lahf_lm lbrv lm 
  mba mca mce misalignsse mmx mmxext monitor movbe msr mtrr mwaitx nonstop_tsc 
  nopl npt nrip_save nx osvw overflow_recov pae pat pausefilter pclmulqdq 
  pdpe1gb perfctr_core perfctr_llc perfctr_nb pfthreshold pge pni popcnt pse 
  pse36 rdpid rdpru rdrand rdseed rdt_a rdtscp rep_good sep sev sev_es sha_ni 
  skinit smap smca sme smep ssbd sse sse2 sse4_1 sse4_2 sse4a ssse3 stibp 
  succor svm svm_lock syscall tce topoext tsc tsc_scale umip v_spec_ctrl 
  v_vmsave_vmload vgif vmcb_clean vme vmmcall wbnoinvd wdt xgetbv1 xsave 
  xsavec xsaveerptr xsaveopt xsaves 
  Vulnerabilities: Type: itlb_multihit status: Not affected 
  Type: l1tf status: Not affected 
  Type: mds status: Not affected 
  Type: meltdown status: Not affected 
  Type: spec_store_bypass 
  mitigation: Speculative Store Bypass disabled via prctl and seccomp 
  Type: spectre_v1 
  mitigation: usercopy/swapgs barriers and __user pointer sanitization 
  Type: spectre_v2 mitigation: Full AMD retpoline, IBPB: conditional, STIBP: 
  conditional, RSB filling 
  Type: srbds status: Not affected 
  Type: tsx_async_abort status: Not affected 
Graphics:
  Device-1: NVIDIA GA102 [GeForce RTX 3080] vendor: Gigabyte driver: nvidia 
  v: 465.31 alternate: nouveau,nvidia_drm bus-ID: 08:00.0 chip-ID: 10de:2206 
  class-ID: 0300 
  Display: x11 server: X.Org 1.20.11 driver: loaded: nvidia display-ID: :0 
  screens: 1 
  Screen-1: 0 s-res: 5120x1440 s-dpi: 96 s-size: 1355x381mm (53.3x15.0") 
  s-diag: 1408mm (55.4") 
  Monitor-1: DP-0 res: 2560x1440 dpi: 109 size: 597x336mm (23.5x13.2") 
  diag: 685mm (27") 
  Monitor-2: DP-4 res: 2560x1440 dpi: 109 size: 597x336mm (23.5x13.2") 
  diag: 685mm (27") 
  OpenGL: renderer: NVIDIA GeForce RTX 3080/PCIe/SSE2 v: 4.6.0 NVIDIA 465.31 
  direct render: Yes 
Audio:
  Device-1: NVIDIA vendor: Gigabyte driver: snd_hda_intel v: kernel 
  bus-ID: 08:00.1 chip-ID: 10de:1aef class-ID: 0403 
  Device-2: AMD Starship/Matisse HD Audio vendor: ASUSTeK 
  driver: snd_hda_intel v: kernel bus-ID: 0a:00.4 chip-ID: 1022:1487 
  class-ID: 0403 
  Device-3: Oculus VR Rift S type: USB 
  driver: cdc_acm,hid-generic,snd-usb-audio,usbhid bus-ID: 1-2.2:3 
  chip-ID: 2833:0051 class-ID: 0300 serial: <filter> 
  Device-4: C-Media Blue Snowball type: USB 
  driver: hid-generic,snd-usb-audio,usbhid bus-ID: 5-2:3 chip-ID: 0d8c:0005 
  class-ID: 0300 serial: <filter> 
  Device-5: Generic Rebel OWL type: USB driver: snd-usb-audio bus-ID: 5-4:5 
  chip-ID: 1209:dada class-ID: 0102 serial: <filter> 
  Sound Server-1: ALSA v: k5.13.0-1-MANJARO running: yes 
  Sound Server-2: JACK v: 0.125.0 running: no 
  Sound Server-3: PulseAudio v: 14.2 running: yes 
  Sound Server-4: PipeWire v: 0.3.30 running: no 
Network:
  Device-1: Intel I211 Gigabit Network vendor: ASUSTeK driver: igb v: kernel 
  port: f000 bus-ID: 04:00.0 chip-ID: 8086:1539 class-ID: 0200 
  IF: enp4s0 state: up speed: 1000 Mbps duplex: full mac: <filter> 
  IP v4: <filter> type: dynamic noprefixroute scope: global 
  broadcast: <filter> 
  IP v6: <filter> type: noprefixroute scope: link 
  WAN IP: <filter> 
Bluetooth:
  Message: No bluetooth data found. 
Logical:
  Permissions: Unable to run lvs. Root privileges required. 
RAID:
  Message: No RAID data found. 
Drives:
  Local Storage: total: 4.55 TiB used: 303.05 GiB (6.5%) 
  SMART Message: Unable to run smartctl. Root privileges required. 
  ID-1: /dev/nvme0n1 maj-min: 259:0 vendor: Samsung 
  model: SSD 970 EVO Plus 1TB size: 931.51 GiB block-size: physical: 512 B 
  logical: 512 B speed: 31.6 Gb/s lanes: 4 rotation: SSD serial: <filter> 
  rev: 2B2QEXM7 scheme: GPT 
  ID-2: /dev/sda maj-min: 8:0 vendor: Crucial model: CT1000MX500SSD1 
  size: 931.51 GiB block-size: physical: 512 B logical: 512 B speed: 6.0 Gb/s 
  rotation: SSD serial: <filter> rev: 023 scheme: GPT 
  ID-3: /dev/sdb maj-min: 8:16 vendor: Western Digital model: WD30EFRX-68AX9N0 
  size: 2.73 TiB block-size: physical: 4096 B logical: 512 B speed: 6.0 Gb/s 
  serial: <filter> rev: 0A80 scheme: GPT 
  Message: No optical or floppy data found. 
Partition:
  ID-1: / raw-size: 896.75 GiB size: 881.67 GiB (98.32%) 
  used: 303.05 GiB (34.4%) fs: ext4 dev: /dev/dm-0 maj-min: 254:0 
  mapped: luks- label: N/A 
  uuid: 
  ID-2: /boot/efi raw-size: 300 MiB size: 299.4 MiB (99.80%) 
  used: 484 KiB (0.2%) fs: vfat dev: /dev/nvme0n1p1 maj-min: 259:1 label: N/A 
  uuid: D420-DFF6 
Swap:
  Kernel: swappiness: 60 (default) cache-pressure: 100 (default) 
  ID-1: swap-1 type: partition size: 34.47 GiB used: 0 KiB (0.0%) priority: -2 
  dev: /dev/dm-1 maj-min: 254:1 
  mapped: luks- label: N/A 
  uuid: 
Unmounted:
  ID-1: /dev/nvme0n1p2 maj-min: 259:2 size: 896.75 GiB 
  fs: <superuser required> label: N/A 
  uuid: dee5c05c-8dd4-437c-a97e-5d907fe93f58 
  ID-2: /dev/nvme0n1p3 maj-min: 259:3 size: 34.47 GiB fs: <superuser required> 
  label: N/A uuid: 2d8b64ce-913f-431d-8676-71473d215671 
  ID-3: /dev/sda1 maj-min: 8:1 size: 100 MiB fs: <superuser required> 
  label: N/A uuid: 022D-89E4 
  ID-4: /dev/sda2 maj-min: 8:2 size: 16 MiB fs: <superuser required> 
  label: N/A uuid: N/A 
  ID-5: /dev/sda3 maj-min: 8:3 size: 930.9 GiB fs: <superuser required> 
  label: N/A uuid: D6F23E77F23E5C45 
  ID-6: /dev/sda4 maj-min: 8:4 size: 513 MiB fs: <superuser required> 
  label: N/A uuid: 0E964CF5964CDF39 
  ID-7: /dev/sdb1 maj-min: 8:17 size: 128 MiB fs: <superuser required> 
  label: N/A uuid: N/A 
  ID-8: /dev/sdb2 maj-min: 8:18 size: 2.73 TiB fs: <superuser required> 
  label: New Volume uuid: FEA43EFDA43EB84B 
USB:
  Hub-1: 1-0:1 info: Full speed (or root) Hub ports: 6 rev: 2.0 
  speed: 480 Mb/s chip-ID: 1d6b:0002 class-ID: 0900 
  Hub-2: 1-2:2 info: Oculus VR Rift S USB Hub ports: 2 rev: 2.1 
  speed: 480 Mb/s chip-ID: 2833:2052 class-ID: 0900 
  Device-1: 1-2.2:3 info: Oculus VR Rift S 
  type: Abstract (modem),CDC-Data,Audio,HID 
  driver: cdc_acm,hid-generic,snd-usb-audio,usbhid interfaces: 9 rev: 2.0 
  speed: 12 Mb/s power: 500mA chip-ID: 2833:0051 class-ID: 0300 
  serial: <filter> 
  Hub-3: 2-0:1 info: Full speed (or root) Hub ports: 4 rev: 3.1 speed: 10 Gb/s 
  chip-ID: 1d6b:0003 class-ID: 0900 
  Hub-4: 2-2:2 info: Oculus VR Rift S USB Hub ports: 1 rev: 3.1 speed: 5 Gb/s 
  chip-ID: 2833:2051 class-ID: 0900 
  Hub-5: 3-0:1 info: Full speed (or root) Hub ports: 6 rev: 2.0 
  speed: 480 Mb/s chip-ID: 1d6b:0002 class-ID: 0900 
  Device-1: 3-4:2 info: ASUSTek AURA LED Controller type: HID 
  driver: hid-generic,usbhid interfaces: 2 rev: 2.0 speed: 12 Mb/s power: 16mA 
  chip-ID: 0b05:18f3 class-ID: 0300 serial: <filter> 
  Device-2: 3-5:3 info: Corsair type: HID driver: corsair-psu,usbhid 
  interfaces: 1 rev: 2.0 speed: 12 Mb/s power: 100mA chip-ID: 1b1c:1c0d 
  class-ID: 0300 
  Hub-6: 4-0:1 info: Full speed (or root) Hub ports: 4 rev: 3.1 speed: 10 Gb/s 
  chip-ID: 1d6b:0003 class-ID: 0900 
  Hub-7: 5-0:1 info: Full speed (or root) Hub ports: 4 rev: 2.0 
  speed: 480 Mb/s chip-ID: 1d6b:0002 class-ID: 0900 
  Hub-8: 5-1:2 info: Genesys Logic Hub ports: 4 rev: 2.0 speed: 480 Mb/s 
  power: 100mA chip-ID: 05e3:0610 class-ID: 0900 
  Device-1: 5-1.1:4 info: Cooler Master MasterKeys Pro S white 
  type: Keyboard,HID driver: hid-generic,usbhid interfaces: 3 rev: 1.1 
  speed: 12 Mb/s power: 100mA chip-ID: 2516:0059 class-ID: 0300 
  Device-2: 5-1.2:6 info: Logitech G500s Laser Gaming Mouse type: Mouse,HID 
  driver: hid-generic,usbhid interfaces: 2 rev: 2.0 speed: 12 Mb/s power: 98mA 
  chip-ID: 046d:c24e class-ID: 0300 serial: <filter> 
  Device-3: 5-1.3:7 info: Micro Star MSI Gaming Controller type: HID 
  driver: hid-generic,usbhid interfaces: 1 rev: 1.1 speed: 12 Mb/s 
  power: 100mA chip-ID: 1462:3fa4 class-ID: 0300 serial: <filter> 
  Device-4: 5-2:3 info: C-Media Blue Snowball type: Audio,HID 
  driver: hid-generic,snd-usb-audio,usbhid interfaces: 3 rev: 1.1 
  speed: 12 Mb/s power: 100mA chip-ID: 0d8c:0005 class-ID: 0300 
  serial: <filter> 
  Device-5: 5-4:5 info: Generic Rebel OWL type: Audio driver: snd-usb-audio 
  interfaces: 2 rev: 2.0 speed: 12 Mb/s power: 100mA chip-ID: 1209:dada 
  class-ID: 0102 serial: <filter> 
  Hub-9: 6-0:1 info: Full speed (or root) Hub ports: 4 rev: 3.1 speed: 10 Gb/s 
  chip-ID: 1d6b:0003 class-ID: 0900 
Sensors:
  System Temperatures: cpu: 58.4 C mobo: 0 C gpu: nvidia temp: 49 C 
  Fan Speeds (RPM): N/A gpu: nvidia fan: 58% 
Info:
  Processes: 445 Uptime: 1h 06m wakeups: 0 Init: systemd v: 248 
  tool: systemctl Compilers: gcc: 11.1.0 Packages: 1831 pacman: 1803 lib: 492 
  flatpak: 18 snap: 10 Shell: Bash v: 5.1.8 running-in: gnome-terminal 
  inxi: 3.3.04 

As is visible, I’ve plenty of other kernels installed, but all have the same behaviour. Here is a log of a kernel crash some time ago:

Jun 17 09:05:25 hans-pc kernel: ------------[ cut here ]------------
Jun 17 09:05:25 hans-pc kernel: WARNING: CPU: 8 PID: 1429 at arch/x86/include/asm/kfence.h:44 kfence_protect_page+0x39/0xc0
Jun 17 09:05:25 hans-pc kernel: Modules linked in: joydev cdc_acm snd_usb_audio snd_usbmidi_lib snd_rawmidi snd_seq_device mousedev corsair_psu mc intel_rapl_msr ip6t_REJECT nf_reject_ipv6 eeepc_wmi asus_wmi sparse_keymap rfkill xt_hl video wmi_bmof mxm_wmi ip6t_rt ipt_REJECT nf_reject_ipv4 xt_LOG nf_log_syslog xt_l>
Jun 17 09:05:25 hans-pc kernel:  pinctrl_amd acpi_cpufreq vboxnetflt(OE) vboxnetadp(OE) vboxdrv(OE) sg fuse crypto_user ip_tables x_tables ext4 crc32c_generic crc16 mbcache jbd2 hid_logitech_hidpp hid_logitech_dj usbhid dm_crypt cbc encrypted_keys dm_mod trusted asn1_encoder tee tpm crct10dif_pclmul crc32_pclmul crc>
Jun 17 09:05:25 hans-pc kernel: CPU: 8 PID: 1429 Comm: irq/119-nvidia Tainted: P           OE     5.13.0-1-MANJARO #1
Jun 17 09:05:25 hans-pc kernel: Hardware name: System manufacturer System Product Name/PRIME X570-PRO, BIOS 2203 06/17/2020
Jun 17 09:05:25 hans-pc kernel: RIP: 0010:kfence_protect_page+0x39/0xc0
Jun 17 09:05:25 hans-pc kernel: Code: 25 28 00 00 00 48 89 44 24 08 31 c0 48 8d 74 24 04 c7 44 24 04 00 00 00 00 e8 a3 da db ff 48 85 c0 74 07 83 7c 24 04 01 74 06 <0f> 0b 31 c0 eb 4c 48 8b 38 48 89 c2 84 db 75 59 48 89 f8 0f 1f 40
Jun 17 09:05:25 hans-pc kernel: RSP: 0018:ffffbb124497fc18 EFLAGS: 00010046
Jun 17 09:05:25 hans-pc kernel: RAX: 0000000000000000 RBX: 0000000000000000 RCX: ffffffff91810000
Jun 17 09:05:25 hans-pc kernel: RDX: ffffbb124497fc1c RSI: 0000000000000000 RDI: ffffffff91810000
Jun 17 09:05:25 hans-pc kernel: RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000
Jun 17 09:05:25 hans-pc kernel: R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000002
Jun 17 09:05:25 hans-pc kernel: R13: ffffbb124497fcd8 R14: 0000000000000002 R15: 0000000000000000
Jun 17 09:05:25 hans-pc kernel: FS:  0000000000000000(0000) GS:ffffa0c60ec00000(0000) knlGS:0000000000000000
Jun 17 09:05:25 hans-pc kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jun 17 09:05:25 hans-pc kernel: CR2: 0000000000000658 CR3: 000000014cd3c000 CR4: 0000000000350ee0
Jun 17 09:05:25 hans-pc kernel: Call Trace:
Jun 17 09:05:25 hans-pc kernel:  kfence_unprotect+0x13/0x30
Jun 17 09:05:25 hans-pc kernel:  page_fault_oops+0x9d/0x2d0
Jun 17 09:05:25 hans-pc kernel:  ? _nv028690rm+0xa9/0x130 [nvidia]
Jun 17 09:05:25 hans-pc kernel:  ? _nv039630rm+0x5e/0x1d0 [nvidia]
Jun 17 09:05:25 hans-pc kernel:  exc_page_fault+0x7b/0x180
Jun 17 09:05:25 hans-pc kernel:  asm_exc_page_fault+0x1e/0x30
Jun 17 09:05:25 hans-pc kernel: RIP: 0010:_nv024993rm+0x22/0x1a0 [nvidia]
Jun 17 09:05:25 hans-pc kernel: Code: b8 1f 00 00 00 f3 c3 90 41 57 41 56 49 89 ce 41 55 41 54 49 89 fc 53 48 83 ed 20 48 85 c9 48 89 f3 89 55 0c 0f 84 4e 01 00 00 <48> c7 01 00 00 00 00 48 c7 41 08 00 00 00 00 48 8b 86 a8 01 00 00
Jun 17 09:05:25 hans-pc kernel: RSP: 0018:ffffbb124497fd80 EFLAGS: 00010202
Jun 17 09:05:25 hans-pc kernel: RAX: ffffffffc0c54830 RBX: ffffa0bf2d18b008 RCX: 0000000000000658
Jun 17 09:05:25 hans-pc kernel: RDX: 0000000000000001 RSI: ffffa0bf2d18b008 RDI: ffffa0bf39dec008
Jun 17 09:05:25 hans-pc kernel: RBP: ffffa0bf39d9abb0 R08: 0000000000000020 R09: ffffa0bf2d18b008
Jun 17 09:05:25 hans-pc kernel: R10: ffffa0bf39dec008 R11: 0000000080000000 R12: ffffa0bf39dec008
Jun 17 09:05:25 hans-pc kernel: R13: ffffa0bf39f9a008 R14: 0000000000000658 R15: ffffa0bf39f0a008
Jun 17 09:05:25 hans-pc kernel:  ? _nv024987rm+0x50/0x50 [nvidia]
Jun 17 09:05:25 hans-pc kernel:  ? _nv024016rm+0x1eb/0x1300 [nvidia]
Jun 17 09:05:25 hans-pc kernel:  ? _nv028944rm+0xcde/0xe70 [nvidia]
Jun 17 09:05:25 hans-pc kernel:  ? _nv028952rm+0x172/0x420 [nvidia]
Jun 17 09:05:25 hans-pc kernel:  ? _nv000715rm+0xb1/0x250 [nvidia]
Jun 17 09:05:25 hans-pc kernel:  ? disable_irq_nosync+0x10/0x10
Jun 17 09:05:25 hans-pc kernel:  ? rm_isr_bh+0x1c/0x60 [nvidia]
Jun 17 09:05:25 hans-pc kernel:  ? nvidia_isr_kthread_bh+0x1b/0x40 [nvidia]
Jun 17 09:05:25 hans-pc kernel:  ? irq_thread_fn+0x20/0x60
Jun 17 09:05:25 hans-pc kernel:  ? irq_thread+0xf2/0x1a0
Jun 17 09:05:25 hans-pc kernel:  ? irq_finalize_oneshot.part.0+0xe0/0xe0
Jun 17 09:05:25 hans-pc kernel:  ? irq_thread_check_affinity+0xd0/0xd0
Jun 17 09:05:25 hans-pc kernel:  ? kthread+0x133/0x150
Jun 17 09:05:25 hans-pc kernel:  ? kthread_associate_blkcg+0xc0/0xc0
Jun 17 09:05:25 hans-pc kernel:  ? ret_from_fork+0x22/0x30
Jun 17 09:05:25 hans-pc kernel: ---[ end trace a43e3fb77e27d75c ]---
Jun 17 09:05:25 hans-pc kernel: ------------[ cut here ]------------
Jun 17 09:05:25 hans-pc kernel: WARNING: CPU: 8 PID: 1429 at mm/kfence/core.c:135 kfence_unprotect+0x18/0x30
Jun 17 09:05:25 hans-pc kernel: Modules linked in: joydev cdc_acm snd_usb_audio snd_usbmidi_lib snd_rawmidi snd_seq_device mousedev corsair_psu mc intel_rapl_msr ip6t_REJECT nf_reject_ipv6 eeepc_wmi asus_wmi sparse_keymap rfkill xt_hl video wmi_bmof mxm_wmi ip6t_rt ipt_REJECT nf_reject_ipv4 xt_LOG nf_log_syslog xt_l>
Jun 17 09:05:25 hans-pc kernel:  pinctrl_amd acpi_cpufreq vboxnetflt(OE) vboxnetadp(OE) vboxdrv(OE) sg fuse crypto_user ip_tables x_tables ext4 crc32c_generic crc16 mbcache jbd2 hid_logitech_hidpp hid_logitech_dj usbhid dm_crypt cbc encrypted_keys dm_mod trusted asn1_encoder tee tpm crct10dif_pclmul crc32_pclmul crc>
Jun 17 09:05:25 hans-pc kernel: CPU: 8 PID: 1429 Comm: irq/119-nvidia Tainted: P        W  OE     5.13.0-1-MANJARO #1
Jun 17 09:05:25 hans-pc kernel: Hardware name: System manufacturer System Product Name/PRIME X570-PRO, BIOS 2203 06/17/2020
Jun 17 09:05:25 hans-pc kernel: RIP: 0010:kfence_unprotect+0x18/0x30
Jun 17 09:05:25 hans-pc kernel: Code: 05 cc e1 53 01 00 c3 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 48 81 e7 00 f0 ff ff 31 f6 e8 fd fe ff ff 84 c0 74 01 c3 <0f> 0b c6 05 9f e1 53 01 00 c3 66 66 2e 0f 1f 84 00 00 00 00 00 0f
Jun 17 09:05:25 hans-pc kernel: RSP: 0018:ffffbb124497fc40 EFLAGS: 00010046
Jun 17 09:05:25 hans-pc kernel: RAX: 0000000000000000 RBX: 0000000000000000 RCX: ffffffff91810000
Jun 17 09:05:25 hans-pc kernel: RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffffffff91810000
Jun 17 09:05:25 hans-pc kernel: RBP: 0000000000000658 R08: 0000000000000000 R09: 0000000000000000
Jun 17 09:05:25 hans-pc kernel: R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000002
Jun 17 09:05:25 hans-pc kernel: R13: ffffbb124497fcd8 R14: 0000000000000002 R15: 0000000000000000
Jun 17 09:05:25 hans-pc kernel: FS:  0000000000000000(0000) GS:ffffa0c60ec00000(0000) knlGS:0000000000000000
Jun 17 09:05:25 hans-pc kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jun 17 09:05:25 hans-pc kernel: CR2: 0000000000000658 CR3: 000000014cd3c000 CR4: 0000000000350ee0
Jun 17 09:05:25 hans-pc kernel: Call Trace:
Jun 17 09:05:25 hans-pc kernel:  page_fault_oops+0x9d/0x2d0
Jun 17 09:05:25 hans-pc kernel:  ? _nv028690rm+0xa9/0x130 [nvidia]
Jun 17 09:05:25 hans-pc kernel:  ? _nv039630rm+0x5e/0x1d0 [nvidia]
Jun 17 09:05:25 hans-pc kernel:  exc_page_fault+0x7b/0x180
Jun 17 09:05:25 hans-pc kernel:  asm_exc_page_fault+0x1e/0x30
Jun 17 09:05:25 hans-pc kernel: RIP: 0010:_nv024993rm+0x22/0x1a0 [nvidia]
Jun 17 09:05:25 hans-pc kernel: Code: b8 1f 00 00 00 f3 c3 90 41 57 41 56 49 89 ce 41 55 41 54 49 89 fc 53 48 83 ed 20 48 85 c9 48 89 f3 89 55 0c 0f 84 4e 01 00 00 <48> c7 01 00 00 00 00 48 c7 41 08 00 00 00 00 48 8b 86 a8 01 00 00
Jun 17 09:05:25 hans-pc kernel: RSP: 0018:ffffbb124497fd80 EFLAGS: 00010202
Jun 17 09:05:25 hans-pc kernel: RAX: ffffffffc0c54830 RBX: ffffa0bf2d18b008 RCX: 0000000000000658
Jun 17 09:05:25 hans-pc kernel: RDX: 0000000000000001 RSI: ffffa0bf2d18b008 RDI: ffffa0bf39dec008
Jun 17 09:05:25 hans-pc kernel: RBP: ffffa0bf39d9abb0 R08: 0000000000000020 R09: ffffa0bf2d18b008
Jun 17 09:05:25 hans-pc kernel: R10: ffffa0bf39dec008 R11: 0000000080000000 R12: ffffa0bf39dec008
Jun 17 09:05:25 hans-pc kernel: R13: ffffa0bf39f9a008 R14: 0000000000000658 R15: ffffa0bf39f0a008
Jun 17 09:05:25 hans-pc kernel:  ? _nv024987rm+0x50/0x50 [nvidia]
Jun 17 09:05:25 hans-pc kernel:  ? _nv024016rm+0x1eb/0x1300 [nvidia]
Jun 17 09:05:25 hans-pc kernel:  ? _nv028944rm+0xcde/0xe70 [nvidia]
Jun 17 09:05:25 hans-pc kernel:  ? _nv028952rm+0x172/0x420 [nvidia]
Jun 17 09:05:25 hans-pc kernel:  ? _nv000715rm+0xb1/0x250 [nvidia]
Jun 17 09:05:25 hans-pc kernel:  ? disable_irq_nosync+0x10/0x10
Jun 17 09:05:25 hans-pc kernel:  ? rm_isr_bh+0x1c/0x60 [nvidia]
Jun 17 09:05:25 hans-pc kernel:  ? nvidia_isr_kthread_bh+0x1b/0x40 [nvidia]
Jun 17 09:05:25 hans-pc kernel:  ? irq_thread_fn+0x20/0x60
Jun 17 09:05:25 hans-pc kernel:  ? irq_thread+0xf2/0x1a0
Jun 17 09:05:25 hans-pc kernel:  ? irq_finalize_oneshot.part.0+0xe0/0xe0
Jun 17 09:05:25 hans-pc kernel:  ? irq_thread_check_affinity+0xd0/0xd0
Jun 17 09:05:25 hans-pc kernel:  ? kthread+0x133/0x150
Jun 17 09:05:25 hans-pc kernel:  ? kthread_associate_blkcg+0xc0/0xc0
Jun 17 09:05:25 hans-pc kernel:  ? ret_from_fork+0x22/0x30
Jun 17 09:05:25 hans-pc kernel: ---[ end trace a43e3fb77e27d75d ]---
Jun 17 09:05:25 hans-pc kernel: BUG: kernel NULL pointer dereference, address: 0000000000000658
Jun 17 09:05:25 hans-pc kernel: #PF: supervisor write access in kernel mode
Jun 17 09:05:25 hans-pc kernel: #PF: error_code(0x0002) - not-present page
Jun 17 09:05:25 hans-pc kernel: PGD 135bca067 P4D 135bca067 PUD 0 
Jun 17 09:05:25 hans-pc kernel: Oops: 0002 [#1] PREEMPT SMP NOPTI
Jun 17 09:05:25 hans-pc kernel: CPU: 8 PID: 1429 Comm: irq/119-nvidia Tainted: P        W  OE     5.13.0-1-MANJARO #1
Jun 17 09:05:25 hans-pc kernel: Hardware name: System manufacturer System Product Name/PRIME X570-PRO, BIOS 2203 06/17/2020
Jun 17 09:05:25 hans-pc kernel: RIP: 0010:_nv024993rm+0x22/0x1a0 [nvidia]
Jun 17 09:05:25 hans-pc kernel: Code: b8 1f 00 00 00 f3 c3 90 41 57 41 56 49 89 ce 41 55 41 54 49 89 fc 53 48 83 ed 20 48 85 c9 48 89 f3 89 55 0c 0f 84 4e 01 00 00 <48> c7 01 00 00 00 00 48 c7 41 08 00 00 00 00 48 8b 86 a8 01 00 00
Jun 17 09:05:25 hans-pc kernel: RSP: 0018:ffffbb124497fd80 EFLAGS: 00010202
Jun 17 09:05:25 hans-pc kernel: RAX: ffffffffc0c54830 RBX: ffffa0bf2d18b008 RCX: 0000000000000658
Jun 17 09:05:25 hans-pc kernel: RDX: 0000000000000001 RSI: ffffa0bf2d18b008 RDI: ffffa0bf39dec008
Jun 17 09:05:25 hans-pc kernel: RBP: ffffa0bf39d9abb0 R08: 0000000000000020 R09: ffffa0bf2d18b008
Jun 17 09:05:25 hans-pc kernel: R10: ffffa0bf39dec008 R11: 0000000080000000 R12: ffffa0bf39dec008
Jun 17 09:05:25 hans-pc kernel: R13: ffffa0bf39f9a008 R14: 0000000000000658 R15: ffffa0bf39f0a008
Jun 17 09:05:25 hans-pc kernel: FS:  0000000000000000(0000) GS:ffffa0c60ec00000(0000) knlGS:0000000000000000
Jun 17 09:05:25 hans-pc kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jun 17 09:05:25 hans-pc kernel: CR2: 0000000000000658 CR3: 000000014cd3c000 CR4: 0000000000350ee0
Jun 17 09:05:25 hans-pc kernel: Call Trace:
Jun 17 09:05:25 hans-pc kernel:  ? _nv024016rm+0x1eb/0x1300 [nvidia]
Jun 17 09:05:25 hans-pc kernel:  ? _nv028944rm+0xcde/0xe70 [nvidia]
Jun 17 09:05:25 hans-pc kernel:  ? _nv028952rm+0x172/0x420 [nvidia]
Jun 17 09:05:25 hans-pc kernel:  ? _nv000715rm+0xb1/0x250 [nvidia]
Jun 17 09:05:25 hans-pc kernel:  ? disable_irq_nosync+0x10/0x10
Jun 17 09:05:25 hans-pc kernel:  ? rm_isr_bh+0x1c/0x60 [nvidia]
Jun 17 09:05:25 hans-pc kernel:  ? nvidia_isr_kthread_bh+0x1b/0x40 [nvidia]
Jun 17 09:05:25 hans-pc kernel:  ? irq_thread_fn+0x20/0x60
Jun 17 09:05:25 hans-pc kernel:  ? irq_thread+0xf2/0x1a0
Jun 17 09:05:25 hans-pc kernel:  ? irq_finalize_oneshot.part.0+0xe0/0xe0
Jun 17 09:05:25 hans-pc kernel:  ? irq_thread_check_affinity+0xd0/0xd0
Jun 17 09:05:25 hans-pc kernel:  ? kthread+0x133/0x150
Jun 17 09:05:25 hans-pc kernel:  ? kthread_associate_blkcg+0xc0/0xc0
Jun 17 09:05:25 hans-pc kernel:  ? ret_from_fork+0x22/0x30
Jun 17 09:05:25 hans-pc kernel: Modules linked in: joydev cdc_acm snd_usb_audio snd_usbmidi_lib snd_rawmidi snd_seq_device mousedev corsair_psu mc intel_rapl_msr ip6t_REJECT nf_reject_ipv6 eeepc_wmi asus_wmi sparse_keymap rfkill xt_hl video wmi_bmof mxm_wmi ip6t_rt ipt_REJECT nf_reject_ipv4 xt_LOG nf_log_syslog xt_l>
Jun 17 09:05:25 hans-pc kernel:  pinctrl_amd acpi_cpufreq vboxnetflt(OE) vboxnetadp(OE) vboxdrv(OE) sg fuse crypto_user ip_tables x_tables ext4 crc32c_generic crc16 mbcache jbd2 hid_logitech_hidpp hid_logitech_dj usbhid dm_crypt cbc encrypted_keys dm_mod trusted asn1_encoder tee tpm crct10dif_pclmul crc32_pclmul crc>
Jun 17 09:05:25 hans-pc kernel: CR2: 0000000000000658
Jun 17 09:05:25 hans-pc kernel: ---[ end trace a43e3fb77e27d75e ]---
Jun 17 09:05:25 hans-pc kernel: RIP: 0010:_nv024993rm+0x22/0x1a0 [nvidia]
Jun 17 09:05:25 hans-pc kernel: Code: b8 1f 00 00 00 f3 c3 90 41 57 41 56 49 89 ce 41 55 41 54 49 89 fc 53 48 83 ed 20 48 85 c9 48 89 f3 89 55 0c 0f 84 4e 01 00 00 <48> c7 01 00 00 00 00 48 c7 41 08 00 00 00 00 48 8b 86 a8 01 00 00
Jun 17 09:05:25 hans-pc kernel: RSP: 0018:ffffbb124497fd80 EFLAGS: 00010202
Jun 17 09:05:25 hans-pc kernel: RAX: ffffffffc0c54830 RBX: ffffa0bf2d18b008 RCX: 0000000000000658
Jun 17 09:05:25 hans-pc kernel: RDX: 0000000000000001 RSI: ffffa0bf2d18b008 RDI: ffffa0bf39dec008
Jun 17 09:05:25 hans-pc kernel: RBP: ffffa0bf39d9abb0 R08: 0000000000000020 R09: ffffa0bf2d18b008
Jun 17 09:05:25 hans-pc kernel: R10: ffffa0bf39dec008 R11: 0000000080000000 R12: ffffa0bf39dec008
Jun 17 09:05:25 hans-pc kernel: R13: ffffa0bf39f9a008 R14: 0000000000000658 R15: ffffa0bf39f0a008
Jun 17 09:05:25 hans-pc kernel: FS:  0000000000000000(0000) GS:ffffa0c60ec00000(0000) knlGS:0000000000000000
Jun 17 09:05:25 hans-pc kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jun 17 09:05:25 hans-pc kernel: CR2: 0000000000000658 CR3: 000000014cd3c000 CR4: 0000000000350ee0
Jun 17 09:05:25 hans-pc kernel: ------------[ cut here ]------------
Jun 17 09:05:25 hans-pc kernel: WARNING: CPU: 8 PID: 1429 at arch/x86/include/asm/kfence.h:44 kfence_protect_page+0x39/0xc0
Jun 17 09:05:25 hans-pc kernel: Modules linked in: joydev cdc_acm snd_usb_audio snd_usbmidi_lib snd_rawmidi snd_seq_device mousedev corsair_psu mc intel_rapl_msr ip6t_REJECT nf_reject_ipv6 eeepc_wmi asus_wmi sparse_keymap rfkill xt_hl video wmi_bmof mxm_wmi ip6t_rt ipt_REJECT nf_reject_ipv4 xt_LOG nf_log_syslog xt_l>
Jun 17 09:05:25 hans-pc kernel:  pinctrl_amd acpi_cpufreq vboxnetflt(OE) vboxnetadp(OE) vboxdrv(OE) sg fuse crypto_user ip_tables x_tables ext4 crc32c_generic crc16 mbcache jbd2 hid_logitech_hidpp hid_logitech_dj usbhid dm_crypt cbc encrypted_keys dm_mod trusted asn1_encoder tee tpm crct10dif_pclmul crc32_pclmul crc>
Jun 17 09:05:25 hans-pc kernel: CPU: 8 PID: 1429 Comm: irq/119-nvidia Tainted: P      D W  OE     5.13.0-1-MANJARO #1
Jun 17 09:05:25 hans-pc kernel: Hardware name: System manufacturer System Product Name/PRIME X570-PRO, BIOS 2203 06/17/2020
Jun 17 09:05:25 hans-pc kernel: RIP: 0010:kfence_protect_page+0x39/0xc0
Jun 17 09:05:25 hans-pc kernel: Code: 25 28 00 00 00 48 89 44 24 08 31 c0 48 8d 74 24 04 c7 44 24 04 00 00 00 00 e8 a3 da db ff 48 85 c0 74 07 83 7c 24 04 01 74 06 <0f> 0b 31 c0 eb 4c 48 8b 38 48 89 c2 84 db 75 59 48 89 f8 0f 1f 40
Jun 17 09:05:25 hans-pc kernel: RSP: 0018:ffffbb124497fcd8 EFLAGS: 00010046
Jun 17 09:05:25 hans-pc kernel: RAX: 0000000000000000 RBX: 0000000000000000 RCX: ffffffff91810000
Jun 17 09:05:25 hans-pc kernel: RDX: ffffbb124497fcdc RSI: 0000000000000000 RDI: ffffffff91810000
Jun 17 09:05:25 hans-pc kernel: RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000
Jun 17 09:05:25 hans-pc kernel: R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000002
Jun 17 09:05:25 hans-pc kernel: R13: ffffbb124497fd98 R14: 0000000000000002 R15: 0000000000000000
Jun 17 09:05:25 hans-pc kernel: FS:  0000000000000000(0000) GS:ffffa0c60ec00000(0000) knlGS:0000000000000000
Jun 17 09:05:25 hans-pc kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jun 17 09:05:25 hans-pc kernel: CR2: 00000000000009e1 CR3: 000000014cd3c000 CR4: 0000000000350ee0
Jun 17 09:05:25 hans-pc kernel: Call Trace:
Jun 17 09:05:25 hans-pc kernel:  kfence_unprotect+0x13/0x30
Jun 17 09:05:25 hans-pc kernel:  page_fault_oops+0x9d/0x2d0
Jun 17 09:05:25 hans-pc kernel:  ? _nv024987rm+0x50/0x50 [nvidia]
Jun 17 09:05:25 hans-pc kernel:  exc_page_fault+0x7b/0x180
Jun 17 09:05:25 hans-pc kernel:  asm_exc_page_fault+0x1e/0x30
Jun 17 09:05:25 hans-pc kernel: RIP: 0010:mutex_lock+0x19/0x30
Jun 17 09:05:25 hans-pc kernel: Code: 00 0f 1f 44 00 00 be 02 00 00 00 e9 21 fa ff ff 90 0f 1f 44 00 00 55 48 89 fd 66 66 48 31 c0 31 c0 65 48 8b 14 25 c0 7b 01 00 <f0> 48 0f b1 55 00 75 02 5d c3 48 89 ef 5d eb c7 0f 1f 80 00 00 00
Jun 17 09:05:25 hans-pc kernel: RSP: 0018:ffffbb124497fe48 EFLAGS: 00010246
Jun 17 09:05:25 hans-pc kernel: RAX: 0000000000000000 RBX: 0000000000000001 RCX: 0000000000000000
Jun 17 09:05:25 hans-pc kernel: RDX: ffffa0bf20508000 RSI: 0000000000001c01 RDI: 00000000000009e1
Jun 17 09:05:25 hans-pc kernel: RBP: 00000000000009e1 R08: 0000000000000001 R09: 0000000000000001
Jun 17 09:05:25 hans-pc kernel: R10: ffffbb124497f900 R11: ffffa0c62f2aa8a8 R12: 00000000000009e1
Jun 17 09:05:25 hans-pc kernel: R13: ffffbb124497fcd8 R14: ffffa0bf20508000 R15: 0000000000000000
Jun 17 09:05:25 hans-pc kernel:  perf_event_exit_task+0x30/0x2a0
Jun 17 09:05:25 hans-pc kernel:  do_exit+0x385/0xa50
Jun 17 09:05:25 hans-pc kernel:  ? task_work_run+0x5c/0x90
Jun 17 09:05:25 hans-pc kernel:  ? do_exit+0x375/0xa50
Jun 17 09:05:25 hans-pc kernel:  ? kthread+0x133/0x150
Jun 17 09:05:25 hans-pc kernel:  ? rewind_stack_do_exit+0x17/0x17
Jun 17 09:05:25 hans-pc kernel: ---[ end trace a43e3fb77e27d75f ]---
Jun 17 09:05:25 hans-pc kernel: ------------[ cut here ]------------
Jun 17 09:05:25 hans-pc kernel: WARNING: CPU: 8 PID: 1429 at mm/kfence/core.c:135 kfence_unprotect+0x18/0x30
Jun 17 09:05:25 hans-pc kernel: Modules linked in: joydev cdc_acm snd_usb_audio snd_usbmidi_lib snd_rawmidi snd_seq_device mousedev corsair_psu mc intel_rapl_msr ip6t_REJECT nf_reject_ipv6 eeepc_wmi asus_wmi sparse_keymap rfkill xt_hl video wmi_bmof mxm_wmi ip6t_rt ipt_REJECT nf_reject_ipv4 xt_LOG nf_log_syslog xt_l>
Jun 17 09:05:25 hans-pc kernel:  pinctrl_amd acpi_cpufreq vboxnetflt(OE) vboxnetadp(OE) vboxdrv(OE) sg fuse crypto_user ip_tables x_tables ext4 crc32c_generic crc16 mbcache jbd2 hid_logitech_hidpp hid_logitech_dj usbhid dm_crypt cbc encrypted_keys dm_mod trusted asn1_encoder tee tpm crct10dif_pclmul crc32_pclmul crc>
Jun 17 09:05:25 hans-pc kernel: CPU: 8 PID: 1429 Comm: irq/119-nvidia Tainted: P      D W  OE     5.13.0-1-MANJARO #1
Jun 17 09:05:25 hans-pc kernel: Hardware name: System manufacturer System Product Name/PRIME X570-PRO, BIOS 2203 06/17/2020
Jun 17 09:05:25 hans-pc kernel: RIP: 0010:kfence_unprotect+0x18/0x30
Jun 17 09:05:25 hans-pc kernel: Code: 05 cc e1 53 01 00 c3 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 48 81 e7 00 f0 ff ff 31 f6 e8 fd fe ff ff 84 c0 74 01 c3 <0f> 0b c6 05 9f e1 53 01 00 c3 66 66 2e 0f 1f 84 00 00 00 00 00 0f
Jun 17 09:05:25 hans-pc kernel: RSP: 0018:ffffbb124497fd00 EFLAGS: 00010046
Jun 17 09:05:25 hans-pc kernel: RAX: 0000000000000000 RBX: 0000000000000000 RCX: ffffffff91810000
Jun 17 09:05:25 hans-pc kernel: RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffffffff91810000
Jun 17 09:05:25 hans-pc kernel: RBP: 00000000000009e1 R08: 0000000000000000 R09: 0000000000000000
Jun 17 09:05:25 hans-pc kernel: R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000002
Jun 17 09:05:25 hans-pc kernel: R13: ffffbb124497fd98 R14: 0000000000000002 R15: 0000000000000000
Jun 17 09:05:25 hans-pc kernel: FS:  0000000000000000(0000) GS:ffffa0c60ec00000(0000) knlGS:0000000000000000
Jun 17 09:05:25 hans-pc kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jun 17 09:05:25 hans-pc kernel: CR2: 00000000000009e1 CR3: 000000014cd3c000 CR4: 0000000000350ee0
Jun 17 09:05:25 hans-pc kernel: Call Trace:
Jun 17 09:05:25 hans-pc kernel:  page_fault_oops+0x9d/0x2d0
Jun 17 09:05:25 hans-pc kernel:  ? _nv024987rm+0x50/0x50 [nvidia]
Jun 17 09:05:25 hans-pc kernel:  exc_page_fault+0x7b/0x180
Jun 17 09:05:25 hans-pc kernel:  asm_exc_page_fault+0x1e/0x30
Jun 17 09:05:25 hans-pc kernel: RIP: 0010:mutex_lock+0x19/0x30
Jun 17 09:05:25 hans-pc kernel: Code: 00 0f 1f 44 00 00 be 02 00 00 00 e9 21 fa ff ff 90 0f 1f 44 00 00 55 48 89 fd 66 66 48 31 c0 31 c0 65 48 8b 14 25 c0 7b 01 00 <f0> 48 0f b1 55 00 75 02 5d c3 48 89 ef 5d eb c7 0f 1f 80 00 00 00
Jun 17 09:05:25 hans-pc kernel: RSP: 0018:ffffbb124497fe48 EFLAGS: 00010246
Jun 17 09:05:25 hans-pc kernel: RAX: 0000000000000000 RBX: 0000000000000001 RCX: 0000000000000000
Jun 17 09:05:25 hans-pc kernel: RDX: ffffa0bf20508000 RSI: 0000000000001c01 RDI: 00000000000009e1
Jun 17 09:05:25 hans-pc kernel: RBP: 00000000000009e1 R08: 0000000000000001 R09: 0000000000000001
Jun 17 09:05:25 hans-pc kernel: R10: ffffbb124497f900 R11: ffffa0c62f2aa8a8 R12: 00000000000009e1
Jun 17 09:05:25 hans-pc kernel: R13: ffffbb124497fcd8 R14: ffffa0bf20508000 R15: 0000000000000000
Jun 17 09:05:25 hans-pc kernel:  perf_event_exit_task+0x30/0x2a0
Jun 17 09:05:25 hans-pc kernel:  do_exit+0x385/0xa50
Jun 17 09:05:25 hans-pc kernel:  ? task_work_run+0x5c/0x90
Jun 17 09:05:25 hans-pc kernel:  ? do_exit+0x375/0xa50
Jun 17 09:05:25 hans-pc kernel:  ? kthread+0x133/0x150
Jun 17 09:05:25 hans-pc kernel:  ? rewind_stack_do_exit+0x17/0x17
Jun 17 09:05:25 hans-pc kernel: ---[ end trace a43e3fb77e27d760 ]---
Jun 17 09:05:25 hans-pc kernel: BUG: kernel NULL pointer dereference, address: 00000000000009e1
Jun 17 09:05:25 hans-pc kernel: #PF: supervisor write access in kernel mode
Jun 17 09:05:25 hans-pc kernel: #PF: error_code(0x0002) - not-present page
Jun 17 09:05:25 hans-pc kernel: PGD 135bca067 P4D 135bca067 PUD 0 
Jun 17 09:05:25 hans-pc kernel: Oops: 0002 [#2] PREEMPT SMP NOPTI
Jun 17 09:05:25 hans-pc kernel: CPU: 8 PID: 1429 Comm: irq/119-nvidia Tainted: P      D W  OE     5.13.0-1-MANJARO #1
Jun 17 09:05:25 hans-pc kernel: Hardware name: System manufacturer System Product Name/PRIME X570-PRO, BIOS 2203 06/17/2020
Jun 17 09:05:25 hans-pc kernel: RIP: 0010:mutex_lock+0x19/0x30
Jun 17 09:05:25 hans-pc kernel: Code: 00 0f 1f 44 00 00 be 02 00 00 00 e9 21 fa ff ff 90 0f 1f 44 00 00 55 48 89 fd 66 66 48 31 c0 31 c0 65 48 8b 14 25 c0 7b 01 00 <f0> 48 0f b1 55 00 75 02 5d c3 48 89 ef 5d eb c7 0f 1f 80 00 00 00
Jun 17 09:05:25 hans-pc kernel: RSP: 0018:ffffbb124497fe48 EFLAGS: 00010246
Jun 17 09:05:25 hans-pc kernel: RAX: 0000000000000000 RBX: 0000000000000001 RCX: 0000000000000000
Jun 17 09:05:25 hans-pc kernel: RDX: ffffa0bf20508000 RSI: 0000000000001c01 RDI: 00000000000009e1
Jun 17 09:05:25 hans-pc kernel: RBP: 00000000000009e1 R08: 0000000000000001 R09: 0000000000000001
Jun 17 09:05:25 hans-pc kernel: R10: ffffbb124497f900 R11: ffffa0c62f2aa8a8 R12: 00000000000009e1
Jun 17 09:05:25 hans-pc kernel: R13: ffffbb124497fcd8 R14: ffffa0bf20508000 R15: 0000000000000000
Jun 17 09:05:25 hans-pc kernel: FS:  0000000000000000(0000) GS:ffffa0c60ec00000(0000) knlGS:0000000000000000
Jun 17 09:05:25 hans-pc kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jun 17 09:05:25 hans-pc kernel: CR2: 00000000000009e1 CR3: 000000014cd3c000 CR4: 0000000000350ee0
Jun 17 09:05:25 hans-pc kernel: Call Trace:
Jun 17 09:05:25 hans-pc kernel:  perf_event_exit_task+0x30/0x2a0
Jun 17 09:05:25 hans-pc kernel:  do_exit+0x385/0xa50
Jun 17 09:05:25 hans-pc kernel:  ? task_work_run+0x5c/0x90
Jun 17 09:05:25 hans-pc kernel:  ? do_exit+0x375/0xa50
Jun 17 09:05:25 hans-pc kernel:  ? kthread+0x133/0x150
Jun 17 09:05:25 hans-pc kernel:  ? rewind_stack_do_exit+0x17/0x17
Jun 17 09:05:25 hans-pc kernel: Modules linked in: joydev cdc_acm snd_usb_audio snd_usbmidi_lib snd_rawmidi snd_seq_device mousedev corsair_psu mc intel_rapl_msr ip6t_REJECT nf_reject_ipv6 eeepc_wmi asus_wmi sparse_keymap rfkill xt_hl video wmi_bmof mxm_wmi ip6t_rt ipt_REJECT nf_reject_ipv4 xt_LOG nf_log_syslog xt_l>
Jun 17 09:05:25 hans-pc kernel:  pinctrl_amd acpi_cpufreq vboxnetflt(OE) vboxnetadp(OE) vboxdrv(OE) sg fuse crypto_user ip_tables x_tables ext4 crc32c_generic crc16 mbcache jbd2 hid_logitech_hidpp hid_logitech_dj usbhid dm_crypt cbc encrypted_keys dm_mod trusted asn1_encoder tee tpm crct10dif_pclmul crc32_pclmul crc>
Jun 17 09:05:25 hans-pc kernel: CR2: 00000000000009e1
Jun 17 09:05:25 hans-pc kernel: ---[ end trace a43e3fb77e27d761 ]---
Jun 17 09:05:25 hans-pc kernel: RIP: 0010:_nv024993rm+0x22/0x1a0 [nvidia]
Jun 17 09:05:25 hans-pc kernel: Code: b8 1f 00 00 00 f3 c3 90 41 57 41 56 49 89 ce 41 55 41 54 49 89 fc 53 48 83 ed 20 48 85 c9 48 89 f3 89 55 0c 0f 84 4e 01 00 00 <48> c7 01 00 00 00 00 48 c7 41 08 00 00 00 00 48 8b 86 a8 01 00 00
Jun 17 09:05:25 hans-pc kernel: RSP: 0018:ffffbb124497fd80 EFLAGS: 00010202
Jun 17 09:05:25 hans-pc kernel: RAX: ffffffffc0c54830 RBX: ffffa0bf2d18b008 RCX: 0000000000000658
Jun 17 09:05:25 hans-pc kernel: RDX: 0000000000000001 RSI: ffffa0bf2d18b008 RDI: ffffa0bf39dec008
Jun 17 09:05:25 hans-pc kernel: RBP: ffffa0bf39d9abb0 R08: 0000000000000020 R09: ffffa0bf2d18b008
Jun 17 09:05:25 hans-pc kernel: R10: ffffa0bf39dec008 R11: 0000000080000000 R12: ffffa0bf39dec008
Jun 17 09:05:25 hans-pc kernel: R13: ffffa0bf39f9a008 R14: 0000000000000658 R15: ffffa0bf39f0a008
Jun 17 09:05:25 hans-pc kernel: FS:  0000000000000000(0000) GS:ffffa0c60ec00000(0000) knlGS:0000000000000000
Jun 17 09:05:25 hans-pc kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jun 17 09:05:25 hans-pc kernel: CR2: 00000000000009e1 CR3: 000000014cd3c000 CR4: 0000000000350ee0
Jun 17 09:05:25 hans-pc kernel: Fixing recursive fault but reboot is needed!

Hopefully there is some way to find a fix for this… I have no clue what’s wrong (I’ve got no pending updates to install), and I seriously consider reinstalling my system to “fix” this issue that’s been hunting me for several weeks.

Hey,

I would first consider updating the BIOS

Wonder if by adding to /etc/X11/mhwd.d/nvidia.conf in the Section "Device" this line

Option  "ConnectToAcpid"    "Off"

and reboot it will make a difference. Did you tweak that configuration ?

Also, maybe worth switching to testing and make use of the latest 470.42 nvidia driver … :man_shrugging:

Thanks for the suggestions. I will try 1 at a time and test drive it for a bit. Sometimes the hangs/crashes pops up after a few minutes, sometimes it takes a couple of hours.

I have noticed the BIOS date as well, and so updated it to the latest version 4002. Let’s see if that makes a difference (that would confuse me though, as Windows and my previous Manjaro install from a few months ago, ran fine).

It appears that a BIOS update has fixed this issue. I haven’t had a crash ever since.

Perhaps there was some underlying instability or incompatibility on this system. However, I’m not pushing/overclocking any of the components (myself), so that would be kind of odd.