Long pause when doing a reboot

Support
1

My system has started taking a long time to do a restart or shutdown.
I think this happened after I created an auto mount of a NAS drive with systemd
What log files do I need to provide to try to troubleshoot this issue.
Here is my system info:

System:
  Host: manjaro Kernel: 5.16.4-1-MANJARO x86_64 bits: 64 compiler: gcc
    v: 11.1.0 Desktop: KDE Plasma 5.23.5 tk: Qt 5.15.2 info: latte-dock
    wm: kwin_x11 vt: 1 dm: SDDM Distro: Manjaro Linux base: Arch Linux
Machine:
  Type: Convertible System: HP product: HP Spectre x360 Convertible 15-df1xxx
    v: N/A serial: <superuser required> Chassis: type: 31
    serial: <superuser required>
  Mobo: HP model: 863F v: 54.24 serial: <superuser required> UEFI: AMI
    v: F.26 date: 07/09/2021
Battery:
  ID-1: BAT0 charge: 53.0 Wh (78.9%) condition: 67.2/67.2 Wh (100.0%)
    volts: 12.3 min: 11.6 model: HP Primary type: Li-ion serial: SerialNumber
    status: N/A cycles: 170
  Device-1: hid-0018:04F3:2992.0001-battery model: ELAN2514:00 04F3:2992
    serial: N/A charge: N/A status: N/A
CPU:
  Info: quad core model: Intel Core i7-10510U bits: 64 type: MT MCP
    smt: enabled arch: Comet/Whiskey Lake note: check rev: C cache: L1: 256 KiB
    L2: 1024 KiB L3: 8 MiB
  Speed (MHz): avg: 3691 high: 4303 min/max: 400/4900 cores: 1: 4303
    2: 4301 3: 4025 4: 4300 5: 2699 6: 1420 7: 4301 8: 4179 bogomips: 36812
  Flags: avx avx2 ht lm nx pae sse sse2 sse3 sse4_1 sse4_2 ssse3 vmx
Graphics:
  Device-1: Intel CometLake-U GT2 [UHD Graphics] vendor: Hewlett-Packard
    driver: i915 v: kernel bus-ID: 00:02.0 chip-ID: 8086:9b41 class-ID: 0300
  Device-2: NVIDIA GP108M [GeForce MX250] vendor: Hewlett-Packard
    driver: nvidia v: 495.46 bus-ID: 3b:00.0 chip-ID: 10de:1d13 class-ID: 0302
  Device-3: Chicony HP Wide Vision FHD Camera type: USB driver: uvcvideo
    bus-ID: 1-5:3 chip-ID: 04f2:b67b class-ID: 0e02 serial: 200901010001
  Display: x11 server: X.org 1.21.1.3 compositor: kwin_x11 driver:
    loaded: modesetting,nvidia unloaded: nouveau alternate: fbdev,nv,vesa
    resolution: <missing: xdpyinfo>
  Message: Unable to show advanced data. Required tool glxinfo missing.
Audio:
  Device-1: Intel Comet Lake PCH-LP cAVS vendor: Hewlett-Packard
    driver: sof-audio-pci-intel-cnl bus-ID: 00:1f.3 chip-ID: 8086:02c8
    class-ID: 0401
  Sound Server-1: ALSA v: k5.16.4-1-MANJARO running: yes
  Sound Server-2: JACK v: 1.9.20 running: no
  Sound Server-3: PulseAudio v: 15.0 running: yes
  Sound Server-4: PipeWire v: 0.3.44 running: yes
Network:
  Device-1: Intel Comet Lake PCH-LP CNVi WiFi driver: iwlwifi v: kernel
    bus-ID: 00:14.3 chip-ID: 8086:02f0 class-ID: 0280
  IF: wlp0s20f3 state: up mac: 0c:dd:24:ab:82:13
Drives:
  Local Storage: total: 931.51 GiB used: 141.08 GiB (15.1%)
  ID-1: /dev/nvme0n1 vendor: Samsung model: SSD 970 EVO Plus 1TB
    size: 931.51 GiB speed: 31.6 Gb/s lanes: 4 type: SSD
    serial: S59ANS0N809758J rev: 2B2QEXM7 temp: 37.9 C scheme: GPT
Partition:
  ID-1: / size: 235 GiB used: 33.92 GiB (14.4%) fs: ext4 dev: /dev/nvme0n1p11
  ID-2: /boot/efi size: 96 MiB used: 66.7 MiB (69.5%) fs: vfat
    dev: /dev/nvme0n1p2
  ID-3: /home size: 319.4 GiB used: 107.09 GiB (33.5%) fs: ext4
    dev: /dev/nvme0n1p7
Swap:
  Alert: No swap data was found.
Sensors:
  System Temperatures: cpu: 46.0 C pch: 45.0 C mobo: N/A
  Fan Speeds (RPM): N/A
Repos:
  Packages: 1373 pacman: 1366 snap: 7
  Active pacman repo servers in: /etc/pacman.d/mirrorlist
    1: https://mirror.math.princeton.edu/pub/manjaro/unstable/$repo/$arch
    2: https://mirror.clarkson.edu/manjaro/unstable/$repo/$arch
    3: https://repo.ialab.dsu.edu/manjaro/unstable/$repo/$arch
    4: https://mirrors.sonic.net/manjaro/unstable/$repo/$arch
    5: https://mirrors.ocf.berkeley.edu/manjaro/unstable/$repo/$arch
    6: https://mirrors.gigenet.com/manjaro/unstable/$repo/$arch
Info:
  Processes: 278 Uptime: 11h 37m wakeups: 1823 Memory: 15.26 GiB
  used: 3.27 GiB (21.4%) Init: systemd v: 250 Compilers: gcc: 11.1.0
  clang: 13.0.0 Shell: Bash v: 5.1.16 running-in: konsole inxi: 3.3.12
2

Output of last -Fx shutdown reboot | head.

Also see this solution to a similar issue:

3 
[demo@manjaro ~]$ last -Fx shutdown reboot | head
reboot   system boot  5.16.4-1-MANJARO Sun Jan 30 09:20:25 2022   still running
shutdown system down  5.16.2-1-MANJARO Sun Jan 30 09:20:09 2022 - Sun Jan 30 09:20:25 2022  (00:00)
reboot   system boot  5.16.2-1-MANJARO Thu Jan 27 12:12:17 2022 - Sun Jan 30 09:20:09 2022 (2+21:07)
shutdown system down  5.16.2-1-MANJARO Thu Jan 27 12:12:01 2022 - Thu Jan 27 12:12:17 2022  (00:00)
reboot   system boot  5.16.2-1-MANJARO Wed Jan 26 20:29:39 2022 - Thu Jan 27 12:12:01 2022  (15:42)
reboot   system boot  5.16.2-1-MANJARO Tue Jan 25 20:18:54 2022 - Thu Jan 27 12:12:01 2022 (1+15:53)
shutdown system down  5.16.2-1-MANJARO Tue Jan 25 20:17:15 2022 - Tue Jan 25 20:18:54 2022  (00:01)
reboot   system boot  5.16.2-1-MANJARO Tue Jan 25 20:16:39 2022 - Tue Jan 25 20:17:15 2022  (00:00)
shutdown system down  5.16.2-1-MANJARO Tue Jan 25 20:16:19 2022 - Tue Jan 25 20:16:39 2022  (00:00)
reboot   system boot  5.16.2-1-MANJARO Mon Jan 24 10:15:04 2022 - Tue Jan 25 20:16:19 2022 (1+10:01)
4

journal log file

5

Output of systemd-analyze blame ?

6 
[demo@manjaro ~]$ systemd-analyze blame
33.675s fstrim.service
 6.663s man-db.service
 1.625s systemd-random-seed.service
 1.435s systemd-modules-load.service
 1.233s ufw.service
 1.074s systemd-networkd.service
 1.021s home-demo-mnt-server-music.mount
  849ms dev-nvme0n1p11.device
  796ms dev-loop5.device
  794ms dev-loop1.device
  794ms dev-loop7.device
  793ms dev-loop2.device
  790ms dev-loop6.device
  789ms dev-loop3.device
  788ms dev-loop4.device
  778ms dev-loop0.device
  407ms apparmor.service
  256ms ldconfig.service
  151ms snapd.service
  138ms cups.service
  132ms systemd-rfkill.service
  131ms boot-efi.mount
  125ms user@1000.service
   97ms systemd-timesyncd.service
   96ms systemd-udev-trigger.service
   94ms polkit.service
   90ms packagekit.service
   86ms systemd-journal-flush.service
   85ms systemd-fsck@dev-disk-by\x2duuid-6865\x2dB8CE.service
   82ms udisks2.service
   77ms systemd-logind.service
   69ms systemd-udevd.service
   64ms upower.service
   64ms lvm2-monitor.service
   59ms logrotate.service
   59ms systemd-sysctl.service
   57ms avahi-daemon.service
   57ms systemd-journald.service
   55ms systemd-tmpfiles-setup.service
   54ms ModemManager.service
   54ms systemd-tmpfiles-clean.service
   51ms snapd.apparmor.service
   46ms NetworkManager.service
   42ms var-lib-snapd-snap-bare-5.mount
   41ms systemd-update-utmp.service
   41ms var-lib-snapd-snap-gtk\x2dcommon\x2dthemes-1519.mount
   40ms var-lib-snapd-snap-snap\x2dstore-558.mount
   40ms var-lib-snapd-snap-core20-1328.mount
   39ms var-lib-snapd-snap-core20-1270.mount
   38ms var-lib-snapd-snap-snapd-14549.mount
   38ms systemd-journal-catalog-update.service
   33ms var-lib-snapd-snap-gnome\x2d3\x2d38\x2d2004-87.mount
   33ms var-lib-snapd-snap-snapd-14295.mount
   27ms systemd-sysusers.service
   26ms pkgfile-update.service
   23ms systemd-tmpfiles-setup-dev.service
   17ms colord.service
   15ms home.mount
   14ms modprobe@fuse.service
   13ms systemd-binfmt.service
    9ms NetworkManager-wait-online.service
    8ms dev-hugepages.mount
    8ms wpa_supplicant.service
    8ms dev-mqueue.mount
    8ms sys-kernel-debug.mount
    8ms systemd-user-sessions.service
    7ms sys-kernel-tracing.mount
    7ms tmp.mount
    7ms user-runtime-dir@1000.service
    7ms systemd-backlight@backlight:intel_backlight.service
    6ms kmod-static-nodes.service
    6ms systemd-update-done.service
    6ms rtkit-daemon.service
    5ms systemd-remount-fs.service
    5ms modprobe@configfs.service
    5ms modprobe@drm.service
    4ms proc-sys-fs-binfmt_misc.mount
    3ms alsa-restore.service
    1ms sys-kernel-config.mount
    1ms sys-fs-fuse-connections.mount
    1ms snapd.socket
7

I am not sure if one should disable this service or not and that too wouldn’t explain why it’s taking

to reboot. Perhaps @Aragorn (a more experienced user) can help.

1 Like
8

After a long shutdown, on the next boot you could run:

journalctl -rb -1

This will show the last boots log, in reverse order (final part of shutdown at top)
So you can scroll down, checking the timestamps, & see at what point a something took a long time.
Typically it all happens in milli-seconds, so if something is timing out you can spot a 90 second delay in the log.

9

I didn’t know how much to include but here it is:

[demo@manjaro ~]$ journalctl -rb -1
Jan 31 14:11:15 manjaro systemd-journald[309]: Journal stopped
Jan 31 14:11:15 manjaro systemd-shutdown[1]: Sending SIGTERM to remaining processes...
Jan 31 14:11:15 manjaro systemd-shutdown[1]: Syncing filesystems and block devices.
Jan 31 14:11:15 manjaro systemd-shutdown[1]: Watchdog running with a timeout of 10min.
Jan 31 14:11:15 manjaro systemd-shutdown[1]: Using hardware watchdog 'iTCO_wdt', version 0, device /dev/watchdog0
Jan 31 14:11:15 manjaro kernel: watchdog: watchdog0: watchdog did not stop!
Jan 31 14:11:15 manjaro systemd[1]: Watchdog running with a timeout of 10min.
Jan 31 14:11:15 manjaro systemd[1]: Using hardware watchdog 'iTCO_wdt', version 0, device /dev/watchdog0
Jan 31 14:11:15 manjaro audit: BPF prog-id=0 op=UNLOAD
Jan 31 14:11:15 manjaro audit: BPF prog-id=0 op=UNLOAD
Jan 31 14:11:15 manjaro audit: BPF prog-id=0 op=UNLOAD
Jan 31 14:11:15 manjaro audit: BPF prog-id=0 op=UNLOAD
Jan 31 14:11:15 manjaro audit: BPF prog-id=0 op=UNLOAD
Jan 31 14:11:15 manjaro audit: BPF prog-id=0 op=UNLOAD
Jan 31 14:11:15 manjaro audit: BPF prog-id=0 op=UNLOAD
Jan 31 14:11:15 manjaro audit: BPF prog-id=0 op=UNLOAD
Jan 31 14:11:15 manjaro systemd[1]: Shutting down.
Jan 31 14:11:15 manjaro systemd[1]: Reached target System Reboot.
Jan 31 14:11:15 manjaro systemd[1]: Finished System Reboot.
Jan 31 14:11:15 manjaro audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 subj==unconfined msg='unit=systemd-reboot comm="systemd" exe="/usr/lib/systemd/sys>
Jan 31 14:11:15 manjaro audit[1]: SERVICE_START pid=1 uid=0 auid=4294967295 ses=4294967295 subj==unconfined msg='unit=systemd-reboot comm="systemd" exe="/usr/lib/systemd/sy>
Jan 31 14:11:15 manjaro systemd[1]: systemd-reboot.service: Deactivated successfully.
Jan 31 14:11:15 manjaro systemd[1]: Reached target Late Shutdown Services.
Jan 31 14:11:15 manjaro systemd[1]: Reached target System Shutdown.
Jan 31 14:11:15 manjaro audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 subj==unconfined msg='unit=lvm2-monitor comm="systemd" exe="/usr/lib/systemd/syste>
Jan 31 14:11:15 manjaro systemd[1]: Stopped Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling.
Jan 31 14:11:15 manjaro systemd[1]: lvm2-monitor.service: Deactivated successfully.
Jan 31 14:11:15 manjaro systemd[1]: Stopped Remount Root and Kernel File Systems.
Jan 31 14:11:15 manjaro systemd[1]: systemd-remount-fs.service: Deactivated successfully.
Jan 31 14:11:15 manjaro systemd[1]: Stopped Create System Users.
Jan 31 14:11:15 manjaro audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 subj==unconfined msg='unit=systemd-remount-fs comm="systemd" exe="/usr/lib/systemd>
Jan 31 14:11:15 manjaro systemd[1]: systemd-sysusers.service: Deactivated successfully.
Jan 31 14:11:15 manjaro audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 subj==unconfined msg='unit=systemd-sysusers comm="systemd" exe="/usr/lib/systemd/s>
Jan 31 14:11:15 manjaro audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 subj==unconfined msg='unit=systemd-tmpfiles-setup-dev comm="systemd" exe="/usr/lib>
Jan 31 14:11:15 manjaro systemd[1]: Stopped Create Static Device Nodes in /dev.
Jan 31 14:11:15 manjaro systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.
Jan 31 14:11:15 manjaro systemd[1]: Stopping Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling...
Jan 31 14:11:15 manjaro systemd[1]: Reached target Unmount All Filesystems.
Jan 31 14:11:15 manjaro systemd[1]: Stopped target Preparation for Local File Systems.
Jan 31 14:11:15 manjaro systemd[1]: Unmounted /home.
Jan 31 14:11:15 manjaro systemd[1]: home.mount: Deactivated successfully.
Jan 31 14:11:15 manjaro systemd[1]: Unmounted Mount unit for gtk-common-themes, revision 1519.
Jan 31 14:11:15 manjaro systemd[1]: var-lib-snapd-snap-gtk\x2dcommon\x2dthemes-1519.mount: Deactivated successfully.
Jan 31 14:11:15 manjaro systemd[1]: Unmounted Mount unit for bare, revision 5.
Jan 31 14:11:15 manjaro systemd[1]: var-lib-snapd-snap-bare-5.mount: Deactivated successfully.
Jan 31 14:11:15 manjaro systemd[1]: Unmounted Mount unit for snapd, revision 14295.
Jan 31 14:11:15 manjaro systemd[1]: var-lib-snapd-snap-snapd-14295.mount: Deactivated successfully.
Jan 31 14:11:15 manjaro systemd[1]: Unmounted Mount unit for snap-store, revision 558.
Jan 31 14:11:15 manjaro systemd[1]: var-lib-snapd-snap-snap\x2dstore-558.mount: Deactivated successfully.
Jan 31 14:11:15 manjaro systemd[1]: Unmounted Mount unit for core20, revision 1270.
Jan 31 14:11:15 manjaro systemd[1]: var-lib-snapd-snap-core20-1270.mount: Deactivated successfully.
Jan 31 14:11:15 manjaro systemd[1]: Unmounted Mount unit for gnome-3-38-2004, revision 87.
Jan 31 14:11:15 manjaro systemd[1]: var-lib-snapd-snap-gnome\x2d3\x2d38\x2d2004-87.mount: Deactivated successfully.
Jan 31 14:11:15 manjaro systemd[1]: Unmounted Mount unit for snapd, revision 14549.
Jan 31 14:11:15 manjaro systemd[1]: var-lib-snapd-snap-snapd-14549.mount: Deactivated successfully.
Jan 31 14:11:15 manjaro systemd[1]: Unmounted Mount unit for core20, revision 1328.
Jan 31 14:11:15 manjaro systemd[1]: var-lib-snapd-snap-core20-1328.mount: Deactivated successfully.
Jan 31 14:11:15 manjaro systemd[1]: Unmounted /run/media/demo/5853e799-bebb-4c86-8c11-a5641cb5ea91.
Jan 31 14:11:15 manjaro systemd[1]: run-media-demo-5853e799\x2dbebb\x2d4c86\x2d8c11\x2da5641cb5ea91.mount: Deactivated successfully.
Jan 31 14:11:15 manjaro systemd[1]: Stopped target Swaps.
Jan 31 14:11:15 manjaro systemd[1]: Unmounted Temporary Directory /tmp.
Jan 31 14:11:15 manjaro systemd[1]: tmp.mount: Deactivated successfully.
Jan 31 14:11:15 manjaro systemd[1]: Removed slice Slice /system/systemd-fsck.
Jan 31 14:11:15 manjaro audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 subj==unconfined msg='unit=systemd-fsck@dev-disk-by\x2duuid-6865\x2dB8CE comm="sys>
Jan 31 14:11:15 manjaro systemd[1]: Stopped File System Check on /dev/disk/by-uuid/6865-B8CE.
Jan 31 14:11:15 manjaro systemd[1]: systemd-fsck@dev-disk-by\x2duuid-6865\x2dB8CE.service: Deactivated successfully.
Jan 31 14:11:15 manjaro systemd[1]: Unmounted /boot/efi.
Jan 31 14:11:15 manjaro systemd[1]: boot-efi.mount: Deactivated successfully.
Jan 31 14:11:15 manjaro audit: BPF prog-id=0 op=UNLOAD
Jan 31 14:11:15 manjaro systemd[1]: Unmounted /run/credentials/systemd-sysusers.service.
Jan 31 14:11:15 manjaro systemd[1]: run-credentials-systemd\x2dsysusers.service.mount: Deactivated successfully.
Jan 31 14:11:15 manjaro systemd[1]: Unmounting Mount unit for snapd, revision 14549...
Jan 31 14:11:15 manjaro systemd[1]: Unmounting Mount unit for snapd, revision 14295...
Jan 31 14:11:15 manjaro systemd[1]: Unmounting Mount unit for snap-store, revision 558...
Jan 31 14:11:15 manjaro systemd[1]: Unmounting Mount unit for gtk-common-themes, revision 1519...
Jan 31 14:11:15 manjaro systemd[1]: Unmounting Mount unit for gnome-3-38-2004, revision 87...
Jan 31 14:11:15 manjaro systemd[1]: Unmounting Mount unit for core20, revision 1328...
Jan 31 14:11:15 manjaro systemd[1]: Unmounting Mount unit for core20, revision 1270...
Jan 31 14:11:15 manjaro systemd[1]: Unmounting Mount unit for bare, revision 5...
Jan 31 14:11:15 manjaro systemd[1]: Unmounting Temporary Directory /tmp...
Jan 31 14:11:15 manjaro systemd[1]: Unmounting /run/media/demo/5853e799-bebb-4c86-8c11-a5641cb5ea91...
Jan 31 14:11:15 manjaro systemd[1]: Unmounting /run/credentials/systemd-sysusers.service...
Jan 31 14:11:15 manjaro systemd[1]: Unmounting /home...
Jan 31 14:11:15 manjaro systemd[1]: Unmounting /boot/efi...
Jan 31 14:11:15 manjaro systemd[1]: Unset automount home-demo-mnt-server-music.automount.
Jan 31 14:11:15 manjaro systemd[1]: home-demo-mnt-server-music.automount: Deactivated successfully.
Jan 31 14:11:15 manjaro systemd[1]: Stopped target Local File Systems.
Jan 31 14:11:15 manjaro audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 subj==unconfined msg='unit=systemd-tmpfiles-setup comm="systemd" exe="/usr/lib/sys>
Jan 31 14:11:15 manjaro systemd[1]: Stopped Create Volatile Files and Directories.
Jan 31 14:11:15 manjaro systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.
Jan 31 14:11:15 manjaro audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 subj==unconfined msg='unit=systemd-update-utmp comm="systemd" exe="/usr/lib/system>
Jan 31 14:11:15 manjaro systemd[1]: Stopped Record System Boot/Shutdown in UTMP.
Jan 31 14:11:15 manjaro systemd[1]: systemd-update-utmp.service: Deactivated successfully.
Jan 31 14:11:15 manjaro audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 subj==unconfined msg='unit=systemd-timesyncd comm="systemd" exe="/usr/lib/systemd/>
Jan 31 14:11:15 manjaro systemd[1]: Stopped Network Time Synchronization.
Jan 31 14:11:15 manjaro systemd[1]: systemd-timesyncd.service: Deactivated successfully.
Jan 31 14:11:15 manjaro systemd[1]: proc-sys-fs-binfmt_misc.mount: Deactivated successfully.
Jan 31 14:11:15 manjaro audit[67246]: SYSTEM_SHUTDOWN pid=67246 uid=0 auid=4294967295 ses=4294967295 subj==unconfined msg=' comm="systemd-update-utmp" exe="/usr/lib/systemd>
Jan 31 14:11:15 manjaro systemd[1]: Unset automount Arbitrary Executable File Formats File System Automount Point.
Jan 31 14:11:15 manjaro systemd[1]: proc-sys-fs-binfmt_misc.automount: Deactivated successfully.
Jan 31 14:11:15 manjaro systemd[1]: Removed slice Slice /system/systemd-backlight.
Jan 31 14:11:15 manjaro audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 subj==unconfined msg='unit=systemd-binfmt comm="systemd" exe="/usr/lib/systemd/sys>
Jan 31 14:11:15 manjaro systemd[1]: Stopped Set Up Additional Binary Formats.
Jan 31 14:11:15 manjaro systemd[1]: systemd-binfmt.service: Deactivated successfully.
Jan 31 14:11:15 manjaro audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 subj==unconfined msg='unit=systemd-backlight@backlight:intel_backlight comm="syste>
Jan 31 14:11:15 manjaro systemd[1]: Stopped Load/Save Screen Backlight Brightness of backlight:intel_backlight.
Jan 31 14:11:15 manjaro systemd[1]: systemd-backlight@backlight:intel_backlight.service: Deactivated successfully.
Jan 31 14:11:15 manjaro systemd[1]: Stopping Record System Boot/Shutdown in UTMP...
Jan 31 14:11:15 manjaro systemd[1]: Stopped Rebuild Journal Catalog.
Jan 31 14:11:15 manjaro systemd[1]: systemd-journal-catalog-update.service: Deactivated successfully.
Jan 31 14:11:15 manjaro systemd[1]: Stopped Rebuild Dynamic Linker Cache.
Jan 31 14:11:15 manjaro systemd[1]: ldconfig.service: Deactivated successfully.
Jan 31 14:11:15 manjaro systemd[1]: Stopped Update is Completed.
Jan 31 14:11:15 manjaro audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 subj==unconfined msg='unit=systemd-journal-catalog-update comm="systemd" exe="/usr>
Jan 31 14:11:15 manjaro audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 subj==unconfined msg='unit=ldconfig comm="systemd" exe="/usr/lib/systemd/systemd" >
Jan 31 14:11:15 manjaro audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 subj==unconfined msg='unit=systemd-update-done comm="systemd" exe="/usr/lib/system>
Jan 31 14:11:15 manjaro kernel: audit: type=1131 audit(1643656275.422:340): pid=1 uid=0 auid=4294967295 ses=4294967295 subj==unconfined msg='unit=ldconfig comm="systemd" ex>
Jan 31 14:11:15 manjaro kernel: audit: type=1131 audit(1643656275.419:339): pid=1 uid=0 auid=4294967295 ses=4294967295 subj==unconfined msg='unit=systemd-update-done comm=">
Jan 31 14:11:15 manjaro kernel: audit: type=1131 audit(1643656275.419:338): pid=1 uid=0 auid=4294967295 ses=4294967295 subj==unconfined msg='unit=systemd-modules-load comm=>
Jan 31 14:11:15 manjaro kernel: audit: type=1131 audit(1643656275.419:337): pid=1 uid=0 auid=4294967295 ses=4294967295 subj==unconfined msg='unit=systemd-sysctl comm="syste>
Jan 31 14:11:15 manjaro systemd[1]: systemd-update-done.service: Deactivated successfully.
Jan 31 14:11:15 manjaro systemd[1]: Stopping Network Time Synchronization...
Jan 31 14:11:15 manjaro systemd[1]: Stopped Load Kernel Modules.
Jan 31 14:11:15 manjaro audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 subj==unconfined msg='unit=systemd-modules-load comm="systemd" exe="/usr/lib/syste>
Jan 31 14:11:15 manjaro systemd[1]: systemd-modules-load.service: Deactivated successfully.
Jan 31 14:11:15 manjaro audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 subj==unconfined msg='unit=systemd-sysctl comm="systemd" exe="/usr/lib/systemd/sys>
Jan 31 14:11:15 manjaro systemd[1]: Stopped Apply Kernel Variables.
Jan 31 14:11:15 manjaro systemd[1]: systemd-sysctl.service: Deactivated successfully.
Jan 31 14:11:15 manjaro systemd[1]: Stopping Set Up Additional Binary Formats...
Jan 31 14:11:15 manjaro systemd[1]: Stopping Load/Save Screen Backlight Brightness of backlight:intel_backlight...
Jan 31 14:11:15 manjaro systemd[1]: Closed Network Service Netlink Socket.
Jan 31 14:11:15 manjaro systemd[1]: systemd-networkd.socket: Deactivated successfully.
Jan 31 14:11:15 manjaro systemd[1]: Stopped target Local Verity Protected Volumes.
Jan 31 14:11:15 manjaro systemd[1]: Stopped target Local Integrity Protected Volumes.
Jan 31 14:11:15 manjaro systemd[1]: Stopped Forward Password Requests to Wall Directory Watch.
Jan 31 14:11:15 manjaro systemd[1]: systemd-ask-password-wall.path: Deactivated successfully.
Jan 31 14:11:15 manjaro systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.
Jan 31 14:11:15 manjaro systemd[1]: systemd-ask-password-console.path: Deactivated successfully.
Jan 31 14:11:15 manjaro systemd[1]: Stopped target Local Encrypted Volumes.
Jan 31 14:11:15 manjaro systemd[1]: Stopped target System Initialization.
Jan 31 14:11:15 manjaro systemd[1]: Closed Socket activation for snappy daemon.
Jan 31 14:11:15 manjaro systemd[1]: snapd.socket: Deactivated successfully.
Jan 31 14:11:15 manjaro systemd[1]: Closed D-Bus System Message Bus Socket.
Jan 31 14:11:15 manjaro systemd[1]: dbus.socket: Deactivated successfully.
Jan 31 14:11:15 manjaro systemd[1]: Closed CUPS Scheduler.
Jan 31 14:11:15 manjaro systemd[1]: cups.socket: Deactivated successfully.
Jan 31 14:11:15 manjaro systemd[1]: Closed Avahi mDNS/DNS-SD Stack Activation Socket.
Jan 31 14:11:15 manjaro systemd[1]: avahi-daemon.socket: Deactivated successfully.
Jan 31 14:11:15 manjaro kernel: audit: type=1131 audit(1643656275.399:336): pid=1 uid=0 auid=4294967295 ses=4294967295 subj==unconfined msg='unit=dbus comm="systemd" exe="/>
Jan 31 14:11:15 manjaro systemd[1]: Stopped target Socket Units.
Jan 31 14:11:15 manjaro systemd[1]: user.slice: Consumed 4h 4min 39.882s CPU time.
Jan 31 14:11:15 manjaro systemd[1]: Removed slice User and Session Slice.
Jan 31 14:11:15 manjaro systemd[1]: Stopped target Slice Units.
Jan 31 14:11:15 manjaro systemd[1]: Stopped CUPS Scheduler.
Jan 31 14:11:15 manjaro systemd[1]: cups.path: Deactivated successfully.
Jan 31 14:11:15 manjaro systemd[1]: Stopped target Path Units.
Jan 31 14:11:15 manjaro systemd[1]: Stopped target Basic System.
Jan 31 14:11:15 manjaro systemd[1]: dbus.service: Consumed 2min 38.618s CPU time.
Jan 31 14:11:15 manjaro audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 subj==unconfined msg='unit=dbus comm="systemd" exe="/usr/lib/systemd/systemd" host>
Jan 31 14:11:15 manjaro systemd[1]: Stopped D-Bus System Message Bus.
Jan 31 14:11:15 manjaro systemd[1]: dbus.service: Deactivated successfully.
Jan 31 14:11:15 manjaro systemd[1]: Stopping D-Bus System Message Bus...
Jan 31 14:11:15 manjaro kernel: audit: type=1131 audit(1643656275.382:335): pid=1 uid=0 auid=4294967295 ses=4294967295 subj==unconfined msg='unit=NetworkManager comm="syste>
Jan 31 14:11:15 manjaro systemd[1]: NetworkManager.service: Consumed 9.643s CPU time.
Jan 31 14:11:15 manjaro audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 subj==unconfined msg='unit=NetworkManager comm="systemd" exe="/usr/lib/systemd/sys>
Jan 31 14:11:15 manjaro systemd[1]: Stopped Network Manager.
Jan 31 14:11:15 manjaro systemd[1]: NetworkManager.service: Deactivated successfully.
Jan 31 14:11:15 manjaro NetworkManager[689]: <info>  [1643656275.3681] exiting (success)
Jan 31 14:11:15 manjaro kernel: audit: type=1131 audit(1643656275.335:334): pid=1 uid=0 auid=4294967295 ses=4294967295 subj==unconfined msg='unit=wpa_supplicant comm="syste>
Jan 31 14:11:15 manjaro dbus-daemon[688]: [system] Activation via systemd failed for unit 'dbus-org.freedesktop.nm-dispatcher.service': Refusing activation, D-Bus is shutti>
Jan 31 14:11:15 manjaro dbus-daemon[688]: [system] Activating via systemd: service name='org.freedesktop.nm_dispatcher' unit='dbus-org.freedesktop.nm-dispatcher.service' re>
Jan 31 14:11:15 manjaro NetworkManager[689]: <info>  [1643656275.3393] device (p2p-dev-wlp0s20f3): state change: disconnected -> unmanaged (reason 'removed', sys-iface-stat>
Jan 31 14:11:15 manjaro audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 subj==unconfined msg='unit=wpa_supplicant comm="systemd" exe="/usr/lib/systemd/sys>
Jan 31 14:11:15 manjaro systemd[1]: Stopped WPA supplicant.
Jan 31 14:11:15 manjaro systemd[1]: wpa_supplicant.service: Deactivated successfully.
Jan 31 14:11:15 manjaro wpa_supplicant[786]: wlp0s20f3: CTRL-EVENT-TERMINATING
Jan 31 14:11:15 manjaro wpa_supplicant[786]: nl80211: deinit ifname=wlp0s20f3 disabled_11b_rates=0
Jan 31 14:11:15 manjaro wpa_supplicant[786]: wlp0s20f3: CTRL-EVENT-DSCP-POLICY clear_all
Jan 31 14:11:15 manjaro kernel: audit: type=1334 audit(1643656275.149:333): prog-id=0 op=UNLOAD
Jan 31 14:11:15 manjaro audit: BPF prog-id=0 op=UNLOAD
Jan 31 14:11:15 manjaro NetworkManager[689]: <info>  [1643656275.1279] device (wlp0s20f3): set-hw-addr: reset MAC address to 0C:DD:24:AB:82:13 (unmanage)
Jan 31 14:11:15 manjaro NetworkManager[689]: <info>  [1643656275.1116] device (wlp0s20f3): state change: disconnected -> unmanaged (reason 'unmanaged', sys-iface-state: 'ma>
Jan 31 14:11:15 manjaro wpa_supplicant[786]: wlp0s20f3: CTRL-EVENT-DSCP-POLICY clear_all
Jan 31 14:11:15 manjaro wpa_supplicant[786]: p2p-dev-wlp0s20: CTRL-EVENT-TERMINATING
Jan 31 14:11:15 manjaro kernel: audit: type=1131 audit(1643656275.082:332): pid=1 uid=0 auid=4294967295 ses=4294967295 subj==unconfined msg='unit=systemd-networkd comm="sys>
Jan 31 14:11:15 manjaro audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 subj==unconfined msg='unit=systemd-networkd comm="systemd" exe="/usr/lib/systemd/s>
Jan 31 14:11:15 manjaro systemd[1]: Stopped Network Configuration.
Jan 31 14:11:15 manjaro systemd[1]: systemd-networkd.service: Deactivated successfully.
Jan 31 14:11:15 manjaro kernel: audit: type=1131 audit(1643656275.075:331): pid=1 uid=0 auid=4294967295 ses=4294967295 subj==unconfined msg='unit=NetworkManager-wait-online>
Jan 31 14:11:15 manjaro kernel: kauditd_printk_skb: 16 callbacks suppressed
Jan 31 14:11:15 manjaro systemd[1]: Stopping WPA supplicant...
Jan 31 14:11:15 manjaro wpa_supplicant[786]: nl80211: deinit ifname=p2p-dev-wlp0s20 disabled_11b_rates=0
Jan 31 14:11:15 manjaro NetworkManager[689]: <info>  [1643656275.0778] caught SIGTERM, shutting down normally.
Jan 31 14:11:15 manjaro wpa_supplicant[786]: p2p-dev-wlp0s20: CTRL-EVENT-DSCP-POLICY clear_all
Jan 31 14:11:15 manjaro systemd[1]: Stopping Network Configuration...
Jan 31 14:11:15 manjaro wpa_supplicant[786]: p2p-dev-wlp0s20: CTRL-EVENT-DSCP-POLICY clear_all
Jan 31 14:11:15 manjaro systemd[1]: Stopping Network Manager...
Jan 31 14:11:15 manjaro systemd[1]: Stopped Network Manager Wait Online.
Jan 31 14:11:15 manjaro systemd[1]: NetworkManager-wait-online.service: Deactivated successfully.
Jan 31 14:11:15 manjaro audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 subj==unconfined msg='unit=NetworkManager-wait-online comm="systemd" exe="/usr/lib>
Jan 31 14:11:15 manjaro systemd[1]: Stopped target Network.
Jan 31 14:11:15 manjaro systemd[1]: Stopped target Network is Online.
Jan 31 14:11:15 manjaro kernel: CIFS: VFS: \\192.168.68.15 cifs_put_smb_ses: Session Logoff failure rc=-512
Jan 31 14:11:15 manjaro systemd[1]: Unmounted /home/demo/mnt/server/music.
Jan 31 14:11:15 manjaro systemd[1]: home-demo-mnt-server-music.mount: Failed with result 'timeout'.
Jan 31 14:11:15 manjaro systemd[1]: home-demo-mnt-server-music.mount: Mount process exited, code=killed, status=15/TERM
Jan 31 14:11:15 manjaro systemd[1]: home-demo-mnt-server-music.mount: Unmounting timed out. Terminating.
Jan 31 14:10:58 manjaro kernel: i915 0000:00:02.0: [drm] *ERROR* CPU pipe A FIFO underrun
Jan 31 14:09:45 manjaro audit: BPF prog-id=0 op=UNLOAD
Jan 31 14:09:45 manjaro audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 subj==unconfined msg='unit=systemd-logind comm="systemd" exe="/usr/lib/systemd/sys>
Jan 31 14:09:45 manjaro systemd[1]: Stopped User Login Management.
Jan 31 14:09:45 manjaro systemd[1]: systemd-logind.service: Deactivated successfully.
Jan 31 14:09:44 manjaro systemd[1]: Unmounting /home/demo/mnt/server/music...
Jan 31 14:09:44 manjaro systemd[1]: Stopped target Remote File Systems.
Jan 31 14:09:44 manjaro audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 subj==unconfined msg='unit=systemd-user-sessions comm="systemd" exe="/usr/lib/syst>
Jan 31 14:09:44 manjaro systemd[1]: Stopped Permit User Sessions.
Jan 31 14:09:44 manjaro systemd[1]: systemd-user-sessions.service: Deactivated successfully.
Jan 31 14:09:44 manjaro systemd[1]: Stopping Permit User Sessions...
Jan 31 14:09:44 manjaro systemd[1]: Stopping User Login Management...
Jan 31 14:09:44 manjaro systemd[1]: sddm.service: Consumed 1h 4min 35.819s CPU time.
10

Here you lost the time. Unmounting /home/demo/mnt/server/music… seems to be an issue.

11

To set this up I followed this article:
https://anteru.net/blog/2019/automatic-mounts-using-systemd/

How do you suggest I troubleshoot this issue?

12

Follow this guide:

13

I looked at these instructions and it looks what I have done complies with this information.
So that doesn’t explain my problem.

14

If fstrim.service takes that long, then that’s because it was trimming the entire SSD, which can indeed take a long time.

Normally, fstrim.timer is set to trigger a full trim on all mounted-writable filesystems on the SSD(s) every Sunday at midnight. However, if the machine was not running at that point in time, then the trimming will take place upon the next boot. And like I said, that can then take a long time. :man_shrugging:

15

Ok that makes sense but it seems to be pausing at every reboot.
I think it has to do with the automount when unmounting the NAS drive but I don’t know how to solve the issue.
Is it possible to set the system to not do the unmount?

16

No, the drive must always be unmounted before the system can shut down, because otherwise you may end up with filesystem damage.

You can test whether the NAS mount is really causing the problem by manually unmounting the drive and manually remounting it again.

17

Doesn’t seem like I can get it unmounted.
It appears to run instantly but not unmounting I don’t believe.

[demo@manjaro ~]$ sudo umount /home/demo/mnt/server/music
[sudo] password for demo: 
umount: /home/demo/mnt/server/music: target is busy.
[demo@manjaro ~]$ sudo fuser -mu /home/demo/mnt/server/music
[demo@manjaro ~]$ sudo umount /home/demo/mnt/server/music
umount: /home/demo/mnt/server/music: target is busy.
[demo@manjaro ~]$ sudo umount -f /home/demo/mnt/server/music
umount: /home/demo/mnt/server/music: target is busy.
[demo@manjaro ~]$ sudo umount -l /home/demo/mnt/server/music
[demo@manjaro ~]$ mount
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
sys on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
dev on /dev type devtmpfs (rw,nosuid,relatime,size=7992816k,nr_inodes=1998204,mode=755,inode64)
run on /run type tmpfs (rw,nosuid,nodev,relatime,mode=755,inode64)
efivarfs on /sys/firmware/efi/efivars type efivarfs (rw,nosuid,nodev,noexec,relatime)
/dev/nvme0n1p11 on / type ext4 (rw,noatime)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev,inode64)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
cgroup2 on /sys/fs/cgroup type cgroup2 (rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
systemd-1 on /proc/sys/fs/binfmt_misc type autofs (rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13596)
mqueue on /dev/mqueue type mqueue (rw,nosuid,nodev,noexec,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,nosuid,nodev,noexec,relatime)
tracefs on /sys/kernel/tracing type tracefs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /tmp type tmpfs (rw,nosuid,nodev,size=8003156k,nr_inodes=1048576,inode64)
configfs on /sys/kernel/config type configfs (rw,nosuid,nodev,noexec,relatime)
ramfs on /run/credentials/systemd-sysusers.service type ramfs (ro,nosuid,nodev,noexec,relatime,mode=700)
fusectl on /sys/fs/fuse/connections type fusectl (rw,nosuid,nodev,noexec,relatime)
/var/lib/snapd/snaps/core20_1328.snap on /var/lib/snapd/snap/core20/1328 type squashfs (ro,nodev,relatime,errors=continue,x-gdu.hide)
/var/lib/snapd/snaps/gtk-common-themes_1519.snap on /var/lib/snapd/snap/gtk-common-themes/1519 type squashfs (ro,nodev,relatime,errors=continue,x-gdu.hide)
/var/lib/snapd/snaps/gnome-3-38-2004_87.snap on /var/lib/snapd/snap/gnome-3-38-2004/87 type squashfs (ro,nodev,relatime,errors=continue,x-gdu.hide)
/var/lib/snapd/snaps/core20_1270.snap on /var/lib/snapd/snap/core20/1270 type squashfs (ro,nodev,relatime,errors=continue,x-gdu.hide)
/var/lib/snapd/snaps/snapd_14295.snap on /var/lib/snapd/snap/snapd/14295 type squashfs (ro,nodev,relatime,errors=continue,x-gdu.hide)
/var/lib/snapd/snaps/snapd_14549.snap on /var/lib/snapd/snap/snapd/14549 type squashfs (ro,nodev,relatime,errors=continue,x-gdu.hide)
/var/lib/snapd/snaps/bare_5.snap on /var/lib/snapd/snap/bare/5 type squashfs (ro,nodev,relatime,errors=continue,x-gdu.hide)
/var/lib/snapd/snaps/snap-store_558.snap on /var/lib/snapd/snap/snap-store/558 type squashfs (ro,nodev,relatime,errors=continue,x-gdu.hide)
/dev/nvme0n1p7 on /home type ext4 (rw,nodev,relatime)
systemd-1 on /home/demo/mnt/server/music type autofs (rw,relatime,fd=51,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15640)
/dev/nvme0n1p2 on /boot/efi type vfat (rw,relatime,fmask=0077,dmask=0077,codepage=437,iocharset=ascii,shortname=mixed,utf8,errors=remount-ro)
binfmt_misc on /proc/sys/fs/binfmt_misc type binfmt_misc (rw,nosuid,nodev,noexec,relatime)
tmpfs on /run/user/1000 type tmpfs (rw,nosuid,nodev,relatime,size=1600628k,nr_inodes=400157,mode=700,uid=1000,gid=1000,inode64)
gvfsd-fuse on /run/user/1000/gvfs type fuse.gvfsd-fuse (rw,nosuid,nodev,relatime,user_id=1000,group_id=1000)
portal on /run/user/1000/doc type fuse.portal (rw,nosuid,nodev,relatime,user_id=1000,group_id=1000)
kio-fuse on /run/user/1000/kio-fuse-YJpkdN type fuse.kio-fuse (rw,nosuid,nodev,relatime,user_id=1000,group_id=1000)
//192.168.68.15/Music on /home/demo/mnt/server/music type cifs (rw,relatime,vers=3.1.1,cache=strict,username=root,uid=1000,noforceuid,gid=0,noforcegid,addr=192.168.68.15,file_mode=0700,dir_mode=0700,soft,nounix,serverino,mapposix,rsize=4194304,wsize=4194304,bsize=1048576,echo_interval=60,actimeo=1)
[demo@manjaro ~]$ sudo umount /home/demo/mnt/server/music
umount: /home/demo/mnt/server/music: target is busy.
[demo@manjaro ~]$ sudo umount -l /home/demo/mnt/server/music
[demo@manjaro ~]$ mount
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
sys on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
dev on /dev type devtmpfs (rw,nosuid,relatime,size=7992816k,nr_inodes=1998204,mode=755,inode64)
run on /run type tmpfs (rw,nosuid,nodev,relatime,mode=755,inode64)
efivarfs on /sys/firmware/efi/efivars type efivarfs (rw,nosuid,nodev,noexec,relatime)
/dev/nvme0n1p11 on / type ext4 (rw,noatime)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev,inode64)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
cgroup2 on /sys/fs/cgroup type cgroup2 (rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
systemd-1 on /proc/sys/fs/binfmt_misc type autofs (rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13596)
mqueue on /dev/mqueue type mqueue (rw,nosuid,nodev,noexec,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,nosuid,nodev,noexec,relatime)
tracefs on /sys/kernel/tracing type tracefs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /tmp type tmpfs (rw,nosuid,nodev,size=8003156k,nr_inodes=1048576,inode64)
configfs on /sys/kernel/config type configfs (rw,nosuid,nodev,noexec,relatime)
ramfs on /run/credentials/systemd-sysusers.service type ramfs (ro,nosuid,nodev,noexec,relatime,mode=700)
fusectl on /sys/fs/fuse/connections type fusectl (rw,nosuid,nodev,noexec,relatime)
/var/lib/snapd/snaps/core20_1328.snap on /var/lib/snapd/snap/core20/1328 type squashfs (ro,nodev,relatime,errors=continue,x-gdu.hide)
/var/lib/snapd/snaps/gtk-common-themes_1519.snap on /var/lib/snapd/snap/gtk-common-themes/1519 type squashfs (ro,nodev,relatime,errors=continue,x-gdu.hide)
/var/lib/snapd/snaps/gnome-3-38-2004_87.snap on /var/lib/snapd/snap/gnome-3-38-2004/87 type squashfs (ro,nodev,relatime,errors=continue,x-gdu.hide)
/var/lib/snapd/snaps/core20_1270.snap on /var/lib/snapd/snap/core20/1270 type squashfs (ro,nodev,relatime,errors=continue,x-gdu.hide)
/var/lib/snapd/snaps/snapd_14295.snap on /var/lib/snapd/snap/snapd/14295 type squashfs (ro,nodev,relatime,errors=continue,x-gdu.hide)
/var/lib/snapd/snaps/snapd_14549.snap on /var/lib/snapd/snap/snapd/14549 type squashfs (ro,nodev,relatime,errors=continue,x-gdu.hide)
/var/lib/snapd/snaps/bare_5.snap on /var/lib/snapd/snap/bare/5 type squashfs (ro,nodev,relatime,errors=continue,x-gdu.hide)
/var/lib/snapd/snaps/snap-store_558.snap on /var/lib/snapd/snap/snap-store/558 type squashfs (ro,nodev,relatime,errors=continue,x-gdu.hide)
/dev/nvme0n1p7 on /home type ext4 (rw,nodev,relatime)
systemd-1 on /home/demo/mnt/server/music type autofs (rw,relatime,fd=51,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15640)
/dev/nvme0n1p2 on /boot/efi type vfat (rw,relatime,fmask=0077,dmask=0077,codepage=437,iocharset=ascii,shortname=mixed,utf8,errors=remount-ro)
binfmt_misc on /proc/sys/fs/binfmt_misc type binfmt_misc (rw,nosuid,nodev,noexec,relatime)
tmpfs on /run/user/1000 type tmpfs (rw,nosuid,nodev,relatime,size=1600628k,nr_inodes=400157,mode=700,uid=1000,gid=1000,inode64)
gvfsd-fuse on /run/user/1000/gvfs type fuse.gvfsd-fuse (rw,nosuid,nodev,relatime,user_id=1000,group_id=1000)
portal on /run/user/1000/doc type fuse.portal (rw,nosuid,nodev,relatime,user_id=1000,group_id=1000)
kio-fuse on /run/user/1000/kio-fuse-YJpkdN type fuse.kio-fuse (rw,nosuid,nodev,relatime,user_id=1000,group_id=1000)
//192.168.68.15/Music on /home/demo/mnt/server/music type cifs (rw,relatime,vers=3.1.1,cache=strict,username=root,uid=1000,noforceuid,gid=0,noforcegid,addr=192.168.68.15,file_mode=0700,dir_mode=0700,soft,nounix,serverino,mapposix,rsize=4194304,wsize=4194304,bsize=1048576,echo_interval=60,actimeo=1)
18

This is the problem. You can also use lsof to see which files are in use.