Debug_shell not working

[sid789]

Hi all,
I try to debug linux boot with systemd debug_shell, but I am not able to get into the shell. Until now, the debug_shell is activated by grub kernel parameters and by debug_shell.service. I try all this because the system has problems starting some services during boot if I do not boot windows in advance. My hope was to get more information with the debug_shell if only I could get this shell started/switched into.

My hardware is a Lenovo ideapad Duet 3 10IGL5. Linux kernel version is

 ~$  uname -a
Linux ideapad 5.15.19-1-MANJARO #1 SMP PREEMPT Tue Feb 1 16:58:17 UTC 2022 x86_64 GNU/Linux

The kernel command line is

 ~$ cat /proc/cmdline
BOOT_IMAGE=/boot/vmlinuz-5.15-x86_64 root=UUID=d1b85899-cc2f-489e-8ed8-a89062284a10 rw fbcon=rotate:1 systemd.debug-shell=1 apparmor=1 security=apparmor udev.log_priority=3

Switching into the shell should happen by Ctrl-Alt-F9. Due to the keyboard layout of the 10IGL5 I press Ctrl-Alt-Fn-F9. This works after a successful boot but not when the system is waiting for the services to start. Nevertheless, I also tried other combinations. But all without success.

sid

[sid789]

As requested in [HowTo] Provide System Information I provide the output of inxi.

    ~  inxi --admin --verbosity=7 --filter --width                                                                        ✔ 
System:
  Kernel: 5.15.19-1-MANJARO x86_64 bits: 64 compiler: gcc v: 11.1.0
    parameters: BOOT_IMAGE=/boot/vmlinuz-5.15-x86_64
    root=UUID=d1b85899-cc2f-489e-8ed8-a89062284a10 rw fbcon=rotate:1
    systemd.debug-shell=1 apparmor=1 security=apparmor udev.log_priority=3
  Desktop: GNOME 41.3 tk: GTK 3.24.31 wm: gnome-shell dm: GDM 41.3
    Distro: Manjaro Linux base: Arch Linux
Machine:
  Type: Detachable System: LENOVO product: 82AT v: IdeaPad Duet 3 10IGL5
    serial: <superuser required> Chassis: type: 32 v: IdeaPad Duet 3 10IGL5
    serial: <superuser required>
  Mobo: LENOVO model: LNVNB161216 v: SDK0T31556 WIN
    serial: <superuser required> UEFI: LENOVO v: EQCN29WW date: 08/11/2021
Battery:
  ID-1: BAT0 charge: 31.1 Wh (100.0%) condition: 31.1/30.0 Wh (103.8%)
    volts: 8.7 min: 7.7 model: SMP L19M2PD7 type: Li-ion serial: <filter>
    status: Full cycles: 11
  Device-1: hid-0018:04F3:2BD6.0001-battery model: ELAN901C:00 04F3:2BD6
    serial: N/A charge: N/A status: N/A
Memory:
  RAM: total: 7.57 GiB used: 2.71 GiB (35.8%)
  RAM Report:
    permissions: Unable to run dmidecode. Root privileges required.
CPU:
  Info: model: Intel Pentium Silver N5030 bits: 64 type: MCP
    arch: Goldmont Plus family: 6 model-id: 0x7A (122) stepping: 8
    microcode: 0x1A
  Topology: cpus: 1x cores: 4 smt: <unsupported> cache: L1: 224 KiB
    desc: d-4x24 KiB; i-4x32 KiB L2: 4 MiB desc: 1x4 MiB
  Speed (MHz): avg: 2855 high: 3069 min/max: 800/3100 scaling:
    driver: intel_cpufreq governor: schedutil cores: 1: 2785 2: 2785 3: 2784
    4: 3069 bogomips: 8756
  Flags: 3dnowprefetch acpi aes aperfmperf apic arat arch_capabilities
    arch_perfmon art bts cat_l2 cdp_l2 clflush clflushopt cmov constant_tsc
    cpuid cpuid_fault cx16 cx8 de ds_cpl dtes64 dtherm dts ept ept_ad erms est
    flexpriority fpu fsgsbase fxsr ht ibpb ibrs ibrs_enhanced ida intel_pt
    lahf_lm lm mca mce md_clear mmx monitor movbe mpx msr mtrr nonstop_tsc
    nopl nx pae pat pbe pclmulqdq pdcm pdpe1gb pebs pge pln pni popcnt pse
    pse36 pts rdpid rdrand rdseed rdt_a rdtscp rep_good sdbg sep sha_ni smap
    smep ss ssbd sse sse2 sse4_1 sse4_2 ssse3 stibp syscall tm tm2 tpr_shadow
    tsc tsc_adjust tsc_deadline_timer tsc_known_freq umip vme vmx vnmi vpid
    x2apic xgetbv1 xsave xsavec xsaveopt xsaves xtopology xtpr
  Vulnerabilities:
  Type: itlb_multihit status: Not affected
  Type: l1tf status: Not affected
  Type: mds status: Not affected
  Type: meltdown status: Not affected
  Type: spec_store_bypass
    mitigation: Speculative Store Bypass disabled via prctl and seccomp
  Type: spectre_v1
    mitigation: usercopy/swapgs barriers and __user pointer sanitization
  Type: spectre_v2 mitigation: Enhanced IBRS, IBPB: conditional, RSB filling
  Type: srbds status: Not affected
  Type: tsx_async_abort status: Not affected
Graphics:
  Device-1: Intel GeminiLake [UHD Graphics 605] vendor: Lenovo driver: i915
    v: kernel bus-ID: 00:02.0 chip-ID: 8086:3184 class-ID: 0300
  Device-2: Realtek Intergrated Camera 2M type: USB driver: uvcvideo
    bus-ID: 1-4:3 chip-ID: 0bda:5609 class-ID: 0e02 serial: <filter>
  Device-3: Realtek Intergrated Camera 5M type: USB driver: uvcvideo
    bus-ID: 1-7:9 chip-ID: 0bda:5612 class-ID: 0e02 serial: <filter>
  Display: wayland server: X.org 1.21.1.3 compositor: gnome-shell driver:
    loaded: i915 note: n/a (using device driver) - try sudo/root
    unloaded: modesetting alternate: fbdev,vesa display-ID: 0
    resolution: <missing: xdpyinfo>
  Message: Unable to show advanced data. Required tool glxinfo missing.
Audio:
  Device-1: Intel Celeron/Pentium Silver Processor High Definition Audio
    vendor: Lenovo driver: snd_hda_intel v: kernel
    alternate: snd_soc_skl,snd_sof_pci_intel_apl bus-ID: 00:0e.0
    chip-ID: 8086:3198 class-ID: 0403
  Sound Server-1: ALSA v: k5.15.19-1-MANJARO running: yes
  Sound Server-2: JACK v: 1.9.20 running: no
  Sound Server-3: PulseAudio v: 15.0 running: yes
  Sound Server-4: PipeWire v: 0.3.45 running: no
Network:
  Device-1: Intel Gemini Lake PCH CNVi WiFi driver: iwlwifi v: kernel
    bus-ID: 00:0c.0 chip-ID: 8086:31dc class-ID: 0280
  IF: wlp0s12f0 state: down mac: <filter>
  Device-2: Realtek RTL8153 Gigabit Ethernet Adapter type: USB driver: r8152
    bus-ID: 2-1.1:3 chip-ID: 0bda:8153 class-ID: 0000 serial: <filter>
  IF: enp0s21f0u1u1 state: up speed: 1000 Mbps duplex: full mac: <filter>
  IP v4: <filter> type: dynamic noprefixroute scope: global
    broadcast: <filter>
  IP v6: <filter> type: noprefixroute scope: link
  WAN IP: <filter>
Bluetooth:
  Device-1: Intel Bluetooth 9460/9560 Jefferson Peak (JfP) type: USB
    driver: btusb v: 0.8 bus-ID: 1-9:10 chip-ID: 8087:0aaa class-ID: e001
  Report: rfkill ID: hci0 rfk-id: 3 state: up address: see --recommends
Logical:
  Message: No logical block device data found.
RAID:
  Message: No RAID data found.
Drives:
  Local Storage: total: 146.2 GiB used: 29.41 GiB (20.1%)
  SMART Message: Required tool smartctl not installed. Check --recommends
  ID-1: /dev/mmcblk0 maj-min: 179:0 vendor: SanDisk model: DA4128
    size: 116.48 GiB block-size: physical: 512 B logical: 512 B type: SSD
    serial: <filter> rev: 0x8 scheme: GPT
  ID-2: /dev/mmcblk1 maj-min: 179:24 vendor: SanDisk model: SC32G
    size: 29.72 GiB block-size: physical: 512 B logical: 512 B type: SSD
    serial: <filter> scheme: MBR
  Message: No optical or floppy data found.
Partition:
  ID-1: / raw-size: 69.44 GiB size: 67.85 GiB (97.71%) used: 29.39 GiB (43.3%)
    fs: ext4 dev: /dev/mmcblk0p5 maj-min: 179:5 label: N/A
    uuid: d1b85899-cc2f-489e-8ed8-a89062284a10
  ID-2: /boot/efi raw-size: 497 MiB size: 496 MiB (99.80%)
    used: 28.6 MiB (5.8%) fs: vfat dev: /dev/mmcblk0p1 maj-min: 179:1
    label: SYSTEM_DRV uuid: B6E8-D9A6
Swap:
  Kernel: swappiness: 60 (default) cache-pressure: 100 (default)
  ID-1: swap-1 type: partition size: 3.91 GiB used: 0 KiB (0.0%)
    priority: -2 dev: /dev/mmcblk0p6 maj-min: 179:6 label: N/A
    uuid: ac965b1e-21e7-4b9e-ad36-4230184af56f
Unmounted:
  ID-1: /dev/mmcblk0p2 maj-min: 179:2 size: 16 MiB fs: <superuser required>
    label: N/A uuid: N/A
  ID-2: /dev/mmcblk0p3 maj-min: 179:3 size: 41.66 GiB fs: ntfs
    label: Windows uuid: 7C7CEBD67CEB896A
  ID-3: /dev/mmcblk0p4 maj-min: 179:4 size: 1000 MiB fs: ntfs
    label: WINRE_DRV uuid: 8816EC3B16EC2C3E
  ID-4: /dev/mmcblk1p1 maj-min: 179:25 size: 29.72 GiB fs: bitlocker
    label: N/A uuid: N/A
USB:
  Hub-1: 1-0:1 info: Hi-speed hub with single TT ports: 9 rev: 2.0
    speed: 480 Mb/s chip-ID: 1d6b:0002 class-ID: 0900
  Hub-2: 1-1:2 info: VIA Labs USB2.0 Hub ports: 5 rev: 2.1 speed: 480 Mb/s
    chip-ID: 2109:2817 class-ID: 0900
  Hub-3: 1-1.3:5 info: Genesys Logic Hub ports: 4 rev: 2.1 speed: 480 Mb/s
    power: 100mA chip-ID: 05e3:0610 class-ID: 0900
  Device-1: 1-1.3.1:7 info: Logitech Keyboard K120 type: Keyboard,HID
    driver: hid-generic,usbhid interfaces: 2 rev: 1.1 speed: 1.5 Mb/s
    power: 90mA chip-ID: 046d:c31c class-ID: 0300
  Hub-4: 1-1.4:6 info: Hitachi ports: 4 rev: 2.1 speed: 480 Mb/s
    chip-ID: 045b:0209 class-ID: 0900
  Device-1: 1-1.5:8 info: Anker Innovations Limited Anker USB-C Hub Device
    type: Billboard driver: N/A interfaces: 1 rev: 2.0 speed: 480 Mb/s
    power: 100mA chip-ID: 291a:8365 class-ID: 1100 serial: <filter>
  Device-2: 1-4:3 info: Realtek Intergrated Camera 2M type: Video
    driver: uvcvideo interfaces: 2 rev: 2.0 speed: 480 Mb/s power: 500mA
    chip-ID: 0bda:5609 class-ID: 0e02 serial: <filter>
  Device-3: 1-7:9 info: Realtek Intergrated Camera 5M type: Video
    driver: uvcvideo interfaces: 2 rev: 2.0 speed: 480 Mb/s power: 500mA
    chip-ID: 0bda:5612 class-ID: 0e02 serial: <filter>
  Device-4: 1-9:10 info: Intel Bluetooth 9460/9560 Jefferson Peak (JfP)
    type: Bluetooth driver: btusb interfaces: 2 rev: 2.0 speed: 12 Mb/s
    power: 100mA chip-ID: 8087:0aaa class-ID: e001
  Hub-5: 2-0:1 info: Super-speed hub ports: 7 rev: 3.0 speed: 5 Gb/s
    chip-ID: 1d6b:0003 class-ID: 0900
  Hub-6: 2-1:2 info: VIA Labs USB3.0 Hub ports: 4 rev: 3.1 speed: 5 Gb/s
    chip-ID: 2109:0817 class-ID: 0900
  Device-1: 2-1.1:3 info: Realtek RTL8153 Gigabit Ethernet Adapter
    type: Network driver: r8152 interfaces: 1 rev: 3.0 speed: 5 Gb/s
    power: 288mA chip-ID: 0bda:8153 class-ID: 0000 serial: <filter>
  Hub-7: 2-1.3:4 info: Genesys Logic Hub ports: 4 rev: 3.2 speed: 5 Gb/s
    chip-ID: 05e3:0626 class-ID: 0900
  Hub-8: 2-1.4:5 info: Hitachi ports: 4 rev: 3.0 speed: 5 Gb/s
    chip-ID: 045b:0210 class-ID: 0900
Sensors:
  System Temperatures: cpu: 52.0 C mobo: N/A
  Fan Speeds (RPM): N/A
Info:
  Processes: 230 Uptime: 2h 2m wakeups: 6 Init: systemd v: 250 tool: systemctl
  Compilers: gcc: 11.1.0 clang: 13.0.0 Packages: 1486 pacman: 1482 lib: 383
  flatpak: 0 snap: 4 Shell: Zsh v: 5.8 running-in: gnome-terminal inxi: 3.3.12

[andreas85]

@sid789

the system has problems starting some services during boot

What services ?

What about telling the real problem ?

How to increase your chances of solving your issue:

[HowTo] Increase your chances of solving your issue

Difficulty: ★☆☆☆☆ Strong of its many members, the Manjaro support forum can provide you help whenever you have an issue with your Manjaro installation. But in order to work efficiently, we shall also ask you to follow three major steps. Keep calm and read First some basics: whenever you need to troubleshoot, chances are the solution is already under your nose. Find error messages Very often when an applications crashes, and sometimes when it misbehaves, it prints an error message somewhere. …

[sid789]

Hi Andreas85,

my real problem is

@sid789

I try to debug linux boot with systemd debug_shell, but I am not able to get into the shell.

With a working debug_shell I should be able to help myself. If I could contribute more information to this problem, I would be happy to do so.

The underlying problem

@sid789

the system has problems starting some services during boot

was actually solved in arch forum in the meantime but unfortunately was deleted as they do not want manjaro topics in their forum. The solution that worked until now is the disable of windows fast startup (Dual boot with Windows - ArchWiki). Shutting down windows through the windows 10 Shift-Restart advanced options menu should do the same. But that didn’t help, as I had to learn. For better debugging I also activated from General troubleshooting - ArchWiki debug and ignore_loglevel.

It is probably not going to be that this fast windows startup makes the debug_shell malfunctioning. I will try to investigate further. Would be good if the shell works when I need it. Any help is welcome.

sid

[maycne.sonahoz]

This might give some ideas.

[HowTo] Find error logs

Difficulty: ★★☆☆☆ The first step for troubleshooting an issue is to find an error log: a trace produced by an application when failing/crashing, and providing the first trail a user/developer can follow to fix it. 1. Reach a usable system Obviously, it will be impossible to acquire those logs if you can’t have access to a usable system. By usable, we mean a system in which we can at least access files and input commands, and not necessarily a graphical desktop. Here are different options: B…

[sid789]

As it turned out, there was no error with systemd. The debug_shell works perfectly. In the initial ramdisk the module for the Lenovo keyboard was missing. With the addition of usbhid in /etc/mkinitcpio.conf

# MODULES
# The following modules are loaded before any boot hooks are
# run.  Advanced users may wish to specify all system modules
# in this array.  For instance:
#     MODULES=(piix ide_disk reiserfs)
MODULES=(usbhid)

and regeneration of initial ramdisk with

mkinitcpio -P

it is possible to debug the boot process and to track down the cause of the boot problems.

Where and how should I file a bug report? The missing load of usbhid in initial ramdisk for this laptop should be fixed.

sid