Luks encrypted root partition won't boot

[Chrisf]

I have a luks encrytped root partition loaded with Manjaro. I’m not sure what change caused this behaviour. After decrypting the drive, Manjaro fails to load. There is a blank screen after decrypting.

I have a live Manjaro USB and I am able to mount the encrytped drive. The following is from the system journal.

Oct 16 21:38:35 cf-ux410uqk systemd[1]: systemd-sysctl.service: Deactivated successfully.
Oct 16 21:38:35 cf-ux410uqk systemd[1]: Stopped Apply Kernel Variables.
Oct 16 21:38:35 cf-ux410uqk systemd[1]: systemd-modules-load.service: Deactivated successfully.
Oct 16 21:38:35 cf-ux410uqk systemd[1]: Stopped Load Kernel Modules.
Oct 16 21:38:35 cf-ux410uqk audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=systemd-sysctl comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
Oct 16 21:38:35 cf-ux410uqk audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=systemd-modules-load comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
Oct 16 21:38:35 cf-ux410uqk systemd[1]: Stopping Network Time Synchronization...
Oct 16 21:38:35 cf-ux410uqk systemd[1]: systemd-update-done.service: Deactivated successfully.
Oct 16 21:38:35 cf-ux410uqk audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=systemd-update-done comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
Oct 16 21:38:35 cf-ux410uqk systemd[1]: Stopped Update is Completed.
Oct 16 21:38:35 cf-ux410uqk audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=ldconfig comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
Oct 16 21:38:35 cf-ux410uqk systemd[1]: ldconfig.service: Deactivated successfully.
Oct 16 21:38:35 cf-ux410uqk audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=systemd-journal-catalog-update comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
Oct 16 21:38:35 cf-ux410uqk systemd[1]: Stopped Rebuild Dynamic Linker Cache.
Oct 16 21:38:35 cf-ux410uqk systemd[1]: systemd-journal-catalog-update.service: Deactivated successfully.
Oct 16 21:38:35 cf-ux410uqk systemd[1]: Stopped Rebuild Journal Catalog.
Oct 16 21:38:35 cf-ux410uqk systemd[1]: Stopping Record System Boot/Shutdown in UTMP...
Oct 16 21:38:35 cf-ux410uqk systemd[1]: systemd-backlight@backlight:intel_backlight.service: Deactivated successfully.
Oct 16 21:38:35 cf-ux410uqk systemd[1]: Stopped Load/Save Screen Backlight Brightness of backlight:intel_backlight.
Oct 16 21:38:35 cf-ux410uqk audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=systemd-backlight@backlight:intel_backlight comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
Oct 16 21:38:35 cf-ux410uqk systemd[1]: systemd-backlight@leds:asus::kbd_backlight.service: Deactivated successfully.
Oct 16 21:38:35 cf-ux410uqk systemd[1]: Stopped Load/Save Screen Backlight Brightness of leds:asus::kbd_backlight.
Oct 16 21:38:35 cf-ux410uqk audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=systemd-backlight@leds:asus::kbd_backlight comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
Oct 16 21:38:35 cf-ux410uqk systemd[1]: Removed slice Slice /system/systemd-backlight.
Oct 16 21:38:35 cf-ux410uqk audit[156700]: SYSTEM_SHUTDOWN pid=156700 uid=0 auid=4294967295 ses=4294967295 msg=' comm="systemd-update-utmp" exe="/usr/lib/systemd/systemd-update-utmp" hostname=? addr=? terminal=? res=success'
Oct 16 21:38:35 cf-ux410uqk systemd-cryptsetup[156699]: Device luks-5b9bb652-477f-4ad7-a38e-994b625d0c5c is still in use.
Oct 16 21:38:35 cf-ux410uqk systemd-cryptsetup[156699]: Failed to deactivate: Device or resource busy
Oct 16 21:38:35 cf-ux410uqk systemd[1]: systemd-cryptsetup@luks\x2d5b9bb652\x2d477f\x2d4ad7\x2da38e\x2d994b625d0c5c.service: Control process exited, code=exited, status=1/FAILURE
Oct 16 21:38:35 cf-ux410uqk systemd[1]: systemd-cryptsetup@luks\x2d5b9bb652\x2d477f\x2d4ad7\x2da38e\x2d994b625d0c5c.service: Failed with result 'exit-code'.
Oct 16 21:38:35 cf-ux410uqk systemd[1]: Stopped Cryptography Setup for luks-5b9bb652-477f-4ad7-a38e-994b625d0c5c.
Oct 16 21:38:35 cf-ux410uqk audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=systemd-cryptsetup@luks\x2d5b9bb652\x2d477f\x2d4ad7\x2da38e\x2d994b625d0c5c comm="systemd" exe="/usr/lib/systemd/systemd" hostname=>
Oct 16 21:38:35 cf-ux410uqk systemd[1]: systemd-update-utmp.service: Deactivated successfully.
Oct 16 21:38:35 cf-ux410uqk systemd[1]: Stopped Record System Boot/Shutdown in UTMP.
Oct 16 21:38:35 cf-ux410uqk audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=systemd-update-utmp comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
Oct 16 21:38:35 cf-ux410uqk systemd[1]: systemd-timesyncd.service: Deactivated successfully.
Oct 16 21:38:35 cf-ux410uqk systemd[1]: Stopped Network Time Synchronization.
Oct 16 21:38:35 cf-ux410uqk audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=systemd-timesyncd comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
Oct 16 21:38:35 cf-ux410uqk systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.
Oct 16 21:38:35 cf-ux410uqk audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=systemd-tmpfiles-setup comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
Oct 16 21:38:35 cf-ux410uqk systemd[1]: Stopped Create Volatile Files and Directories.
Oct 16 21:38:35 cf-ux410uqk systemd[1]: Stopped target Local File Systems.
Oct 16 21:38:35 cf-ux410uqk systemd[1]: Unmounting /boot/efi...
Oct 16 21:38:35 cf-ux410uqk systemd[1]: Unmounting /run/credentials/systemd-sysusers.service...
Oct 16 21:38:35 cf-ux410uqk systemd[1]: Unmounting /run/media/cf/HDD...
Oct 16 21:38:35 cf-ux410uqk systemd[1]: Unmounting /tmp...
Oct 16 21:38:35 cf-ux410uqk ntfs-3g[353]: Unmounting /dev/sda1 (HDD)
Oct 16 21:38:35 cf-ux410uqk audit: BPF prog-id=0 op=UNLOAD
Oct 16 21:38:35 cf-ux410uqk systemd[1]: boot-efi.mount: Deactivated successfully.
Oct 16 21:38:35 cf-ux410uqk systemd[1]: Unmounted /boot/efi.
Oct 16 21:38:35 cf-ux410uqk systemd[1]: systemd-fsck@dev-disk-by\x2duuid-6C69\x2d7E78.service: Deactivated successfully.
Oct 16 21:38:35 cf-ux410uqk systemd[1]: Stopped File System Check on /dev/disk/by-uuid/6C69-7E78.
Oct 16 21:38:35 cf-ux410uqk audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=systemd-fsck@dev-disk-by\x2duuid-6C69\x2d7E78 comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=succes>
Oct 16 21:38:35 cf-ux410uqk systemd[1]: Removed slice Slice /system/systemd-fsck.
Oct 16 21:38:35 cf-ux410uqk systemd[1]: run-credentials-systemd\x2dsysusers.service.mount: Deactivated successfully.
Oct 16 21:38:35 cf-ux410uqk systemd[1]: Unmounted /run/credentials/systemd-sysusers.service.
Oct 16 21:38:35 cf-ux410uqk systemd[1]: tmp.mount: Deactivated successfully.
Oct 16 21:38:35 cf-ux410uqk systemd[1]: Unmounted /tmp.
Oct 16 21:38:35 cf-ux410uqk systemd[1]: Stopped target Swaps.
Oct 16 21:38:35 cf-ux410uqk systemd[1]: Deactivating swap /dev/disk/by-id/ata-ST1000LM035-1RK172_ZDE0M5YV-part3...
Oct 16 21:38:35 cf-ux410uqk systemd[1]: dev-disk-by\x2dpartuuid-b29b9fff\x2d01e2\x2d6244\x2d82e4\x2d2f5e775e9d95.swap: Deactivated successfully.
Oct 16 21:38:35 cf-ux410uqk systemd[1]: dev-disk-by\x2dpartuuid-b29b9fff\x2d01e2\x2d6244\x2d82e4\x2d2f5e775e9d95.swap: Deactivated successfully.
Oct 16 21:38:35 cf-ux410uqk systemd[1]: Deactivated swap /dev/disk/by-partuuid/b29b9fff-01e2-6244-82e4-2f5e775e9d95.
Oct 16 21:38:35 cf-ux410uqk systemd[1]: dev-disk-by\x2did-wwn\x2d0x5000c500a2be21f6\x2dpart3.swap: Deactivated successfully.
Oct 16 21:38:35 cf-ux410uqk systemd[1]: Deactivated swap /dev/disk/by-id/wwn-0x5000c500a2be21f6-part3.
Oct 16 21:38:35 cf-ux410uqk systemd[1]: dev-disk-by\x2did-ata\x2dST1000LM035\x2d1RK172_ZDE0M5YV\x2dpart3.swap: Deactivated successfully.
Oct 16 21:38:35 cf-ux410uqk systemd[1]: Deactivated swap /dev/disk/by-id/ata-ST1000LM035-1RK172_ZDE0M5YV-part3.
Oct 16 21:38:35 cf-ux410uqk systemd[1]: dev-disk-by\x2dpath-pci\x2d0000:00:17.0\x2data\x2d1\x2dpart3.swap: Deactivated successfully.
Oct 16 21:38:35 cf-ux410uqk systemd[1]: Deactivated swap /dev/disk/by-path/pci-0000:00:17.0-ata-1-part3.
Oct 16 21:38:35 cf-ux410uqk systemd[1]: dev-disk-by\x2dpath-pci\x2d0000:00:17.0\x2data\x2d1.0\x2dpart3.swap: Deactivated successfully.
Oct 16 21:38:35 cf-ux410uqk systemd[1]: Deactivated swap /dev/disk/by-path/pci-0000:00:17.0-ata-1.0-part3.
Oct 16 21:38:35 cf-ux410uqk systemd[1]: dev-sda3.swap: Deactivated successfully.
Oct 16 21:38:35 cf-ux410uqk systemd[1]: Deactivated swap /dev/sda3.
Oct 16 21:38:35 cf-ux410uqk systemd[1]: dev-disk-by\x2duuid-37ef8f25\x2de6aa\x2d45be\x2d8741\x2d2aa28ba00f97.swap: Deactivated successfully.
Oct 16 21:38:35 cf-ux410uqk systemd[1]: Deactivated swap /dev/disk/by-uuid/37ef8f25-e6aa-45be-8741-2aa28ba00f97.
Oct 16 21:38:36 cf-ux410uqk systemd[1]: run-media-cf-HDD.mount: Deactivated successfully.
Oct 16 21:38:36 cf-ux410uqk systemd[1]: Unmounted /run/media/cf/HDD.
Oct 16 21:38:36 cf-ux410uqk systemd[1]: run-media-cf-HDD.mount: Consumed 44.937s CPU time.
Oct 16 21:38:36 cf-ux410uqk systemd[1]: Stopped target Preparation for Local File Systems.
Oct 16 21:38:36 cf-ux410uqk systemd[1]: Reached target Unmount All Filesystems.
Oct 16 21:38:36 cf-ux410uqk systemd[1]: Stopping Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling...
Oct 16 21:38:36 cf-ux410uqk systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.
Oct 16 21:38:36 cf-ux410uqk audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=systemd-tmpfiles-setup-dev comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
Oct 16 21:38:36 cf-ux410uqk audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=systemd-sysusers comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
Oct 16 21:38:36 cf-ux410uqk systemd[1]: Stopped Create Static Device Nodes in /dev.
Oct 16 21:38:36 cf-ux410uqk audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=systemd-remount-fs comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
Oct 16 21:38:36 cf-ux410uqk systemd[1]: systemd-sysusers.service: Deactivated successfully.
Oct 16 21:38:36 cf-ux410uqk systemd[1]: Stopped Create System Users.
Oct 16 21:38:36 cf-ux410uqk systemd[1]: systemd-remount-fs.service: Deactivated successfully.
Oct 16 21:38:36 cf-ux410uqk systemd[1]: Stopped Remount Root and Kernel File Systems.
Oct 16 21:38:36 cf-ux410uqk systemd[1]: lvm2-monitor.service: Deactivated successfully.
Oct 16 21:38:36 cf-ux410uqk systemd[1]: Stopped Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling.
Oct 16 21:38:36 cf-ux410uqk audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=lvm2-monitor comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
Oct 16 21:38:36 cf-ux410uqk systemd[1]: Reached target System Shutdown.
Oct 16 21:38:36 cf-ux410uqk systemd[1]: Reached target Late Shutdown Services.
Oct 16 21:38:36 cf-ux410uqk audit[1]: SERVICE_START pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=systemd-reboot comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
Oct 16 21:38:36 cf-ux410uqk audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=systemd-reboot comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
Oct 16 21:38:36 cf-ux410uqk systemd[1]: systemd-reboot.service: Deactivated successfully.
Oct 16 21:38:36 cf-ux410uqk systemd[1]: Finished System Reboot.
Oct 16 21:38:36 cf-ux410uqk systemd[1]: Reached target System Reboot.
Oct 16 21:38:36 cf-ux410uqk systemd[1]: Shutting down.
Oct 16 21:38:36 cf-ux410uqk audit: BPF prog-id=0 op=UNLOAD
Oct 16 21:38:36 cf-ux410uqk audit: BPF prog-id=0 op=UNLOAD
Oct 16 21:38:36 cf-ux410uqk audit: BPF prog-id=0 op=UNLOAD
Oct 16 21:38:36 cf-ux410uqk audit: BPF prog-id=0 op=UNLOAD
Oct 16 21:38:36 cf-ux410uqk audit: BPF prog-id=0 op=UNLOAD
Oct 16 21:38:36 cf-ux410uqk systemd[1]: Using hardware watchdog 'iTCO_wdt', version 0, device /dev/watchdog0
Oct 16 21:38:36 cf-ux410uqk systemd[1]: Watchdog running with a timeout of 10min.
Oct 16 21:38:36 cf-ux410uqk kernel: watchdog: watchdog0: watchdog did not stop!
Oct 16 21:38:36 cf-ux410uqk systemd-shutdown[1]: Using hardware watchdog 'iTCO_wdt', version 0, device /dev/watchdog0
Oct 16 21:38:36 cf-ux410uqk systemd-shutdown[1]: Watchdog running with a timeout of 10min.
Oct 16 21:38:36 cf-ux410uqk systemd-shutdown[1]: Syncing filesystems and block devices.
Oct 16 21:38:36 cf-ux410uqk systemd-shutdown[1]: Sending SIGTERM to remaining processes...
Oct 16 21:38:36 cf-ux410uqk systemd-journald[286]: Received SIGTERM from PID 1 (systemd-shutdow).

[tnaser4]

The best answer that I can give is from a thread on https://unix.stackexchange.com/questions/543360/problem-with-booting-a-newly-luks-encrypted-root-partition from about 3 yrs. ago, but it still applies.

[megavolt]

@Chrisf

The following is from the system journal.

That is the shutdown process. So nothing useful.

[Chrisf]

Thank you tnaser I might try chrooting in and reinstalling the grub. However I have had many successful boots, this is not a newly encrypted drive.

[Chrisf]

My bad. Not familiar with the output.

[Nachlese]

When you do that, also do this:
edit /etc/default/grub
and remove the “quiet” parameter from the kernel command line
GRUB_CMDLINE_LINUX_DEFAULT=“…”
so that you will see the messages that are normally printed to the screen during boot.

sudo update-grub
after changes to that file

[Chrisf]

I chrooted in, changed the entries in /etc/default/grub, and updated the grub. I can now see messages printed to screen during boot.

There are messages referring to
ACPI BIOS Error (bug), and
Kernel panic - not syncing: VFS: Unable to mount root fs on unknown-block(0,0)

[Nachlese]

These are not the only things that are printed there - or are they?
And you are (normally) dropped into an (pretty limited) emergency shell.

[Chrisf]

No they’re not the only things. I can’t upload an image tho. And no not dropped into a shell. I have to force power off.

[megavolt]

@Chrisf

There are messages referring to
ACPI BIOS Error (bug), and
Kernel panic - not syncing: VFS: Unable to mount root fs on unknown-block(0,0)

At least it is kernel related. Maybe an non-complete update? Search for mkinitcpio, grub-install and update-grub…

[Nachlese]

@Chrisf

I can’t upload an image tho.

Yes you can - just not directly to here.
Use a service, share the URL.
If you think it is useful.

[megavolt]

@Chrisf

I can’t upload an image tho.

[HowTo] Post screenshots and links

Difficulty: ★☆☆☆☆ You’ve probably been sent here by a more experienced user because you cannot post links nor screenshots so please follow the simple instructions of this tutorial below to allow you to post both screenshots and links in any post and have a short explanation of why you can’t do this easily… If you’re reading this in response to a question, please click the green link above this text to bring you to the full unabridged text of the tutorial itself. If you …

[Chrisf]

Here is a link to the screen showing the failed boot process
https://drive.google.com/file/d/10VtMNwWjHes9PzbmoMYulTtTeJNn8vns/view?usp=drivesdk

[Chrisf]

I’ll not sure what you mean by search for mkinitcpio

[Chrisf]

I found this:
https://bugzilla.kernel.org/show_bug.cgi?id=213023

[megavolt]

@Chrisf

https://drive.google.com/file/d/10VtMNwWjHes9PzbmoMYulTtTeJNn8vns/view?usp=drivesdk

Ok…

First:

The BIOS seems to be pretty outdated. ASUS Zenbook UX410UQ - Support Latest one is dated at 2020/05/25 .

That could be a problem here… update it.

Second:

The problem is the mounting process of the root partition. It could be simply that the storage device (whatever type) is damaged or just the filesystem.

Third:

The ACPI errors refer to the BIOS which is outdated since 6 years.

[zbe]

@Chrisf

I’m not sure what change caused this behaviour.

Think. What did you change/install/remove/edit before this happened?

@Chrisf

changed the entries in /etc/default/grub

What did you change now? Because…

@Chrisf

Kernel panic - not syncing: VFS: Unable to mount root fs on unknown-block(0,0)

…kernel can’t find root filesystem now.

So now either you have wrong root= set or wrong mkinitcpio hooks/modules or something.

[Chrisf]

Now secure boot is enabled after updating bios so will have to troubleshoot around windows recovery environment there to disable before getting back into this issue.

[Chrisf]

After updating the BIOS, administrator password appears to have reset and enabled secure boot. So I can no longer dual boot, or access the BIOS using admin. Anyone know how to get around this on an Asus UX410UQ? Asus support have advised sending into service centre(!). Haven’t been able to find any real solutions searching the web…

[mithrial]

How about disabling secure boot?