Recover interrupted upgrade

[medmedin]

While doing latest stable upgrade 2022-02-14, I left my desktop alone and a cut in electricity occurred while I was absent, then after powering on my machine I tried booting both 5.4 and 5.15 kernels but they give me the following message :

error: file '/boot/vmlinuz-x.x-x86_64' not found
error: you need to load the kernel first

I fired up a live KDE Neon live then checked pacman log :

[2022-02-15T09:13:34+0100] [PACMAN] Running 'pacman -Syyu'
[2022-02-15T09:13:34+0100] [PACMAN] synchronizing package lists
[2022-02-15T09:14:01+0100] [PACMAN] starting full system upgrade
[2022-02-15T10:10:55+0100] [PACMAN] Running 'pacman -Syyu'
[2022-02-15T10:10:55+0100] [PACMAN] synchronizing package lists
[2022-02-15T10:11:20+0100] [PACMAN] starting full system upgrade
[2022-02-15T10:29:45+0100] [ALPM] running '60-mkinitcpio-remove.hook'...
[2022-02-15T10:29:46+0100] [ALPM] running 'firefox-pre.hook'...
[2022-02-15T10:29:46+0100] [ALPM] running 'ghc-unregister.hook'...
[2022-02-15T10:29:56+0100] [ALPM] running 'thunderbird-pre.hook'...
[2022-02-15T10:29:56+0100] [ALPM] transaction started
[2022-02-15T10:29:57+0100] [ALPM] upgraded ncurses (6.3-1 -> 6.3-2)
[2022-02-15T10:30:19+0100] [ALPM] upgraded btrfs-progs (5.16-1 -> 5.16.1-1)
[2022-02-15T10:30:20+0100] [ALPM] upgraded findutils (4.8.0-1 -> 4.9.0-1)
[2022-02-15T10:30:20+0100] [ALPM] upgraded libcap-ng (0.8.2-6 -> 0.8.2-7)
[2022-02-15T10:30:20+0100] [ALPM] upgraded libcap (2.63-1 -> 2.63-2)
[2022-02-15T10:30:20+0100] [ALPM] upgraded systemd-libs (250.3-2 -> 250.3-3)
[2022-02-15T10:30:20+0100] [ALPM] upgraded ca-certificates-mozilla (3.74-1 -> 3.75-1)
[2022-02-15T10:30:21+0100] [ALPM] upgraded llvm-libs (13.0.0-6 -> 13.0.1-1)
[2022-02-15T10:30:21+0100] [ALPM] upgraded compiler-rt (13.0.0-2 -> 13.0.1-1)
[2022-02-15T10:30:21+0100] [ALPM] upgraded libelf (0.186-3 -> 0.186-4)
[2022-02-15T10:30:22+0100] [ALPM] upgraded elfutils (0.186-3 -> 0.186-4)
[2022-02-15T10:30:23+0100] [ALPM] upgraded clang (13.0.0-4 -> 13.0.1-1)
[2022-02-15T10:30:23+0100] [ALPM] upgraded coin-or-cgl (0.60.4-2 -> 0.60.5-1)
[2022-02-15T10:30:24+0100] [ALPM] upgraded cryfs (0.11.1-1 -> 0.11.1-2)
[2022-02-15T10:30:24+0100] [ALPM] upgraded debuginfod (0.186-3 -> 0.186-4)
[2022-02-15T10:30:24+0100] [ALPM] upgraded device-mapper (2.03.14-2 -> 2.03.15-1)
[2022-02-15T10:30:24+0100] [ALPM] upgraded harfbuzz (3.3.1-1 -> 3.3.2-1)
[2022-02-15T10:30:25+0100] [ALPM] upgraded fontconfig (2:2.13.94-2 -> 2:2.13.96-1)
[2022-02-15T10:30:25+0100] [ALPM-SCRIPTLET] Rebuilding fontconfig cache...
[2022-02-15T10:30:55+0100] [ALPM] upgraded xkeyboard-config (2.34-1 -> 2.35-1)
[2022-02-15T10:30:55+0100] [ALPM] upgraded libxkbcommon (1.3.1-1 -> 1.4.0-1)
[2022-02-15T10:30:55+0100] [ALPM] upgraded libxkbcommon-x11 (1.3.1-1 -> 1.4.0-1)
[2022-02-15T10:30:55+0100] [ALPM] upgraded libusb (1.0.24-2 -> 1.0.25-2)
[2022-02-15T10:30:55+0100] [ALPM] upgraded gdbm (1.22-1 -> 1.23-1)
[2022-02-15T10:30:55+0100] [ALPM] upgraded hwdata (0.355-1 -> 0.356-1)
[2022-02-15T10:30:55+0100] [ALPM] upgraded libpcap (1.10.1-1 -> 1.10.1-2)
[2022-02-15T10:30:58+0100] [ALPM] upgraded systemd (250.3-2 -> 250.3-3)
[2022-02-15T10:31:06+0100] [ALPM] upgraded qt5-base (5.15.2+kde+r296-2.1 -> 5.15.2+kde+r297-1.1)
[2022-02-15T10:31:07+0100] [ALPM] upgraded kuserfeedback (1.0.0-3 -> 1.2.0-1)
[2022-02-15T10:31:08+0100] [ALPM] upgraded qt5-declarative (5.15.2+kde+r44-1 -> 5.15.2+kde+r45-1)
[2022-02-15T10:31:08+0100] [ALPM] upgraded qt5-wayland (5.15.2+kde+r46-2 -> 5.15.2+kde+r48-1)
[2022-02-15T10:31:08+0100] [ALPM] upgraded libnsl (2.0.0-1 -> 2.0.0-2)
[2022-02-15T10:31:08+0100] [ALPM] upgraded gpgme (1.16.0-3 -> 1.17.0-1)
[2022-02-15T10:31:08+0100] [ALPM] upgraded upower (0.99.13-1 -> 0.99.14-1)
[2022-02-15T10:31:10+0100] [ALPM] upgraded lvm2 (2.03.14-2 -> 2.03.15-1)
[2022-02-15T10:31:10+0100] [ALPM] upgraded nss (3.74-1 -> 3.75-1)
[2022-02-15T10:31:14+0100] [ALPM] upgraded dolphin (21.12.2-1 -> 21.12.2.1-1)
[2022-02-15T10:31:15+0100] [ALPM] upgraded espeak-ng (1.50-4 -> 1.50-5)
[2022-02-15T10:31:16+0100] [ALPM] upgraded fftw (3.3.10-1 -> 3.3.10-2)
[2022-02-15T10:31:31+0100] [ALPM] upgraded firefox (97.0-0.1 -> 97.0-1)
[2022-02-15T10:31:33+0100] [ALPM] upgraded firejail (0.9.66-3 -> 0.9.68-1)
[2022-02-15T10:31:33+0100] [ALPM] upgraded frei0r-plugins (1.7.0-1 -> 1.7.0-2)
[2022-02-15T10:31:37+0100] [ALPM] upgraded ghostscript (9.55.0-3 -> 9.55.0-4)
[2022-02-15T10:31:37+0100] [ALPM] upgraded harfbuzz-icu (3.3.1-1 -> 3.3.2-1)
[2022-02-15T10:31:38+0100] [ALPM] upgraded haskell-aeson (1.5.6.0-77 -> 1.5.6.0-79)
[2022-02-15T10:31:38+0100] [ALPM] upgraded haskell-aeson-pretty (0.8.9-27 -> 0.8.9-29)
[2022-02-15T10:31:39+0100] [ALPM] upgraded haskell-pandoc-types (1.22-133 -> 1.22-135)
[2022-02-15T10:31:40+0100] [ALPM] upgraded haskell-text-icu (0.7.1.0-5 -> 0.8.0-1)
[2022-02-15T10:31:40+0100] [ALPM] upgraded haskell-unicode-collation (0.1.3.1-18 -> 0.1.3.1-19)
[2022-02-15T10:31:41+0100] [ALPM] upgraded haskell-citeproc (0.6.0.1-5 -> 0.6.0.1-8)
[2022-02-15T10:31:41+0100] [ALPM] upgraded haskell-unicode-transforms (0.4.0-10 -> 0.4.0-11)
[2022-02-15T10:31:42+0100] [ALPM] upgraded haskell-commonmark (0.2.1.1-3 -> 0.2.1.1-4)
[2022-02-15T10:31:42+0100] [ALPM] upgraded haskell-commonmark-extensions (0.2.2.1-4 -> 0.2.2.1-5)
[2022-02-15T10:31:42+0100] [ALPM] upgraded haskell-commonmark-pandoc (0.2.1.2-4 -> 0.2.1.2-7)
[2022-02-15T10:31:42+0100] [ALPM] upgraded haskell-x509-store (1.6.8-2 -> 1.6.9-1)
[2022-02-15T10:31:43+0100] [ALPM] upgraded haskell-x509-validation (1.6.12-5 -> 1.6.12-6)
[2022-02-15T10:31:44+0100] [ALPM] upgraded haskell-tls (1.5.7-3 -> 1.5.7-4)
[2022-02-15T10:31:44+0100] [ALPM] upgraded haskell-x509-system (1.6.7-3 -> 1.6.7-4)
[2022-02-15T10:31:44+0100] [ALPM] upgraded haskell-connection (0.3.1-171 -> 0.3.1-172)
[2022-02-15T10:31:44+0100] [ALPM] upgraded haskell-doctemplates (0.10.0.1-27 -> 0.10.0.1-29)
[2022-02-15T10:31:44+0100] [ALPM] upgraded haskell-haddock-library (1.10.0-92 -> 1.10.0-94)
[2022-02-15T10:31:45+0100] [ALPM] upgraded haskell-hslua (1.3.0.1-95 -> 1.3.0.1-96)
[2022-02-15T10:31:45+0100] [ALPM] upgraded haskell-hslua-module-path (0.1.0.1-80 -> 0.1.0.1-81)
[2022-02-15T10:31:45+0100] [ALPM] upgraded haskell-hslua-module-system (0.2.2.1-151 -> 0.2.2.1-152)
[2022-02-15T10:31:45+0100] [ALPM] upgraded haskell-hslua-module-text (0.3.0.1-139 -> 0.3.0.1-140)
[2022-02-15T10:31:46+0100] [ALPM] upgraded haskell-http (4000.3.16-125 -> 4000.3.16-128)
[2022-02-15T10:31:46+0100] [ALPM] upgraded haskell-http-types (0.12.3-207 -> 0.12.3-208)
[2022-02-15T10:31:46+0100] [ALPM] upgraded haskell-http-client (0.7.10-7 -> 0.7.10-8)
[2022-02-15T10:31:46+0100] [ALPM] upgraded haskell-http-client-tls (0.3.5.3-486 -> 0.3.5.3-488)
[2022-02-15T10:31:46+0100] [ALPM] upgraded haskell-ipynb (0.1.0.1-272 -> 0.1.0.1-274)
[2022-02-15T10:31:47+0100] [ALPM] upgraded haskell-skylighting-core (0.11-67 -> 0.11-69)
[2022-02-15T10:31:48+0100] [ALPM] upgraded haskell-skylighting (0.11-65 -> 0.11-67)
[2022-02-15T10:31:49+0100] [ALPM] upgraded haskell-texmath (0.12.3.2-8 -> 0.12.3.2-10)
[2022-02-15T10:31:51+0100] [ALPM] upgraded imagemagick (7.1.0.22-1 -> 7.1.0.23-1)
[2022-02-15T10:31:51+0100] [ALPM] upgraded imlib2 (1.7.5-1 -> 1.8.0-1)
[2022-02-15T10:32:01+0100] [ALPM] upgraded inkscape (1.1.1-8 -> 1.1.2-1)
[2022-02-15T10:32:02+0100] [ALPM] upgraded jxrlib (0.2.1-3 -> 0.2.4-1)
[2022-02-15T10:32:02+0100] [ALPM] upgraded lib32-harfbuzz (3.3.1-1 -> 3.3.2-1)
[2022-02-15T10:32:02+0100] [ALPM] upgraded lib32-fontconfig (2:2.13.94-1 -> 2:2.13.96-1)
[2022-02-15T10:32:02+0100] [ALPM-SCRIPTLET] Rebuilding 32-bit fontconfig cache...
[2022-02-15T10:32:15+0100] [ALPM] upgraded lib32-libelf (0.186-2 -> 0.186-3)
[2022-02-15T10:32:16+0100] [ALPM] upgraded lib32-libusb (1.0.24-1 -> 1.0.25-2)
[2022-02-15T10:32:25+0100] [ALPM] upgraded lib32-llvm-libs (13.0.0-1 -> 13.0.1-1)
[2022-02-15T10:32:27+0100] [ALPM] upgraded libical (3.0.13-1 -> 3.0.14-1)
[2022-02-15T10:32:51+0100] [ALPM] upgraded libreoffice-fresh (7.3.0-2 -> 7.3.0-4)
[2022-02-15T10:32:51+0100] [ALPM] upgraded libspeechd (0.11.1-1 -> 0.11.1-2)
[2022-02-15T10:33:17+0100] [ALPM] upgraded linux515 (5.15.19-1 -> 5.15.21-1)
[2022-02-15T10:33:33+0100] [ALPM] upgraded linux515-headers (5.15.19-1 -> 5.15.21-1)
[2022-02-15T10:33:51+0100] [ALPM] upgraded linux54 (5.4.176-1 -> 5.4.178-1)
[2022-02-15T10:34:09+0100] [ALPM] upgraded linux54-headers (5.4.176-1 -> 5.4.178-1)
[2022-02-15T10:34:10+0100] [ALPM] upgraded luajit (2.0.5-3 -> 2.1.0.beta3.r384.g1d7b5029-1)
[2022-02-15T10:34:13+0100] [ALPM] upgraded man-db (2.9.4-2 -> 2.10.0-1)
[2022-02-15T10:34:14+0100] [ALPM] upgraded mesa-demos (8.4.0-6 -> 8.4.0-7)
[2022-02-15T10:34:14+0100] [ALPM] upgraded openmp (13.0.0-1 -> 13.0.1-1)
[2022-02-15T10:34:14+0100] [ALPM] upgraded otf-font-awesome (5.15.4-1 -> 6.0.0-1)
[2022-02-15T10:34:19+0100] [ALPM] upgraded pandoc (2.14.2-26 -> 2.14.2-30)
[2022-02-15T10:34:19+0100] [ALPM] upgraded pandoc-crossref (0.3.12.2-11 -> 0.3.12.2-15)
[2022-02-15T10:34:20+0100] [ALPM] upgraded perl-http-message (6.35-1 -> 6.36-1)
[2022-02-15T10:34:21+0100] [ALPM] upgraded python-gpgme (1.16.0-3 -> 1.17.0-1)
[2022-02-15T10:34:24+0100] [ALPM] upgraded python-numpy (1.21.5-2 -> 1.22.2-1)
[2022-02-15T10:34:25+0100] [ALPM] upgraded python-pycryptodome (3.14.0-1 -> 3.14.1-1)
[2022-02-15T10:34:26+0100] [ALPM] upgraded qgpgme (1.16.0-3 -> 1.17.0-1)
[2022-02-15T10:34:27+0100] [ALPM] upgraded qt5-quick3d (5.15.2+kde+r19-4 -> 5.15.2+kde+r19-5)
[2022-02-15T10:34:29+0100] [ALPM] upgraded qt5-tools (5.15.2+kde+r17-5 -> 5.15.2+kde+r17-6)
[2022-02-15T10:34:31+0100] [ALPM] upgraded qt6-quick3d (6.2.3-2 -> 6.2.3-3)
[2022-02-15T10:34:33+0100] [ALPM] upgraded qt6-tools (6.2.3-2 -> 6.2.3-4)
[2022-02-15T10:34:40+0100] [ALPM] upgraded qtcreator (6.0.2-1 -> 6.0.2-4)
[2022-02-15T10:34:40+0100] [ALPM] upgraded systemd-sysvcompat (250.3-2 -> 250.3-3)
[2022-02-15T10:35:11+0100] [ALPM] upgraded thunderbird (91.6.0-0.1 -> 91.6.0-1)
[2022-02-15T10:35:12+0100] [ALPM] upgraded transcode (1.1.7-39 -> 1.1.7-40)
[2022-02-15T10:35:22+0100] [ALPM] upgraded webkit2gtk (2.34.4-1 -> 2.34.5-1)
[2022-02-15T10:35:22+0100] [ALPM] upgraded xorg-server-common (21.1.3-1 -> 21.1.3-2)
[2022-02-15T10:35:23+0100] [ALPM] upgraded xorg-server (21.1.3-1 -> 21.1.3-2)
[2022-02-15T10:35:26+0100] [ALPM] upgraded yt-dlp (2022.02.04-1 -> 2022.02.04-2)
[2022-02-15T10:35:56+0100] [ALPM] transaction completed
[2022-02-15T10:36:02+0100] [ALPM] running '20-systemd-sysusers.hook'...
[2022-02-15T10:36:02+0100] [ALPM] running '30-systemd-catalog.hook'...
[2022-02-15T10:36:02+0100] [ALPM] running '30-systemd-daemon-reload.hook'...
[2022-02-15T10:36:04+0100] [ALPM] running '30-systemd-hwdb.hook'...
[2022-02-15T10:36:05+0100] [ALPM] running '30-systemd-sysctl.hook'...
[2022-02-15T10:36:05+0100] [ALPM] running '30-systemd-tmpfiles.hook'...
[2022-02-15T10:36:06+0100] [ALPM] running '30-systemd-udev-reload.hook'...
[2022-02-15T10:36:06+0100] [ALPM] running '30-systemd-update.hook'...
[2022-02-15T10:36:06+0100] [ALPM] running '30-update-mime-database.hook'...
[2022-02-15T10:36:09+0100] [ALPM] running '40-fontconfig-config.hook'...
[2022-02-15T10:36:09+0100] [ALPM] running '40-update-ca-trust.hook'...
[2022-02-15T10:36:12+0100] [ALPM] running '60-depmod.hook'...

What is the correct way to recover my machine, I don’t want to reinstall those many apps and reconfigure them again. I really found it weird that both kernels were broken at the same time, then what is the need of keeping two kernels if they are upgraded in parallel. Thanks

[NGr]

Hi,

This post will be helpful:

Linux Update Interrupted And Now Linux Broken

How do you know that it did really freeze? Some updates take a longer time to install, and there’s only so much data that your drive can handle at the same time. The mistake all of the impatient newbies make, and the result is always the same. At the start of the upgrade process, pacman removes the kernels and the initcpios. That is why your system can’t boot anymore if you interrupt the process. Boot up from the installer medium in live mode, open up a termin…

[medmedin]

It didn’t work, the error message is gone but when I click on 5.4 or 5.15 entry in grub menu, the screen goes black, I waited about 30min after clicking on each one but neither the logo nor login manager appeared.
How can I re-execute and reinstall all 2022-02-14 upgrade packages ?

[Mirdarthos]

I suspect you’d have to boot up with a Live ISO, from there enter a chroot environment, and re-sync (redo the update), to get everything working again.

[medmedin]

I did it with live USB under root using manjaro-chroot -a and updated pacman mirrors but pacman -Syyu shows nothing to update.

[Mirdarthos]

To chroot

1. Ensure you’ve got a relatively new ISO or at least one with an LTS kernel.

2. Write/copy/dd the ISO to a USB thumb drive.

3. When done, boot with the above mentioned USB thumb drive into the live environment.

4. Once booted, open a terminal and enter the following command to enter the chroot encironment:

manjaro-chroot -a

5. If you have more than one Linux installation, select the correct one to use from the list provided.

When done, you should now be in the chroot environment.

But, be careful, as you’re now in an actual root environment on your computer, so any changes you make will persist after a restart.

6. Perform a full, complete system upgrade:

pamac upgrade --enable-downgrade

7. Exit the chroot environment

exit

8. And reboot

reboot

Hold your thumbs and cross your heart.

If it works, feel free to heap on the praise. If not, well, then I think I’m not here.

[medmedin]

If anyone suffered from sudden cut in electricity while the system is upgrading, this is how I solved it with help of this great community:

1. Prepare a live USB containing Manjaro

2. Boot into live mode and connect to internet

3. In terminal type:
   sudo su -
manjaro-chroot -a
   Here select installed operating system that corresponds to Manjaro
   pacman-mirrors --fasttrack
pacman -Syyu

4. This is the important step that fixes the problem : you reinstall either the same version of the previous kernel or install new one (for me I chose 5.15):
   pacman -S linux515 linux515-headers
   Then reboot and happy Manjaro