Pamac auto update (kernel 6.6.16 to 19) made multiple systems unusable

Hi,

I have multiple systems running manjaro stable, and few of them are set up to update automatically every week and install on shutdown. On next boot they either failed to boot or had no network/audio etc.
I came to the conclusion that the kernel update didnt go thru properly (all systems were up to date), since reinstalling linux66 kernel fixed the problem everywhere.
I rly hope this wont happen next update, but if it does, where do i look to see what causes the error? The systems are completely unrelated in hardware.

Cheers,
Kloon

youā€™re on a rolling release, not to say a bleeding edge distro. hope is good but constant backups are better.
especially if you run a ā€œunusualā€ configuration.

2 Likes

In addition, Iā€™d not recommend unattended upgrades, that youā€™ve had done there.

Chances are, if you didnā€™t rely on magic, this wouldnā€™t have happened.

Manjaro is stable, rock-friggin-solid. It can be used as a server even. That doesnā€™t mean it should be done. Itā€™d be a much better idea to rather use Ubuntu LTS. Like I have on my Raspberry PI Home server here.

But Iā€™ll stick to my PC for Manjaro. I didnā€™t even recommend it for my brother when he asked, purely because he wouldnā€™t be able to constantly keep it up-to-date like it needs to be.

4 Likes

Here:

Pacmanā€™s output is meant to be read (and acted upon) by a human, so automatic updates are not a good idea.

Its pamac, not pacman, and its an option in the GUI settings menu so its pretty reasonable to use such a thing.

I have timeshift snapshots set up so yea, but still its a pretty common thing to expect on a modern distro, far from unusual, most ppl dont wanna bother manually updating system every single time.

For home server i run ubuntu lts aswell, never had a problem w unattended upgrades over many years, but for desktop i prefer a rolling distro, but not bleeding edge like arch or debian unstable. I dont think having automatic updates is relying on magic, should be a fairly common option among distros, not many ppl would bother updating manually every single time.

Itā€™s a stupid option if true. Who manages .pacnew files and other stuff after update then? Ah right, who cares. :smiley:

It doesnā€™t hold for Arch and any arch-based distros.

Besides the ā€˜unattended upgradesā€™ ā€¦

pamac itself has specific problems with memory, full cache, crashing system ā€¦ possibly related to AUR packages and auto-update.

See, ex:

(theres also a dozen or so similar threads if you use the :mag:)

To clarify a bit - just so you know ā€¦ it wasnt the kernel update, or the update itself in general, that caused this. It would appear to me that what caused this was an interrupted upgrade. Which in turn was probably caused by a situation similar to the link above; ie - pamac running out the memory, causing a system hang during upgrade.

Different issues after updating suggest there is possibly more than one issue
Failure to boot might be issue from plymouth splash screen
Failure of network/audio devices could be failure to load a working device driver
But I prefer to look at the data before speculating on possible causes

where do i look to see what causes the error?

I suggest looking in /var/log/pacman.log to see:

  • what packages were updated
  • if any .pacnew files were creaed and need merging
  • any error messages during update

To see error messages after system reboot check system Journal

I donā€™t know if Raspbian comes with automatic updates or the image I have has it installed but it screwed me over so many times I had to get rid of it and update ā€œmanuallyā€. Of course I donā€™t do it manually as such, I use Ansible. The amount of times Iā€™ve had to SSH to one of the RPIs went down drastically. Raspbian is based on Debian.

I donā€™t expect or trust any ā€œautomaticā€ program to do updates properly.

Manjaro requires more. I would say you are expected to read release notes on every update and if there are steps to do beforehand, do it.

Now, I donā€™t know how OpenSUSE Tumbleweed is over a longer time but maybe that is an option? Still rolling-release but less active management with updates, it seems. I just donā€™t like TW because it has massive updates constantly. And people praise their automated build system for packages. Makes me trust it even less.

1 Like

The thing is, automatic updates rely on everything going hunky-dory. a Machine canā€™t do something on itā€™s own, something it hasnā€™t been programmed for by a human. And humans can only compensate, or handle any problems he/she/it knows about.

So in order for an ā€œautomaticā€ update to work flawlessly, there are a lot of stars to align, a lot of variables. And thereā€™s absolutely no way for something that has so many variables to be flawless. Less error-prone? Sure. Flawless? Not going to happen. Even more so with a rolling-release that pushes the updates quicker than, and with less testing than a point-release system.

Before I switched to Linux and when I still had an IT support job, I witnessed even Windows update problems. It can happen. As you just experienced.

1 Like