| Summary: | Machine rebooted when updating systemd | ||
|---|---|---|---|
| Product: | Mageia | Reporter: | Pascal Terjan <pterjan> |
| Component: | RPM Packages | Assignee: | Base system maintainers <basesystem> |
| Status: | RESOLVED FIXED | QA Contact: | |
| Severity: | major | ||
| Priority: | Normal | CC: | mageia, marja11, ngompa13, thierry.vignaud, tmb, zen25000 |
| Version: | Cauldron | ||
| Target Milestone: | --- | ||
| Hardware: | All | ||
| OS: | Linux | ||
| Whiteboard: | |||
| Source RPM: | systemd | CVE: | |
| Status comment: | |||
# rpm -qa systemd* systemd-230-12.1.mga6 systemd-236-3.mga7 systemd-units-230-12.1.mga6 Tried again, crashed again:
# urpmi --auto-update
http://ftp.free.fr/mirrors/mageia.org/distrib/cauldron/x86_64/media/core/release/media_info/20180108-151027-synthesis.hdlist.cz
updated medium "Core Release"
medium "Core Updates" is up-to-date
medium "Tainted Release" is up-to-date
medium "Tainted Updates" is up-to-date
http://ftp.free.fr/mirrors/mageia.org/distrib/cauldron/i586/media/core/release/media_info/20180108-150709-synthesis.hdlist.cz
updated medium "Core 32bit Release"
medium "Core 32bit Updates" is up-to-date
medium "Tainted 32bit Release" is up-to-date
medium "Tainted 32bit Updates" is up-to-date
The following package has to be removed for others to be upgraded:
systemd-236-3.mga7.x86_64
(in order to install systemd-236-3.mga7.x86_64) (y/N) y
To satisfy dependencies, the following packages are going to be installed:
Package Version Release Arch
(medium "Core Release")
cpupower 4.14.12 2.mga7 x86_64
dracut 046 2.mga7 x86_64
kernel-server-4.14.12-2.mga7 1 1.mga7 x86_64
kernel-server-latest 4.14.12 2.mga7 x86_64
kernel-userspace-headers 4.14.12 2.mga7 x86_64
lib64atomic_ops1 7.6.2 1.mga7 x86_64
lib64ncursesw-devel 6.0 20171223.2.m> x86_64
lib64ncursesw5 6.0 20171223.2.m> x86_64
lib64systemd0 236 3.mga7 x86_64
lib64tcl-devel 8.6.8 1.mga7 x86_64
lib64thai0 0.1.27 1.mga7 x86_64
lib64udev1 236 3.mga7 x86_64
lib64unistring2 0.9.8 1.mga7 x86_64
ncurses 6.0 20171223.2.m> x86_64
ruby-irb 2.5.0 16.mga7 noarch
strace 4.20 1.mga7 x86_64
sysstat 11.6.1 1.mga7 x86_64
systemd 236 3.mga7 x86_64
systemd-units 236 3.mga7 x86_64
tk 8.6.8 1.mga7 x86_64
vim-common 8.0.1428 2.mga7 x86_64
vim-enhanced 8.0.1428 2.mga7 x86_64
vim-minimal 8.0.1428 2.mga7 x86_64
(medium "Core 32bit Release")
liblz4_1 1.8.0 2.mga7 i586
libncurses6 6.0 20171223.2.m> i586
libncursesw6 6.0 20171223.2.m> i586
libsystemd0 236 3.mga7 i586
38MB of additional disk space will be used.
75MB of packages will be retrieved.
Proceed with the installation of the 27 packages? (Y/n)
http://ftp.free.fr/mirrors/mageia.org/distrib/cauldron/x86_64/media/core/release/lib64unistring2-0.9.8-1.mga7.x86_64.rpm
http://ftp.free.fr/mirrors/mageia.org/distrib/cauldron/x86_64/media/core/release/sysstat-11.6.1-1.mga7.x86_64.rpm
http://ftp.free.fr/mirrors/mageia.org/distrib/cauldron/x86_64/media/core/release/kernel-server-latest-4.14.12-2.mga7.x86_64.rpm
http://ftp.free.fr/mirrors/mageia.org/distrib/cauldron/x86_64/media/core/release/vim-common-8.0.1428-2.mga7.x86_64.rpm
http://ftp.free.fr/mirrors/mageia.org/distrib/cauldron/x86_64/media/core/release/tk-8.6.8-1.mga7.x86_64.rpm
http://ftp.free.fr/mirrors/mageia.org/distrib/cauldron/x86_64/media/core/release/cpupower-4.14.12-2.mga7.x86_64.rpm
http://ftp.free.fr/mirrors/mageia.org/distrib/cauldron/x86_64/media/core/release/strace-4.20-1.mga7.x86_64.rpm
http://ftp.free.fr/mirrors/mageia.org/distrib/cauldron/x86_64/media/core/release/vim-minimal-8.0.1428-2.mga7.x86_64.rpm
http://ftp.free.fr/mirrors/mageia.org/distrib/cauldron/x86_64/media/core/release/systemd-236-3.mga7.x86_64.rpm
http://ftp.free.fr/mirrors/mageia.org/distrib/cauldron/x86_64/media/core/release/ncurses-6.0-20171223.2.mga7.x86_64.rpm
http://ftp.free.fr/mirrors/mageia.org/distrib/cauldron/x86_64/media/core/release/lib64ncursesw5-6.0-20171223.2.mga7.x86_64.rpm
http://ftp.free.fr/mirrors/mageia.org/distrib/cauldron/x86_64/media/core/release/systemd-units-236-3.mga7.x86_64.rpm
http://ftp.free.fr/mirrors/mageia.org/distrib/cauldron/x86_64/media/core/release/kernel-userspace-headers-4.14.12-2.mga7.x86_64.rpm
http://ftp.free.fr/mirrors/mageia.org/distrib/cauldron/x86_64/media/core/release/lib64thai0-0.1.27-1.mga7.x86_64.rpm
http://ftp.free.fr/mirrors/mageia.org/distrib/cauldron/x86_64/media/core/release/lib64tcl-devel-8.6.8-1.mga7.x86_64.rpm
http://ftp.free.fr/mirrors/mageia.org/distrib/cauldron/x86_64/media/core/release/lib64ncursesw-devel-6.0-20171223.2.mga7.x86_64.rpm
http://ftp.free.fr/mirrors/mageia.org/distrib/cauldron/x86_64/media/core/release/lib64systemd0-236-3.mga7.x86_64.rpm
http://ftp.free.fr/mirrors/mageia.org/distrib/cauldron/x86_64/media/core/release/lib64atomic_ops1-7.6.2-1.mga7.x86_64.rpm
http://ftp.free.fr/mirrors/mageia.org/distrib/cauldron/x86_64/media/core/release/kernel-server-4.14.12-2.mga7-1-1.mga7.x86_64.rpm
http://ftp.free.fr/mirrors/mageia.org/distrib/cauldron/x86_64/media/core/release/vim-enhanced-8.0.1428-2.mga7.x86_64.rpm
http://ftp.free.fr/mirrors/mageia.org/distrib/cauldron/x86_64/media/core/release/ruby-irb-2.5.0-16.mga7.noarch.rpm
http://ftp.free.fr/mirrors/mageia.org/distrib/cauldron/x86_64/media/core/release/lib64udev1-236-3.mga7.x86_64.rpm
http://ftp.free.fr/mirrors/mageia.org/distrib/cauldron/x86_64/media/core/release/dracut-046-2.mga7.x86_64.rpm
http://ftp.free.fr/mirrors/mageia.org/distrib/cauldron/i586/media/core/release/libncurses6-6.0-20171223.2.mga7.i586.rpm
http://ftp.free.fr/mirrors/mageia.org/distrib/cauldron/i586/media/core/release/libsystemd0-236-3.mga7.i586.rpm
http://ftp.free.fr/mirrors/mageia.org/distrib/cauldron/i586/media/core/release/libncursesw6-6.0-20171223.2.mga7.i586.rpm
http://ftp.free.fr/mirrors/mageia.org/distrib/cauldron/i586/media/core/release/liblz4_1-1.8.0-2.mga7.i586.rpm
installing kernel-userspace-headers-4.14.12-2.mga7.x86_64.rpm systemd-units-236-3.mga7.x86_64.rpm lib64tcl-devel-8.6.8-1.mga7.x86_64.rpm lib64thai0-0.1.27-1.mga7.x86_64.rpm ruby-irb-2.5.0-16.mga7.noarch.rpm vim-enhanced-8.0.1428-2.mga7.x86_64.rpm kernel-server-4.14.12-2.mga7-1-1.mga7.x86_64.rpm lib64atomic_ops1-7.6.2-1.mga7.x86_64.rpm lib64systemd0-236-3.mga7.x86_64.rpm lib64ncursesw-devel-6.0-20171223.2.mga7.x86_64.rpm dracut-046-2.mga7.x86_64.rpm lib64udev1-236-3.mga7.x86_64.rpm libsystemd0-236-3.mga7.i586.rpm sysstat-11.6.1-1.mga7.x86_64.rpm lib64unistring2-0.9.8-1.mga7.x86_64.rpm tk-8.6.8-1.mga7.x86_64.rpm vim-common-8.0.1428-2.mga7.x86_64.rpm cpupower-4.14.12-2.mga7.x86_64.rpm libncurses6-6.0-20171223.2.mga7.i586.rpm kernel-server-latest-4.14.12-2.mga7.x86_64.rpm strace-4.20-1.mga7.x86_64.rpm libncursesw6-6.0-20171223.2.mga7.i586.rpm lib64ncursesw5-6.0-20171223.2.mga7.x86_64.rpm liblz4_1-1.8.0-2.mga7.i586.rpm ncurses-6.0-20171223.2.mga7.x86_64.rpm systemd-236-3.mga7.x86_64.rpm vim-minimal-8.0.1428-2.mga7.x86_64.rpm from /var/cache/urpmi/rpms
Preparing... #############################################
1/27: systemd #############################################
2/27: systemd-units ###############
OK the crash is: /sbin/init: error while loading shared libraries: libsystemd-shared-236.so: cannot open shared object file: No such file or directory [ 4.840093] Kernel panic - not syncing: Attempted to kill init! exitcode=0x00007f00 Original crash was actually: [ 458.956426] systemd: 39 output lines suppressed due to ratelimiting [ 458.963254] Kernel panic - not syncing: Attempted to kill init! exitcode=0x00007f00 [ 458.963254] [ 458.972516] CPU: 2 PID: 1 Comm: systemd Not tainted 4.14.11-server-5.mga7 #1 [ 458.979668] Hardware name: Censored [ 458.988990] Call Trace: [ 458.991551] dump_stack+0x5c/0x85 [ 458.994980] panic+0xe4/0x232 [ 458.998054] do_exit+0xad4/0xae0 [ 459.001386] do_group_exit+0x3a/0xa0 [ 459.005067] SyS_exit_group+0x10/0x10 [ 459.008837] entry_SYSCALL_64_fastpath+0x1e/0x81 [ 459.013562] RIP: 0033:0x7f91ed9c88b8 [ 459.017239] RSP: 002b:00007fffaa6ad448 EFLAGS: 00000206 [ 459.017816] Kernel Offset: 0x3000000 from 0xffffffff81000000 (relocation range: 0xffffffff80000000-0xffffffffbfffffff) [ 459.033956] Rebooting in 10 seconds.. [ 469.092026] ACPI MEMORY or I/O RESET_REG. But now it crashes on boot Likely source of the problem: systemd and systemd-units get updated before lib64systemd0 in the transaction I couldn't find a reason for systemd to either crash or reexec itself when the package is updated so I am not sure if this is a crash and we can't do anything, or a failure to reexec due to the lack of the lib. I would guess the problem is while installing systemd main package (or when running its post) and reboot happens in systemd-unit because the kernel waits 10s after init crashed.
Marja Van Waes
2018-01-08 20:31:14 CET
Assignee:
bugsquad =>
basesystem I wonder if there is some issues with the PTI security fixes beeing flooded everywhere... try to boot with pti=off to try and rule them out... there has been sone interesting fallouts from the kernel changes ... and more fixes will land in upstream 4.14.13... CC:
(none) =>
tmb When the first crash first happened, I hadn't rebooted for a few weeks and was running kernel 4.14.5 I think the problem is "libsystemd-shared-236.so" is installed by systemd-units and not by systemd itself! CC:
(none) =>
mageia Oh I assumed it was by lib64systemd0 and didn't even check :) My update crashed and locked the machine during systemd update and now any kernel panics. Attempting a urpmi --auto-update while chrooted into it now fails due to curl failure: /lib64/libunistring.so.4 file too short, which from the above was in the same transaction. @Barry: you have to update a few libs by hand, e.g. lib64unistring (in general every lib that failed). For systemd, you have to install systemd, lib64systemd,systemd-units, systemd-devel via rpm --replacepkgs If rpm fails, check if the symlink /lib64/libsystemd.so.0 points to a the new version with 0 bytes, link it back to the old version and install again. Then your system will boot again. libsystemd-shared-236.so should be moved back to systemd IMHO We had no shared lib in systemd-units previously And systemd-units is supposed to be "Basic configuration files, directories and installation tool for the systemd system and session manager", not libs. CC:
(none) =>
thierry.vignaud There are a few other things that need to be moved around Note that fedora merged systemd-units into main package in 2012 @Marc thanks for the pointers - finally got it going again :) CC:
(none) =>
zen25000 I'm still getting random reboots even after updating to systemd-236-4.mga7 (In reply to Thierry Vignaud from comment #16) > I'm still getting random reboots even after updating to systemd-236-4.mga7 Anything in the logs? What kernel ? (In reply to Pascal Terjan from comment #14) > There are a few other things that need to be moved around > > Note that fedora merged systemd-units into main package in 2012 This split is driving me nuts, I'm probably going to kill that split as part of a greater rework before systemd 237 arrives. RHEL axed the split in RHEL 7.2 as well. SUSE doesn't have the split, either. I'm probably going to reorganize the systemd package to be more similar to the Fedora/openSUSE layout, since it makes more sense and minimizes the risk for error in these situations. Yeah, the split was needed when we started systemd migration so people could opt out of systemd in mga2 ... I dont see the need for the split anymore This bug was filed against Mageia 7 which is EOL since June 2021. With Mageia 8 there is no split of systemd-unit anymore. Closing as FIXED. Status:
NEW =>
RESOLVED |
Reporting a bug as someone reported something similar on the ML Description of problem: installing systemd-units-236-3.mga7.x86_64.rpm libsystemd0-236-3.mga7.i586.rpm vim-common-8.0.1428-2.mga7.x86_64.rpm lib64qrencode4-4.0.0-1.mga7.x86_64.rpm dracut-046-2.mga7.x86_64.rpm lib64unistring2-0.9.8-1.mga7.x86_64.rpm libncursesw6-6.0-20171223.2.mga7.i586.rpm lib64ncurses-devel-6.0-20171223.2.mga7.x86_64.rpm lib64ncurses6-6.0-20171223.2.mga7.x86_64.rpm vim-minimal-8.0.1428-2.mga7.x86_64.rpm tcl-8.6.8-1.mga7.x86_64.rpm lib64tk8.6-8.6.8-1.mga7.x86_64.rpm lib64ncursesw-devel-6.0-20171223.2.mga7.x86_64.rpm lib64ip4tc0-1.6.1-3.mga7.x86_64.rpm lib64ncursesw5-6.0-20171223.2.mga7.x86_64.rpm kernel-server-4.14.12-2.mga7-1-1.mga7.x86_64.rpm lib64atomic_ops1-7.6.2-1.mga7.x86_64.rpm thai-data-0.1.27-1.mga7.x86_64.rpm lib64ncurses5-6.0-20171223.2.mga7.x86_64.rpm lib64udev1-236-3.mga7.x86_64.rpm lib64systemd0-236-3.mga7.x86_64.rpm cpupower-4.14.12-2.mga7.x86_64.rpm strace-4.20-1.mga7.x86_64.rpm lib64ncursesw6-6.0-20171223.2.mga7.x86_64.rpm nss-myhostname-236-3.mga7.x86_64.rpm ruby-irb-2.5.0-16.mga7.noarch.rpm tk-8.6.8-1.mga7.x86_64.rpm vim-enhanced-8.0.1428-2.mga7.x86_64.rpm lib64tcl-devel-8.6.8-1.mga7.x86_64.rpm lib64tcl8.6-8.6.8-1.mga7.x86_64.rpm liblz4_1-1.8.0-2.mga7.i586.rpm mageia-release-Default-7-0.4.mga7.x86_64.rpm mageia-release-common-7-0.4.mga7.x86_64.rpm ncurses-6.0-20171223.2.mga7.x86_64.rpm lib64thai0-0.1.27-1.mga7.x86_64.rpm sysstat-11.6.1-1.mga7.x86_64.rpm systemd-236-3.mga7.x86_64.rpm libncurses6-6.0-20171223.2.mga7.i586.rpm kernel-server-latest-4.14.12-2.mga7.x86_64.rpm kernel-userspace-headers-4.14.12-2.mga7.x86_64.rpm from /var/cache/urpmi/rpms Preparing... ############################################# 1/40: lib64ncurses6 ############################################# 2/40: lib64tcl8.6 ############################################# 3/40: tcl ############################################# 4/40: lib64ncurses-devel ############################################# 5/40: lib64ncursesw6 ############################################# 6/40: mageia-release-common ############################################# 7/40: mageia-release-Default ############################################# 8/40: nss-myhostname ############################################# 9/40: lib64ncurses5 ############################################# 10/40: thai-data ############################################# 11/40: lib64ip4tc0 ############################################# 12/40: lib64tk8.6 ############################################# 13/40: lib64qrencode4 ############################################# 14/40: systemd ############################################# 15/40: systemd-units #######################################Timeout, server 104.X.X.X not responding. Unfortunately the journal stops about half an hour before the crash