Bug 27999

Summary: eMMC devices reordered in bootup and causes boot failure with 5.10.4-desktop-(x series).mga8
Product: Mageia Reporter: Ben McMonagle <westel>
Component: RPM PackagesAssignee: Kernel and Drivers maintainers <kernel>
Status: RESOLVED FIXED QA Contact:
Severity: normal    
Priority: Normal CC: davidwhodgins
Version: Cauldron   
Target Milestone: ---   
Hardware: All   
OS: Linux   
Whiteboard:
Source RPM: kernel 5.10.4-desktop-2.mga8 CVE:
Status comment:
Attachments: lspcidrake -v
journal of failed boot
good 5.9.12-desktop-1.mga8 journal
failed 5.10.4-desktop-2.mga8 boot journal
grub configuration
unsuccessful 5.10.4 boot
successful 5.10.4 boot via advanced boot recovery option

Description Ben McMonagle 2021-01-02 07:46:47 CET
Description of problem: in a multi-DE install (and multi-DM) if using PlasmaDE on GDM, when upgrading kernel from 5.9.12-desktop-1.mga8 to 5.10.4-desktop-2.mga8, login is no longer possible using GDM.
reboot, chose prior kernel, change GDM to SDDM, reboot and now choose 5.10.4-desktop-2.mga8 and login is ok (to Plasma DE) 

Version-Release number of selected component (if applicable):


How reproducible: 


Steps to Reproduce:
1.install all DE from x86_64 CI.iso. reboot.
2.reboot, choose Plasma DE, login  and update to latest kernel
3.reboot
4. text screen presents Ctrl+D or root password to continue
Comment 1 Ben McMonagle 2021-01-02 07:49:42 CET
Created attachment 12170 [details]
lspcidrake -v
Comment 2 Ben McMonagle 2021-01-02 08:12:46 CET
Created attachment 12171 [details]
journal of failed boot

I tried to change to SDDM via tty but reboot was unsuccessful.
Comment 3 Dave Hodgins 2021-01-02 12:00:08 CET Comment hidden (obsolete)

CC: (none) => davidwhodgins
Keywords: (none) => feedback

Comment 4 Dave Hodgins 2021-01-02 12:18:45 CET
From attachment 12171 [details] (with localhost removed from all lines)
Jan 02 19:02:49 kernel: Kernel command line: BOOT_IMAGE=/boot/vmlinuz-5.10.4-desktop-2.mga8 root=UUID=34203a1b-dc51-47f5-9fd5-63ae6c2c5f59 ro noiswmd resume=/dev/mmcblk0p3 audit=0 vga=791
Jan 02 19:02:49 kernel:  mmcblk1: p1 p2 p3
Jan 02 19:02:49 kernel: EXT4-fs (mmcblk1p2): INFO: recovery required on readonly filesystem
Jan 02 19:02:49 kernel: EXT4-fs (mmcblk1p2): write access will be enabled during recovery
Jan 02 19:02:49 kernel: EXT4-fs (mmcblk1p2): recovery complete
Jan 02 19:02:49 kernel: EXT4-fs (mmcblk1p2): mounted filesystem with ordered data mode. Opts: (null)
Jan 02 19:02:49 kernel: EXT4-fs (mmcblk1p2): mounted filesystem with ordered data mode. Opts: (null)
Jan 02 19:02:49 dracut: Mounted root filesystem /dev/mmcblk1p2
Jan 02 19:02:49 kernel: EXT4-fs (mmcblk1p2): re-mounted. Opts: acl
Jan 02 19:02:49 systemd-fsck[461]: /dev/mmcblk1p2: clean, 225350/798112 files, 1777494/3187376 blocks
Jan 02 19:04:19 systemd[1]: dev-mmcblk0p1.device: Job dev-mmcblk0p1.device/start timed out.
Jan 02 19:04:19 systemd[1]: Timed out waiting for device /dev/mmcblk0p1.
Jan 02 19:04:19 systemd[1]: dev-mmcblk0p1.device: Job dev-mmcblk0p1.device/start failed with result 'timeout'.
Jan 02 19:04:19 systemd[1]: dev-mmcblk0p3.device: Job dev-mmcblk0p3.device/start timed out.
Jan 02 19:04:19 systemd[1]: Timed out waiting for device /dev/mmcblk0p3.
Jan 02 19:04:19 systemd[1]: Dependency failed for /dev/mmcblk0p3.
Jan 02 19:04:19 systemd[1]: dev-mmcblk0p3.swap: Job dev-mmcblk0p3.swap/start failed with result 'dependency'.
Jan 02 19:04:19 systemd[1]: dev-mmcblk0p3.device: Job dev-mmcblk0p3.device/start failed with result 'timeout'.

So the question is why the device mmcblk0 failed start.

Please try to recreate the error.
Dave Hodgins 2021-01-02 12:19:27 CET

Assignee: bugsquad => kernel
Keywords: feedback => (none)

Ben McMonagle 2021-01-02 21:05:29 CET

Summary: GDM does not present login greeter with 5.10.4-desktop-2.mga8 => eMMC device does not boot with 5.10.4-desktop-2.mga8

Comment 5 Thomas Backlund 2021-01-02 21:41:13 CET
Can you provide log from a working boot with 5.9 series ?

I see in this one we fail to enumerate one gpio:

sdhci-acpi 80860F16:00: failed to setup card detect gpio
Comment 6 Ben McMonagle 2021-01-02 21:54:23 CET
Created attachment 12174 [details]
good 5.9.12-desktop-1.mga8  journal

full journal of a 5.9.12-desktop-1.mga8 session on this hardware (Acer C730 ex-chromebook with Seabios)
Comment 7 Ben McMonagle 2021-01-02 21:56:55 CET
Created attachment 12175 [details]
failed 5.10.4-desktop-2.mga8 boot journal

next boot that failed
Comment 8 Ben McMonagle 2021-01-03 02:48:09 CET
Mga8 Gnome 32 installed on Asus T100TA-DK003H does NOT exhibit issue.

successful multiple bootups and reboots ok
Comment 9 Thomas Backlund 2021-01-03 16:57:15 CET
ok, so with 5.9 series kernels it inits as primary storage:

mmc0: new HS200 MMC card at address 0001
mmcblk0: p1 p2 p3

and with 5.10 series kernels it gets enumerated as second storage:

mmc1: new HS200 MMC card at address 0001
mmcblk1: p1 p2 p3


Of course kernel does not guarantee device detetection ordering wich is why we prefer uuid or label mounts...

So if you alter the resume=/dev/mmcblk0p3 to resume=/dev/mmcblk1p3 it would probably boot up on 5.10 series 

or boot the 5.9 series, change resume and swap to use uuid reference, recreate initrds and so on...
Comment 10 Ben McMonagle 2021-01-03 20:52:46 CET
uname -r
5.9.12-desktop-1.mga8

lsblk
NAME         MAJ:MIN RM  SIZE RO TYPE MOUNTPOINT
mmcblk0      179:0    0 14.7G  0 disk 
├─mmcblk0p1  179:1    0  299M  0 part /boot/EFI
├─mmcblk0p2  179:2    0 12.2G  0 part /
└─mmcblk0p3  179:3    0  2.2G  0 part [SWAP]
mmcblk0boot0 179:8    0    4M  1 disk 
mmcblk0boot1 179:16   0    4M  1 disk 


not sure where mccblk1..... comes from, as no external storage connected.

altering resume=/dev/mmcblk0p3 to resume=/dev/mmcblk1p3 did not seem to make a difference
Comment 11 Ben McMonagle 2021-01-03 21:06:28 CET
Created attachment 12177 [details]
grub configuration

appears to be set to look for UUID
Comment 12 Thomas Backlund 2021-01-03 21:29:23 CET
(In reply to ben mcmonagle from comment #10)
> uname -r
> 5.9.12-desktop-1.mga8
> 
> lsblk
> NAME         MAJ:MIN RM  SIZE RO TYPE MOUNTPOINT
> mmcblk0      179:0    0 14.7G  0 disk 
> ├─mmcblk0p1  179:1    0  299M  0 part /boot/EFI
> ├─mmcblk0p2  179:2    0 12.2G  0 part /
> └─mmcblk0p3  179:3    0  2.2G  0 part [SWAP]
> mmcblk0boot0 179:8    0    4M  1 disk 
> mmcblk0boot1 179:16   0    4M  1 disk 
> 
> 
> not sure where mccblk1..... comes from, as no external storage connected.
> 

either you have an card reader or the hardware has 2 ports and the system only uses one...

from kernel 5.9 log:
mmc0: SDHCI controller on ACPI [80860F14:00] using ADMA
sdhci-acpi 80860F16:00: failed to setup card detect gpio
mmc1: SDHCI controller on ACPI [80860F16:00] using ADMA
mmc0: new HS200 MMC card at address 0001
mmcblk0: p1 p2 p3


and in 5.10 log it gets swapped:
sdhci-acpi 80860F16:00: failed to setup card detect gpio
mmc0: SDHCI controller on ACPI [80860F16:00] using ADMA
mmc1: SDHCI controller on ACPI [80860F14:00] using ADMA
mmc1: new HS200 MMC card at address 0001
mmcblk1: p1 p2 p3


> altering resume=/dev/mmcblk0p3 to resume=/dev/mmcblk1p3 did not seem to make
> a difference

I forgot there is also the contents in:
/etc/dracut.conf.d/51-mageia-resume.conf


and since this is in initrd the 5.10 initrd need to be rebuilt after changing this file
yrs, but the resume line points to /dev stuff...

But I also
Comment 13 Ben McMonagle 2021-01-04 09:02:08 CET
uname -r
5.10.4-desktop-3.mga8

failed today on Asus T00TA.

was able to boot usning the advanced boot option- recovery
Comment 14 Ben McMonagle 2021-01-04 09:15:17 CET
Created attachment 12178 [details]
unsuccessful 5.10.4 boot
Comment 15 Ben McMonagle 2021-01-04 09:17:11 CET
Created attachment 12179 [details]
successful 5.10.4 boot via advanced boot recovery option
Ben McMonagle 2021-01-04 09:18:30 CET

Summary: eMMC device does not boot with 5.10.4-desktop-2.mga8 => eMMC device does not boot with 5.10.4-desktop-(x series).mga8

Ben McMonagle 2021-01-04 09:19:07 CET

Hardware: x86_64 => All

Ben McMonagle 2021-01-04 09:21:20 CET

Summary: eMMC device does not boot with 5.10.4-desktop-(x series).mga8 => eMMC devices reordered in bootup and causes boot failure with 5.10.4-desktop-(x series).mga8

Comment 16 Dave Hodgins 2021-01-04 09:34:08 CET
One workaround that should work would be to add the nofail option to the swap
line in /etc/fstab, and then run dracut -f.

When the swap does time out though, the system would be running without it,
but it might make it easier to debug.
Comment 17 Ben McMonagle 2021-01-06 04:37:22 CET
ok on MGA8 RC, so closing as fixed

Resolution: (none) => FIXED
Status: NEW => RESOLVED