Bug 15295 - release notes are no more unpacked on the distrib tree when a new mageia-release is uploaded
Summary: release notes are no more unpacked on the distrib tree when a new mageia-rele...
Status: RESOLVED FIXED
Alias: None
Product: Infrastructure
Classification: Unclassified
Component: BuildSystem (show other bugs)
Version: unspecified
Hardware: All Linux
Priority: release_blocker major
Target Milestone: ---
Assignee: Thomas Backlund
QA Contact:
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2015-02-14 22:32 CET by Thierry Vignaud
Modified: 2015-02-27 21:57 CET (History)
2 users (show)

See Also:
Source RPM:
CVE:
Status comment:


Attachments

Description Thierry Vignaud 2015-02-14 22:32:59 CET
release notes are no more unpacked on the distrib tree when a new mageia-release is uploaded

Reproducible: 

Steps to Reproduce:
Thierry Vignaud 2015-02-14 22:33:07 CET

Priority: Normal => release_blocker

Comment 1 Pascal Terjan 2015-02-17 23:34:21 CET
Hmm I see no upload logs for mageia-release....

N: [emi] processing 20150214151747.tv.valstar.1031
W: [emi] another instance [1232] is already running for  41  seconds
W: [emi] another instance [1232] is already running for  101  seconds
W: [emi] another instance [1232] is already running for  161  seconds
W: [emi] another instance [1232] is already running for  221  seconds
W: [emi] another instance [1232] is already running for  281  seconds

I think I fixed the logging in http://gitweb.mageia.org/infrastructure/puppet/commit/?id=90646397ed6b339dd5297fe41260b6fe133f1cef but I have nothing to look at for this bug :(

I'll try to run the actions manually

CC: (none) => pterjan
Component: Release (media or process) => BuildSystem
Version: Cauldron => unspecified
Product: Mageia => Infrastructure

Comment 2 Pascal Terjan 2015-02-17 23:42:59 CET
Creating action unpack_release_notes
running action unpack_release_notes on package mageia-release-common-5-0.7.mga5.i586
138 blocks
cpio: cannot remove current /distrib/bootstrap/distrib/cauldron/i586/././release-notes.html: Permission denied
cpio: cannot remove current /distrib/bootstrap/distrib/cauldron/i586/././release-notes.txt: Permission denied
0 blocks

$ ll /distrib/bootstrap/distrib/cauldron/i586 -d
drwxr-xr-x 8 root root 4096 Feb  4  2014 /distrib/bootstrap/distrib/cauldron/i586/

After a chown -R, it seemsto work again:

[schedbot@valstar ~]$ perl -I/usr/share/mga-youri-submit/lib /usr/share/mga-youri-submit/bin/youri-submit --config /etc/youri/submit-upload.conf --define user=pterjan --skip-check rpmlint --skip-check tag --skip-post clean_rpmsrate cauldron /distrib/bootstrap/distrib/cauldron/i586/media/core/release/mageia-release-common-5-0.7.mga5.i586.rpm --verbose --skip-check recency --skip-action link --skip-action markrelease --skip-action sign --skip-action archive --skip-action mail --skip-action maintdb --skip-post genhdlist2 --skip-action install
UNIVERSAL->import is deprecated and will be removed in a future perl at /usr/lib/perl5/vendor_perl/5.12.2/YAML/AppConfig.pm line 5
Creating repository
Initializing repository
Preparing upload for /distrib/bootstrap/distrib/cauldron/i586/media/core/release/mageia-release-common-5-0.7.mga5.i586.rpm in 
Creating check version
running check version on package mageia-release-common-5-0.7.mga5.i586
Use of uninitialized value in string eq at /usr/share/mga-youri-submit/lib/Youri/Submit/Check/Version.pm line 36.
Use of uninitialized value in regexp compilation at /usr/share/mga-youri-submit/lib/Youri/Submit/Check/Version.pm line 39.
Creating check acl
running check acl on package mageia-release-common-5-0.7.mga5.i586
Deprecated method, use as_string now at /usr/share/mga-youri-submit/lib/Youri/Submit/Check/ACL.pm line 32
Creating action unpack_release_notes
running action unpack_release_notes on package mageia-release-common-5-0.7.mga5.i586
138 blocks
104 blocks
Creating action unpack_gfxboot_theme
running action unpack_gfxboot_theme on package mageia-release-common-5-0.7.mga5.i586
Creating action unpack_meta_task
running action unpack_meta_task on package mageia-release-common-5-0.7.mga5.i586
Creating action unpack_installer_images
running action unpack_installer_images on package mageia-release-common-5-0.7.mga5.i586
Creating action unpack_installer_images_nonfree
running action unpack_installer_images_nonfree on package mageia-release-common-5-0.7.mga5.i586
Creating action unpack_installer_stage2
running action unpack_installer_stage2 on package mageia-release-common-5-0.7.mga5.i586
Creating action unpack_installer_advertising
running action unpack_installer_advertising on package mageia-release-common-5-0.7.mga5.i586
Creating action unpack_installer_rescue
running action unpack_installer_rescue on package mageia-release-common-5-0.7.mga5.i586
Creating action unpack_syslinux
running action unpack_syslinux on package mageia-release-common-5-0.7.mga5.i586
Creating action rebuild
running action rebuild on package mageia-release-common-5-0.7.mga5.i586
Creating post mirror
running post mirror
Comment 3 Pascal Terjan 2015-02-17 23:44:50 CET
Closing

Status: NEW => RESOLVED
Resolution: (none) => FIXED

Comment 4 Thierry Vignaud 2015-02-18 11:07:36 CET
Sorry, it's not fixed yet.

I uploaded new release notes.
But the tree still show old mga4 release notes whereas packages uploaded hours alter are already there...

Status: RESOLVED => REOPENED
Resolution: FIXED => (none)

Comment 5 Pascal Terjan 2015-02-18 11:22:05 CET
I just looked at a random mirror and it seems to be recent ones:
http://www.mirrorservice.org/sites/mageia.org/pub/mageia/distrib/cauldron/x86_64/release-notes.html
Comment 6 Pascal Terjan 2015-02-18 11:29:04 CET
Hmm even if not from Mageia 4, they seem to be the ones I forced yesterday and not the ones from today.
Comment 7 Thomas Backlund 2015-02-18 11:30:58 CET
There is some script/daemon/... running that re-sets root:root permission on distrib tree making next unpack fail
Comment 8 Pascal Terjan 2015-02-18 23:17:56 CET
Yes puppet config:

modules/buildsystem/manifests/distros.rb

    mirror_user = 'root'
[...]
            mediadir = [ bootstrap_reporoot, rel, arch, 'media' ].join('/')
            file mediadir, :ensure => 'directory', :owner => mirror_user,
                :group => mirror_user
            file [ mediadir, 'media_info' ].join('/'), :ensure => 'directory',
                :owner => schedbot_user, :group => schedbot_user
            file [ mediadir, 'debug' ].join('/'), :ensure => 'directory',
                :owner => mirror_user, :group => mirror_user
Comment 9 Mageia Robot 2015-02-18 23:23:30 CET
commit 50bae74af7c57eef227884bb8d5e271877321502
Author: Pascal Terjan <pterjan@...>
Date:   Wed Feb 18 22:23:22 2015 +0000

    Give media directories to schedbot to allow extracting release notes (mga#15295)
---
 Commit Link:
   http://gitweb.mageia.org/infrastructure/puppet/commit/?id=50bae74af7c57eef227884bb8d5e271877321502
Comment 10 Pascal Terjan 2015-02-18 23:27:02 CET
Closing again :)

Status: REOPENED => RESOLVED
Resolution: (none) => FIXED

Comment 11 Mageia Robot 2015-02-27 21:57:42 CET
commit a3bb6a6c9cc43d6f286982554aef945a6a6abaf9
Author: Pascal Terjan <pterjan@...>
Date:   Fri Feb 27 20:57:35 2015 +0000

    Really give media directories to schedbot to allow extracting release notes (mga#15295)
---
 Commit Link:
   http://gitweb.mageia.org/infrastructure/puppet/commit/?id=a3bb6a6c9cc43d6f286982554aef945a6a6abaf9

Note You need to log in before you can comment on or make changes to this bug.