Bug 7271

Summary: use cauldron's genhdlist2+rpmtools in order to generate synthesis & the like
Product: Infrastructure Reporter: Thierry Vignaud <thierry.vignaud>
Component: BuildSystemAssignee: Sysadmin Team <sysadmin-bugs>
Status: RESOLVED FIXED QA Contact:
Severity: normal    
Priority: Normal CC: ennael1, sysadmin-bugs, tmb
Version: unspecified   
Target Milestone: ---   
Hardware: All   
OS: Linux   
Whiteboard:
Source RPM: CVE:
Status comment:

Description Thierry Vignaud 2012-08-31 14:00:01 CEST
use cauldron's genhdlist2+rpmtools in order to generate synthesis & the like for cauldron/mga3+ repositories.
That enables us to better compress synthesis (44% saved) & xml meta-data (25%).

That means:
- faster update checking in mgaapplet & urpmi.update
  (less time spent downloading)
- saving space on ISO images.

Both mga2's URPM (update) & cauldron handles synthesis/hdlist compressed with XZ instead of gzip.
Thierry Vignaud 2012-09-04 10:04:21 CEST

CC: (none) => ennael1

Comment 1 Anne Nicolas 2012-09-04 10:50:44 CEST
we will see that for alpha 2 on new build server. Still it will need to backport it for Mageia 2, we don't use cauldron on such server
Comment 2 Thomas Backlund 2012-09-04 10:54:43 CEST
A few points...

- we use the same tools for generating mga1 / mga2 hdlists too so we need to be careful

- how will we handle mga1 -> mga3 upgraders ?

CC: (none) => tmb

Comment 3 Thierry Vignaud 2012-09-04 12:02:50 CEST
mga1 -> 3 upgrade can be done through DVD.
For live upgrade, users will have to go first through the mga1 -> 2 upgrade.
Note that though it usually works to upgrade from X to X+N, we usually advice to go through all intermediate upgrades, which are the ones that got (more or less) tested.
Comment 4 Thomas Backlund 2012-09-04 12:13:35 CEST
Yeah, I know, but there will always be questions for those wanting to skip a release...

Otoh for mga3 upgraders we need to make the UsrMove thingie work too :)
Comment 5 Thierry Vignaud 2012-09-05 16:30:48 CEST
OK, I have an URPM for mga1 that can read XZ synthesis (need latest rpm-4.8.1-10.4.mga1 updates from April though).
I'll upload it tonight and open a ticket for an official update.
Comment 6 Nicolas Vigier 2012-09-05 16:47:32 CEST
This URPM update will be useful for mga1 -> mga3 upgrade. However this doesn't allow XZ synthesis in mga1 updates, because you need to be able to read synthesis to install the URPM update. So we need to keep synthesis not compressed with XZ for mga1.

Is there an option in new genhdlists2 to not compress with XZ, that we could use to generate mga1 hdlists ?

CC: (none) => boklm

Comment 7 Thierry Vignaud 2012-09-05 18:18:42 CEST
use the man page, Luke!
=> --synthesis-filter

aka:
$ genhdlist2 . 
$ file media_info/synthesis.hdlist.cz
media_info/synthesis.hdlist.cz: XZ compressed data
$ genhdlist2 . -synthesis-filter '.cz:gzip -5' 
$ file media_info/synthesis.hdlist.cz
media_info/synthesis.hdlist.cz: gzip compressed data, from Unix, last modified: Wed Sep  5 16:17:23 2012
Comment 8 Thierry Vignaud 2012-09-12 16:22:57 CEST
Ping?
Nicolas Vigier 2014-03-24 10:52:33 CET

CC: boklm => (none)

Comment 9 Thierry Vignaud 2015-04-29 09:06:37 CEST
We now use a new enough genhdlist2 so that's OK

Status: NEW => RESOLVED
Resolution: (none) => FIXED