Bug 18426 - Increase transaction size in URPMI (was: urpmi-ing perl-EBook-EPUB (and other perl packages) on Cauldron is slow )
Summary: Increase transaction size in URPMI (was: urpmi-ing perl-EBook-EPUB (and other...
Status: RESOLVED FIXED
Alias: None
Product: Mageia
Classification: Unclassified
Component: RPM Packages (show other bugs)
Version: Cauldron
Hardware: x86_64 Linux
Priority: Normal enhancement
Target Milestone: ---
Assignee: Mageia tools maintainers
QA Contact:
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2016-05-10 12:53 CEST by Shlomi Fish
Modified: 2018-08-01 09:46 CEST (History)
3 users (show)

See Also:
Source RPM: urpmi, man-db
CVE:
Status comment:


Attachments

Description Shlomi Fish 2016-05-10 12:53:54 CEST
Description of problem:

If I do "urpmi perl-EBook-EPUB" on my Core i3 x86-64 Cauldron machine (which is a a fast computer), then after the hashmarks are done, urpmi hangs for a long while, while apparently running "/usr/bin/mandb -q". On my mga5 x86-64 laptop which has an older Duo Core processor and is slower than my cauldron machine, then running the same urpmi command is much faster. The same appears to happen with all other perl-* packages I tried.   

How reproducible:

Always.

Steps to Reproduce:
1. sudo or su as root
2. urpmi perl-EBook-EPUB
Comment 1 Marja Van Waes 2016-05-12 12:09:30 CEST
Neither 
"urpmi perl-EBook-EPUB" nor
"dnf install perl-EBook-EPUB" hang here on a not-so-fast cauldron.

Both pull in 5 dependencies and install fine and fast.

Setting to unconfirmed for now, please change that if you can reproduce it on a different system.

Keywords: (none) => NEEDINFO
Status: NEW => UNCONFIRMED
CC: (none) => marja11
Assignee: bugsquad => thierry.vignaud
Ever confirmed: 1 => 0

Comment 2 Thierry Vignaud 2016-05-12 15:13:30 CEST
That's not a urpmi issue.
When man is installed (really man-db), a filetrigger updates the man pages database
That's usually fast.

See eg: "rpm -q --filetriggers man-db"

You should investigate why "/usr/bin/mandb -q" is slow on your machine (strace, ...)

Maybe you got a bunch of man-pages??

Assignee: thierry.vignaud => bugsquad
Source RPM: urpmi-8.102-1.mga6.src.rpm => man-db

Thierry Vignaud 2016-05-12 15:13:40 CEST

CC: (none) => thierry.vignaud
Summary: urpmi-ing perl-EBook-EPUB (and other perl packages) on Cauldron is slow. => urpmi-ing perl-EBook-EPUB (and other perl packages) on Cauldron is slow

Comment 3 Shlomi Fish 2016-05-12 22:17:08 CEST
(In reply to Thierry Vignaud from comment #2)
> That's not a urpmi issue.
> When man is installed (really man-db), a filetrigger updates the man pages
> database
> That's usually fast.
> 
> See eg: "rpm -q --filetriggers man-db"
> 
> You should investigate why "/usr/bin/mandb -q" is slow on your machine
> (strace, ...)
> 
> Maybe you got a bunch of man-pages??

I'll attach the strace output soon. Thanks for your insight - removing the "man-pages" package seems to make the situation much better and removing mandb completely significantly improves it.
Comment 4 Thierry Vignaud 2016-11-07 14:51:24 CET
Another thing we could do would be to increase the default transaction size from 8 to eg 20 or 50 packages at once in urpmi...
Comment 5 Marja Van Waes 2017-01-10 11:30:03 CET
(In reply to Thierry Vignaud from comment #4)
> Another thing we could do would be to increase the default transaction size
> from 8 to eg 20 or 50 packages at once in urpmi...

That would be nice (I remember some difficult update or upgrade sessions, that had to be rerun until some interdependent packages ended up in the same transaction).

What is against having an unlimited transaction size? 

(In reply to Shlomi Fish from comment #3)
> (In reply to Thierry Vignaud from comment #2)

> > 
> > You should investigate why "/usr/bin/mandb -q" is slow on your machine
> > (strace, ...)
> > 
> > Maybe you got a bunch of man-pages??
> 
> I'll attach the strace output soon. Thanks for your insight - removing the
> "man-pages" package seems to make the situation much better and removing
> mandb completely significantly improves it.

A little bit sorry for hijacking your report, but since you never attached the strace output, I thought it would be OK to do so ;-)

Keywords: NEEDINFO => (none)
Status: UNCONFIRMED => NEW
Assignee: bugsquad => mageiatools
Summary: urpmi-ing perl-EBook-EPUB (and other perl packages) on Cauldron is slow => Increase transaction size in URPMI (was: urpmi-ing perl-EBook-EPUB (and other perl packages) on Cauldron is slow )
Ever confirmed: 0 => 1
Source RPM: man-db => urpmi
Severity: normal => enhancement

Comment 6 papoteur 2017-01-10 12:51:50 CET
Hello,
I confirm that I encountered also this problem with long time needed by man-db.

CC: (none) => yves.brungard_mageia

Comment 7 Thierry Vignaud 2017-03-02 14:58:41 CET
For the record, urpmi-8.106-2.mga6 has been uploaded in cauldron's core/updates_testing on Feb 22
It increases the default transaction size from 8 to 50
Comment 8 Mageia Robot 2017-05-09 18:10:00 CEST
commit 287518ab333db89b5cf3f1821c4043f8e9f57cc2
Author: Thierry Vignaud <thierry.vignaud@...>
Date:   Wed Feb 22 16:41:05 2017 +0100

    increase transaction size from 8 to 50 (mga#18426)
    
    this increases the installation size as some file triggers are now quite
    slow (eg: man-db)
    
    previously tried in commit b6834f91d61d50c4ccfea3b5977363829ef3a1f8
---
 Commit Link:
   http://gitweb.mageia.org/software/rpm/urpmi/commit/?id=287518ab333db89b5cf3f1821c4043f8e9f57cc2
Comment 9 Marja Van Waes 2017-12-02 13:28:09 CET
The transaction size was increased to 50 in May.

@ Shlomi @ papoteur

Is the man-db issue still present? If so, could one of you strace it?

If not, then I suggest closing this report as fixed for the transaction size.
Comment 10 Shlomi Fish 2017-12-02 13:56:22 CET
(In reply to Marja van Waes from comment #9)
> The transaction size was increased to 50 in May.
> 
> @ Shlomi @ papoteur
> 
> Is the man-db issue still present? If so, could one of you strace it?
> 
> If not, then I suggest closing this report as fixed for the transaction size.

There is some delay and a report of a seg fault in col, but otherwise it is OK. Note that I recently removed many packages from my system, so it may be faster now.
Comment 11 papoteur 2017-12-02 17:50:30 CET
I didn't see this problem recently.
Comment 12 Thierry Vignaud 2018-08-01 09:45:43 CEST
Fixed in man-db-2.8.4-1.mga7

Status: NEW => RESOLVED
Resolution: (none) => FIXED

Thierry Vignaud 2018-08-01 09:46:21 CEST

Source RPM: urpmi => urpmi, man-db


Note You need to log in before you can comment on or make changes to this bug.