25845 – urpmi-proxy corrupts files after upgrading to Mageia 7 due to not setting binmode on STDOUT

Bug 25845 - urpmi-proxy corrupts files after upgrading to Mageia 7 due to not setting binmode on STDOUT

Summary: urpmi-proxy corrupts files after upgrading to Mageia 7 due to not setting bin...

Status:	RESOLVED FIXED

Alias:	None

Product:	Mageia
Classification:	Unclassified
Component:	RPM Packages (show other bugs)
Version:	7
Hardware:	All Linux

Priority:	Normal Severity: normal
Target Milestone:	---
Assignee:	Mageia tools maintainers
QA Contact:

URL:
Whiteboard:
Keywords:	Junior_job, NEEDINFO, NO_PATCH

Depends on:
Blocks:

Reported:	2019-12-08 11:10 CET by Buchan Milne
Modified:	2020-11-22 23:44 CET (History)
CC List:	5 users (show)

See Also:
Source RPM:	urpmi-proxy-0.4.0-6.mga7.src.rpm
CVE:
Status comment:

Attachments
Add an attachment (proposed patch, testcase, etc.)

Description Buchan Milne 2019-12-08 11:10:13 CET

Description of problem:

I had been using urpmi-proxy successfully on Mageia 6. While upgrading the machine running urpmi-proxy to Mageia 7, urpmi-proxy broke. This made completing the upgrade a bit inconvenient. Nevertheless, eventually I managed to track the problem down.

When retrieving a synthesis.hdlist.cz, the md5sum would be incorrect when retrieved via urpmi-proxy, but not when retrieving it directly:

retrieval of [http://media/mageia/distrib/7/x86_64/media/core/updates/media_info/synthesis.hdlist.cz] failed (md5sum mismatch)

If disabling md5sums, the media could not be used (urpmi would complain about invalid characters).

The httpd error_log showed e.g. (first occurance):
[Sat Dec 07 15:14:12.918820 2019] [cgi:error] [pid 2489] [client 192.168.2.1:55528] AH01215: "\\x{00ed}" does not map to ascii at /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi line 527.: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi

perl-base (along with a few other core perl modules) was upgraded at:
perl-base-5.28.2-1.mga7.x86_64                Sat 07 Dec 2019 15:10:03 SAST


Adding the following line to /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi (before the current line 490 where it prints to STDOUT), resolves the issue:

        binmode STDOUT;


Version-Release number of selected component (if applicable):


How reproducible:
Every time (for me)


Steps to Reproduce:
1. Install urpmi-proxy
2. Point urpmi at it (urpmi.addmedia --distrib http://localhost/mageia/distrib/7/x86_64 or similar)

urpmi should complain about invalid md5sums for synthesis hdlists.

Comment 1 Lewis Smith 2019-12-08 12:42:13 CET

Thank you for this detailed and helpful report - especially the detective work.

This package has no registered maintainer, assigning to tools group.

Assignee: bugsquad => mageiatools

Thierry Vignaud 2019-12-09 11:40:40 CET

CC: (none) => alien

Comment 2 Hoyt Duff 2019-12-29 19:35:12 CET

I am experiencing a somewhat similar problem as detailed in 
https://forums.mageia.org/en/viewtopic.php?f=8&t=13248
and am glad to provide any additional information requested.

CC: (none) => hoyt

Comment 3 Thierry Vignaud 2019-12-30 03:38:55 CET

Buchan, can you attach a proper patch?
(or even commit it directly into http://gitweb.mageia.org/software/rpm/urpmi-proxy/)

Keywords: (none) => Junior_job, NEEDINFO, NO_PATCH
CC: (none) => thierry.vignaud

Comment 4 Hoyt Duff 2020-01-02 23:33:33 CET

I solved my issue, but am experiencing the same issue as above, even after applying the patch.

retrieving   media_info/MD5SUM
'/usr/bin/curl' '-q' '-s' '--location-trusted' '-R' '-f' '--disable-epsv' '--connect-timeout' '60' '--anyauth' '--stderr' '-' '-O' 'http://192.168.1.5/mageia/distrib/7.1/x86_64/media/core/release/media_info/MD5SUM'
retrieved   media_info/MD5SUM
comparing /var/cache/urpmi/partial/MD5SUM and /var/lib/urpmi/Core Release/MD5SUM
retrieving source synthesis of "Core Release"...
retrieving   media_info/20190627-235351-synthesis.hdlist.cz
'/usr/bin/curl' '-q' '--location-trusted' '-R' '-f' '--disable-epsv' '--connect-timeout' '60' '--anyauth' '--stderr' '-' '-O' 'http://192.168.1.5/mageia/distrib/7.1/x86_64/media/core/release/media_info/20190627-235351-synthesis.hdlist.cz'
    http://192.168.1.5/mageia/distrib/7.1/x86_64/media/core/release/media_info/20190627-235351-synthesis.hdlist.cz
        76% of 2233k completed, ETA = 0:00:02, speed = 318k                 retrieved   media_info/20190627-235351-synthesis.hdlist.cz                       
computing md5sum of retrieved source synthesis
retrieval of [http://192.168.1.5/mageia/distrib/7.1/x86_64/media/core/release/media_info/synthesis.hdlist.cz] failed (md5sum mismatch)                       
problem reading synthesis file of medium "Core Release"
unlocking urpmi database
EXITING (pid=11471)

Comment 5 AL13N 2020-01-06 09:31:31 CET

I've added a binmode on STDOUT and some changes i had running locally to 0.5.0 and committed and submitted it to cauldron.

If that all works fine i'll backport to 7.

Thanks for all the help, i've not been much active; but it's great to know that people actually use my program (even if it is a bit hack-ish)

Comment 6 Hoyt Duff 2020-01-07 02:33:36 CET

Just to re-state. The fix above does not work for me.

Comment 7 Hoyt Duff 2020-01-07 03:11:39 CET

I downloaded and installed the update from cauldron and this is the error message I now receive with 
#source 'http://mirror.math.princeton.edu/pub/mageia'


$sudo urpmi.addmedia  --debug  --distrib  Mageia7 http://192.168.1.200/mageia/distrib/7/x86_64
getting exclusive lock on urpmi
parsing: /etc/urpmi/mediacfg.d/Devel-7-x86_64
parsing: /etc/urpmi/mediacfg.d/Official-7-x86_64
retrieving media.cfg file...
retrieving   media/media_info/media.cfg
'/usr/bin/curl' '-q' '-s' '--location-trusted' '-R' '-f' '--disable-epsv' '--connect-timeout' '60' '--anyauth' '--stderr' '-' '-O' 'http://192.168.1.200/mageia/distrib/7/x86_64/media/media_info/media.cfg'
error: curl failed: exited with 22

...retrieving failed: curl failed: exited with 22

unable to access the distribution medium (no media.cfg file found)
unable to add medium
unlocking urpmi database
EXITING (pid=27859)

Comment 8 AL13N 2020-01-07 10:36:04 CET

are you sure the "source" was uncommented?

also, maybe you have a broken already downloaded file, maybe you can manually remove the file that has issues and then retry the transfer?

also, there's a logfile and if you enable debug you can see more stuff in the apache error logs

Comment 9 Hoyt Duff 2020-01-07 15:11:50 CET

"source" is uncommented.

There are no downloaded files that I could find.

The httpd error log reveals:

Tue Jan 07 09:02:08.203129 2020] [cgi:error] [pid 9789] [client 192.168.1.5:47466] AH01215: "\\x{00eb}" does not map to ascii at /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi line 528.: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi

This is using the urpmi-proxy.cgi from urpmi-proxy-0.5.0-1.mga8.noarch.rpm.

I had to force the installation because it asked for a version of perl-base that Mageia7 does not yet provide.  

# urpmi /home/hoyt/urpmi-proxy-0.5.0-1.mga8.noarch.rpm 
A requested package cannot be installed:
urpmi-proxy-0.5.0-1.mga8.noarch (due to unsatisfied perl-base[>= 2:5.30.1])
Continue installation anyway? (Y/n) 

What I have installed is v5.28.2.

Comment 10 AL13N 2020-01-08 09:44:58 CET

the warning about that char is not a big problem.

the newer perl-base is because this is compiled for cauldron, so no big issue there eiter.

have you found the logfile for the requests? it should give HIT or MISS or FAIL for each file requested.

and the httpd error log only contains useful stuff after enabling debug in the config.

Matteo Pasotti 2020-01-15 17:01:21 CET

CC: (none) => matteo.pasotti

Comment 11 Hoyt Duff 2020-02-15 00:48:42 CET

My apologies for the delay in replying. I had some unanticipated heart surgery and am glad to report that I am all better now.

Here is the error log for httpd:
[Fri Feb 14 18:32:35.499416 2020] [mpm_prefork:notice] [pid 6558] AH00170: caught SIGWINCH, shutting down gracefully
[Fri Feb 14 18:32:36.550839 2020] [mpm_prefork:notice] [pid 7040] AH00163: Apache/2.4.41 (Unix) configured -- resuming normal operations
[Fri Feb 14 18:32:36.550936 2020] [mpm_prefork:info] [pid 7040] AH00164: Server built: Dec 25 2019 17:16:14
[Fri Feb 14 18:32:36.550947 2020] [core:notice] [pid 7040] AH00094: Command line: '/usr/sbin/httpd -D FOREGROUND'
[Fri Feb 14 18:32:36.550951 2020] [core:debug] [pid 7040] log.c(1571): AH02639: Using SO_REUSEPORT: yes (1)
[Fri Feb 14 18:32:36.550957 2020] [mpm_prefork:debug] [pid 7040] prefork.c(919): AH00165: Accept mutex: none (default: pthread)
[Fri Feb 14 18:33:55.241361 2020] [authz_core:debug] [pid 7045] mod_authz_core.c(820): [client 192.168.1.4:33892] AH01626: authorization result of Require all granted: granted
[Fri Feb 14 18:33:55.241460 2020] [authz_core:debug] [pid 7045] mod_authz_core.c(820): [client 192.168.1.4:33892] AH01626: authorization result of <RequireAny>: granted
[Fri Feb 14 18:33:55.241686 2020] [authz_core:debug] [pid 7045] mod_authz_core.c(820): [client 192.168.1.4:33892] AH01626: authorization result of Require all granted: granted
[Fri Feb 14 18:33:55.241699 2020] [authz_core:debug] [pid 7045] mod_authz_core.c(820): [client 192.168.1.4:33892] AH01626: authorization result of <RequireAny>: granted
[Fri Feb 14 18:33:55.324915 2020] [cgi:error] [pid 7045] [client 192.168.1.4:33892] AH01215: Subroutine getcwd redefined at /usr/share/perl5/vendor_perl/urpm/download.pm line 13.: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:55.354250 2020] [cgi:error] [pid 7045] [client 192.168.1.4:33892] AH01215: logfile: /var/log/urpmi-proxy.log: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:55.354288 2020] [cgi:error] [pid 7045] [client 192.168.1.4:33892] AH01215: orig sources: 1: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:55.354309 2020] [cgi:error] [pid 7045] [client 192.168.1.4:33892] AH01215:  - http://mirror.dacentec.com/mageia/: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:55.654895 2020] [cgi:error] [pid 7045] [client 192.168.1.4:33892] AH01215: file: /distrib/7/x86_64/media/media_info/media.cfg: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:55.654948 2020] [cgi:error] [pid 7045] [client 192.168.1.4:33892] AH01215: dest_path: /distrib/7/x86_64/media/media_info: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:55.654965 2020] [cgi:error] [pid 7045] [client 192.168.1.4:33892] AH01215: filename: media.cfg: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:55.654978 2020] [cgi:error] [pid 7045] [client 192.168.1.4:33892] AH01215: check_file: 1: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:55.654989 2020] [cgi:error] [pid 7045] [client 192.168.1.4:33892] AH01215: merge: 0: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:55.655007 2020] [cgi:error] [pid 7045] [client 192.168.1.4:33892] AH01215: timestamp: 1561159098: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:55.655018 2020] [cgi:error] [pid 7045] [client 192.168.1.4:33892] AH01215: sources: 1: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:55.655043 2020] [cgi:error] [pid 7045] [client 192.168.1.4:33892] AH01215:  - http://mirror.dacentec.com/mageia/: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:55.655061 2020] [cgi:error] [pid 7045] [client 192.168.1.4:33892] AH01215: interpolated sources: 1: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:55.655086 2020] [cgi:error] [pid 7045] [client 192.168.1.4:33892] AH01215:  - http://mirror.dacentec.com/mageia/: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:55.655119 2020] [cgi:error] [pid 7045] [client 192.168.1.4:33892] AH01215: source of type http: 'http://mirror.dacentec.com/mageia/': /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:55.655188 2020] [cgi:error] [pid 7045] [client 192.168.1.4:33892] AH01215: curl fetch url 'http://mirror.dacentec.com/mageia//distrib/7/x86_64/media/media_info/media.cfg': /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:55.655254 2020] [cgi:error] [pid 7045] [client 192.168.1.4:33892] AH01215: curl return value: 200: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:55.655272 2020] [cgi:error] [pid 7045] [client 192.168.1.4:33892] AH01215: condition unmet: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:55.655285 2020] [cgi:error] [pid 7045] [client 192.168.1.4:33892] AH01215: file_sent: 0: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:55.668444 2020] [cgi:error] [pid 7045] [client 192.168.1.4:33892] AH01215: HTTP header: 200 OK: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:55.668485 2020] [cgi:error] [pid 7045] [client 192.168.1.4:33892] AH01215: Content-Type: 'text/plain': /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:55.668501 2020] [cgi:error] [pid 7045] [client 192.168.1.4:33892] AH01215: Content-Length: 10270: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:55.668516 2020] [cgi:error] [pid 7045] [client 192.168.1.4:33892] AH01215: Last-Modified: Fri Jun 21 19:18:18 2019: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:56.407219 2020] [authz_core:debug] [pid 7044] mod_authz_core.c(820): [client 192.168.1.4:33894] AH01626: authorization result of Require all granted: granted
[Fri Feb 14 18:33:56.407326 2020] [authz_core:debug] [pid 7044] mod_authz_core.c(820): [client 192.168.1.4:33894] AH01626: authorization result of <RequireAny>: granted
[Fri Feb 14 18:33:56.407537 2020] [authz_core:debug] [pid 7044] mod_authz_core.c(820): [client 192.168.1.4:33894] AH01626: authorization result of Require all granted: granted
[Fri Feb 14 18:33:56.407549 2020] [authz_core:debug] [pid 7044] mod_authz_core.c(820): [client 192.168.1.4:33894] AH01626: authorization result of <RequireAny>: granted
[Fri Feb 14 18:33:56.490935 2020] [cgi:error] [pid 7044] [client 192.168.1.4:33894] AH01215: Subroutine getcwd redefined at /usr/share/perl5/vendor_perl/urpm/download.pm line 13.: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:56.517599 2020] [cgi:error] [pid 7044] [client 192.168.1.4:33894] AH01215: logfile: /var/log/urpmi-proxy.log: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:56.517635 2020] [cgi:error] [pid 7044] [client 192.168.1.4:33894] AH01215: orig sources: 1: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:56.517650 2020] [cgi:error] [pid 7044] [client 192.168.1.4:33894] AH01215:  - http://mirror.dacentec.com/mageia/: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:56.753501 2020] [cgi:error] [pid 7044] [client 192.168.1.4:33894] AH01215: file: /distrib/7/x86_64/media/core/release/media_info/MD5SUM: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:56.753565 2020] [cgi:error] [pid 7044] [client 192.168.1.4:33894] AH01215: dest_path: /distrib/7/x86_64/media/core/release/media_info: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:56.753584 2020] [cgi:error] [pid 7044] [client 192.168.1.4:33894] AH01215: filename: MD5SUM: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:56.753600 2020] [cgi:error] [pid 7044] [client 192.168.1.4:33894] AH01215: check_file: 1: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:56.753613 2020] [cgi:error] [pid 7044] [client 192.168.1.4:33894] AH01215: merge: 0: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:56.753633 2020] [cgi:error] [pid 7044] [client 192.168.1.4:33894] AH01215: timestamp: 1561679633: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:56.753648 2020] [cgi:error] [pid 7044] [client 192.168.1.4:33894] AH01215: sources: 1: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:56.753678 2020] [cgi:error] [pid 7044] [client 192.168.1.4:33894] AH01215:  - http://mirror.dacentec.com/mageia/: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:56.753717 2020] [cgi:error] [pid 7044] [client 192.168.1.4:33894] AH01215: interpolated sources: 1: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:56.753748 2020] [cgi:error] [pid 7044] [client 192.168.1.4:33894] AH01215:  - http://mirror.dacentec.com/mageia/: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:56.753789 2020] [cgi:error] [pid 7044] [client 192.168.1.4:33894] AH01215: source of type http: 'http://mirror.dacentec.com/mageia/': /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:56.753858 2020] [cgi:error] [pid 7044] [client 192.168.1.4:33894] AH01215: curl fetch url 'http://mirror.dacentec.com/mageia//distrib/7/x86_64/media/core/release/media_info/MD5SUM': /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:56.753878 2020] [cgi:error] [pid 7044] [client 192.168.1.4:33894] AH01215: curl return value: 200: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:56.753895 2020] [cgi:error] [pid 7044] [client 192.168.1.4:33894] AH01215: condition unmet: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:56.753911 2020] [cgi:error] [pid 7044] [client 192.168.1.4:33894] AH01215: file_sent: 0: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:56.763419 2020] [cgi:error] [pid 7044] [client 192.168.1.4:33894] AH01215: HTTP header: 200 OK: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:56.763456 2020] [cgi:error] [pid 7044] [client 192.168.1.4:33894] AH01215: Content-Type: 'text/plain': /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:56.763467 2020] [cgi:error] [pid 7044] [client 192.168.1.4:33894] AH01215: Content-Length: 576: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:56.763484 2020] [cgi:error] [pid 7044] [client 192.168.1.4:33894] AH01215: Last-Modified: Thu Jun 27 19:53:53 2019: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:56.778498 2020] [authz_core:debug] [pid 7043] mod_authz_core.c(820): [client 192.168.1.4:33896] AH01626: authorization result of Require all granted: granted
[Fri Feb 14 18:33:56.778590 2020] [authz_core:debug] [pid 7043] mod_authz_core.c(820): [client 192.168.1.4:33896] AH01626: authorization result of <RequireAny>: granted
[Fri Feb 14 18:33:56.778799 2020] [authz_core:debug] [pid 7043] mod_authz_core.c(820): [client 192.168.1.4:33896] AH01626: authorization result of Require all granted: granted
[Fri Feb 14 18:33:56.778812 2020] [authz_core:debug] [pid 7043] mod_authz_core.c(820): [client 192.168.1.4:33896] AH01626: authorization result of <RequireAny>: granted
[Fri Feb 14 18:33:56.863783 2020] [cgi:error] [pid 7043] [client 192.168.1.4:33896] AH01215: Subroutine getcwd redefined at /usr/share/perl5/vendor_perl/urpm/download.pm line 13.: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:56.889515 2020] [cgi:error] [pid 7043] [client 192.168.1.4:33896] AH01215: logfile: /var/log/urpmi-proxy.log: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:56.889551 2020] [cgi:error] [pid 7043] [client 192.168.1.4:33896] AH01215: orig sources: 1: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:56.889566 2020] [cgi:error] [pid 7043] [client 192.168.1.4:33896] AH01215:  - http://mirror.dacentec.com/mageia/: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:57.156172 2020] [cgi:error] [pid 7043] [client 192.168.1.4:33896] AH01215: file: /distrib/7/x86_64/media/core/release/media_info/20190627-235351-synthesis.hdlist.cz: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:57.156250 2020] [cgi:error] [pid 7043] [client 192.168.1.4:33896] AH01215: dest_path: /distrib/7/x86_64/media/core/release/media_info: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:57.156283 2020] [cgi:error] [pid 7043] [client 192.168.1.4:33896] AH01215: filename: 20190627-235351-synthesis.hdlist.cz: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:57.156297 2020] [cgi:error] [pid 7043] [client 192.168.1.4:33896] AH01215: check_file: 1: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:57.156325 2020] [cgi:error] [pid 7043] [client 192.168.1.4:33896] AH01215: merge: 0: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:57.156339 2020] [cgi:error] [pid 7043] [client 192.168.1.4:33896] AH01215: sources: 1: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:57.156365 2020] [cgi:error] [pid 7043] [client 192.168.1.4:33896] AH01215:  - http://mirror.dacentec.com/mageia/: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:57.156385 2020] [cgi:error] [pid 7043] [client 192.168.1.4:33896] AH01215: interpolated sources: 1: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:57.156413 2020] [cgi:error] [pid 7043] [client 192.168.1.4:33896] AH01215:  - http://mirror.dacentec.com/mageia/: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:57.156453 2020] [cgi:error] [pid 7043] [client 192.168.1.4:33896] AH01215: source of type http: 'http://mirror.dacentec.com/mageia/': /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:57.156532 2020] [cgi:error] [pid 7043] [client 192.168.1.4:33896] AH01215: curl fetch url 'http://mirror.dacentec.com/mageia//distrib/7/x86_64/media/core/release/media_info/20190627-235351-synthesis.hdlist.cz': /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:57.156563 2020] [cgi:error] [pid 7043] [client 192.168.1.4:33896] AH01215: [1581723237,151187]: write(1033,0,4096,0): /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:57.156595 2020] [cgi:error] [pid 7043] [client 192.168.1.4:33896] AH01215: [1581723237,152678]: write(1369,1033,4096,0): /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:57.156626 2020] [cgi:error] [pid 7043] [client 192.168.1.4:33896] AH01215: [1581723237,154322]: write(1369,2402,4096,0): /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:57.156658 2020] [cgi:error] [pid 7043] [client 192.168.1.4:33896] AH01215: [1581723237,155917]: write(1369,3771,4096,0): /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:57.156684 2020] [cgi:error] [pid 7043] [client 192.168.1.4:33896] AH01215: [1581723237,155932]: write: flush: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:57.156700 2020] [cgi:error] [pid 7043] [client 192.168.1.4:33896] AH01215: flushing buffer: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:57.156716 2020] [cgi:error] [pid 7043] [client 192.168.1.4:33896] AH01215: HTTP header: 200: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:57.156731 2020] [cgi:error] [pid 7043] [client 192.168.1.4:33896] AH01215: Content-Type: : /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:57.156749 2020] [cgi:error] [pid 7043] [client 192.168.1.4:33896] AH01215: Content-Length: -1: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:57.156806 2020] [cgi:error] [pid 7043] [client 192.168.1.4:33896] AH01215: "\\x{00fd}" does not map to ascii at /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi line 450.: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:57.156864 2020] [cgi:error] [pid 7043] [client 192.168.1.4:33896] AH01215: "\\x{00e6}" does not map to ascii at /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi line 450.: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:57.156921 2020] [cgi:error] [pid 7043] [client 192.168.1.4:33896] AH01215: "\\x{00d6}" does not map to ascii at /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi line 450.: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:57.156979 2020] [cgi:error] [pid 7043] [client 192.168.1.4:33896] AH01215: "\\x{00b4}" does not map to ascii at /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi line 450.: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:57.157037 2020] [cgi:error] [pid 7043] [client 192.168.1.4:33896] AH01215: "\\x{00e7}" does not map to ascii at /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi line 450.: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:57.157093 2020] [cgi:error] [pid 7043] [client 192.168.1.4:33896] AH01215: "\\x{00ef}" does not map to ascii at /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi line 450.: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:57.157164 2020] [cgi:error] [pid 7043] [client 192.168.1.4:33896] AH01215: "\\x{00ff}" does not map to ascii at /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi line 450.: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:57.157223 2020] [cgi:error] [pid 7043] [client 192.168.1.4:33896] AH01215: "\\x{00b9}" does not map to ascii at /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi line 450.: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:57.157280 2020] [cgi:error] [pid 7043] [client 192.168.1.4:33896] AH01215: "\\x{0085}" does not map to ascii at /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi line 450.: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:57.157336 2020] [cgi:error] [pid 7043] [client 192.168.1.4:33896] AH01215: "\\x{00fd}" does not map to ascii at /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi line 450.: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:57.157396 2020] [cgi:error] [pid 7043] [client 192.168.1.4:33896] AH01215: "\\x{0098}" does not map to ascii at /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi line 450.: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:57.157453 2020] [cgi:error] [pid 7043] [client 192.168.1.4:33896] AH01215: "\\x{00d6}" does not map to ascii at /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi line 450.: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:57.157514 2020] [cgi:error] [pid 7043] [client 192.168.1.4:33896] AH01215: "\\x{00d5}" does not map to ascii at /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi line 450.: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:57.157573 2020] [cgi:error] [pid 7043] [client 192.168.1.4:33896] AH01215: "\\x{00c7}" does not map to ascii at /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi line 450.: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:57.157631 2020] [cgi:error] [pid 7043] [client 192.168.1.4:33896] AH01215: "\\x{008b}" does not map to ascii at /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi line 450.: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:57.157687 2020] [cgi:error] [pid 7043] [client 192.168.1.4:33896] AH01215: "\\x{00ca}" does not map to ascii at /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi line 450.: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:57.157744 2020] [cgi:error] [pid 7043] [client 192.168.1.4:33896] AH01215: "\\x{00f5}" does not map to ascii at /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi line 450.: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi
[Fri Feb 14 18:33:57.157801 2020] [cgi:error] [pid 7043] [client 192.168.1.4:33896] AH01215: "\\x{00ba}" does not map to ascii at /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi line 450.: /usr/share/urpmi-proxy/cgi-bin/urpmi-proxy.cgi

The last error messages continue on for some length.

/var/log/urpmi-proxy.log shows only

[Fri Feb 14 18:33:55 EST 2020] 192.168.1.4 200 10270 HIT_UNMODIFIED '/distrib/7/x86_64/media/media_info/media.cfg' 'curl/7.66.0'
[Fri Feb 14 18:33:56 EST 2020] 192.168.1.4 200 576 HIT_UNMODIFIED '/distrib/7/x86_64/media/core/release/media_info/MD5SUM' 'curl/7.66.0'
[Fri Feb 14 18:34:29 EST 2020] 192.168.1.4 200 2287452 MISS '/distrib/7/x86_64/media/core/release/media_info/20190627-235351-synthesis.hdlist.cz' 'curl/7.66.0
'
And the error message on the client shows
$ sudo urpmi.addmedia --distrib http://192.168.1.5/mageia/distrib/7/x86_64
adding medium "Core Release"
 . . .
adding medium "Tainted 32bit Backports Testing" (ignored by default)
    http://192.168.1.5/mageia/distrib/7/x86_64/media/core/release/media_info/20190627-235351-synthesis.hdlist.cz
retrieval of [http://192.168.1.5/mageia/distrib/7/x86_64/media/core/release/media_info/synthesis.hdlist.cz] failed (md5sum mismatch)
problem reading synthesis file of medium "Core Release"

Comment 12 Dave Hodgins 2020-02-15 02:50:56 CET

Just a guess. Try editing /etc/urpmi.urpmi.cfg and adding a line after the
first line, such that the first three lines end up being ...
{
  downloader: wget
}

If you prefer not to manually edit the file, the same result can also be done
using mcc, Configure media ..., Options, Global options, and then using
the dropdown button for the Download program to use, to select wget.

CC: (none) => davidwhodgins

Comment 13 AL13N 2020-02-15 10:51:18 CET

Ok, at fosdem, i sat with Matteo and fixed the issue in 0.5.1 .

unfortunately, i didn't backport this into mga7 yet.

after installing 0.5.1 ; you should remove all your MD5SUM files in your caches and do an urpmi.update -a ; after that, things should work again...

Comment 14 Hoyt Duff 2020-02-15 17:16:43 CET

I still get this.

retrieval of [http://192.168.1.5/mageia/distrib/7.1/x86_64/media/core/release/media_info/synthesis.hdlist.cz] failed (md5sum mismatch)
problem reading synthesis file of medium "Core Release"

Comment 15 AL13N 2020-02-15 23:38:37 CET

did you remove all your md5sum files? try also to remove the synthesis file from urpmi cache (the one you're downloading).

if that fails, check if the relevant md5sum matches the upstream version...

Comment 16 Hoyt Duff 2020-02-16 20:55:28 CET

Same results. I'm giving up. Thanks for your help.

Comment 17 AL13N 2020-02-17 18:02:26 CET

did you check if the md5sum matches the one from upstream?

also, i meant removing the synthesis file from the regular urpmi cache, not urpmi proxy cache.

I had most of the trouble with rpm files not really the synthesis, and removing the md5sum (after updating to 0.5.1) and doing urpmi.update -a worked for me

Comment 18 Hoyt Duff 2020-11-22 21:43:37 CET

I just circled back around to this issue and whatever problem I was having seems to be fixed and the application works as advertised. This bug can be closed. Thank you for your help.

Comment 19 Dave Hodgins 2020-11-22 23:44:18 CET

Closing as per comment 18

Resolution: (none) => FIXED
Status: NEW => RESOLVED

Note You need to log in before you can comment on or make changes to this bug.