Bug 29910 - [BUG]...extraction failed: curl: (22) Requested URL returned error: 404 Not found
Summary: [BUG]...extraction failed: curl: (22) Requested URL returned error: 404 Not f...
Status: RESOLVED FIXED
Alias: None
Product: Websites
Classification: Unclassified
Component: mirrors.mageia.org (show other bugs)
Version: trunk
Hardware: All Linux
Priority: Normal normal
Target Milestone: ---
Assignee: Sysadmin Team
QA Contact:
URL: http://mirror.yandex.ru/mageia/distri...
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2022-01-20 13:51 CET by Nikolay Sabelnikov
Modified: 2022-01-24 19:00 CET (History)
4 users (show)

See Also:
Source RPM:
CVE:
Status comment:


Attachments

Description Nikolay Sabelnikov 2022-01-20 13:51:17 CET
Description of problem:
root@localhost ~# urpmi.update -a
source "Core Release (distrib1)" has already been updated
    http://mirror.yandex.ru/mageia/distrib/8/x86_64/media/core/updates/media_info/20220118-191128-synthesis.hdlist.cz
updated the source "Core Updates (distrib3)"                                                                                                                                                                       
source "Nonfree Release (distrib11)" has already been updated
source "Nonfree Updates (distrib13)" has already been updated
root@localhost ~# urpmi --auto-update
the source of "Core Release (Installer)" has already been updated
the source of "Nonfree Release (Installer)" has already been updated
the source of "Core Release (distrib1)" has already been updated
    http://mirror.yandex.ru/mageia/distrib/8/x86_64/media/core/updates/media_info/20210630-234236-synthesis.hdlist.cz
updated the source "Core Updates (distrib3)"                                                                                                                                                                       
the "Nonfree Release (distrib11)" source has already been updated
    http://mirror.yandex.ru/mageia/distrib/8/x86_64/media/nonfree/updates/media_info/20210613-212153-synthesis.hdlist.cz

...extraction failed: curl: (22) The requested URL returned error: 404 Not Found
...extraction failed: curl failed: completed with 22
problem reading the synthesis file of the source "Nonfree Updates (distrib13)"
Packages are up to date
root@localhost ~#

Version-Release number of selected component (if applicable):
Operating System: Mageia 8
KDE Plasma Version: 5.20.4
KDE Frameworks Version: 5.76.0
Qt Version: 5.15.2
Kernel Version: 5.10.46-desktop-1.mga8
OS Type: 64-bit
Processors: 6 × AMD FX(tm)-6300 Six-Core Processor
Memory: 7.7 ГиБ of RAM
Graphics Processor: GeForce GT 630/PCIe/SSE2

How reproducible:


Steps to Reproduce:
the command when updating sources and updating packages.
Comment 1 Dave Hodgins 2022-01-20 23:29:52 CET
Thanks for the report, but this is not actually a problem with the Mageia
system, but is due to they way the mirror operator has chosen to handle
synchronization combined with a race condition.

In between when the urpmi.update obtained the list of available files and when
it tried to fetch the file, the file was removed (replaced with a new file
with a different name).

Mageia does not control how the mirror operators sync their mirrors. When this
does happen, just wait a few minutes and try again.

While it's a valid problem, closing the bug as invalid since it is not a bug
with the Mageia packages or infrastructure.

CC: (none) => davidwhodgins
Resolution: (none) => INVALID
Status: NEW => RESOLVED

Comment 2 Nikolay Sabelnikov 2022-01-23 20:43:15 CET
Then you need to switch the mirror, or add commands to find a more suitable and efficient mirror to the output.
Comment 3 Dave Hodgins 2022-01-23 21:17:33 CET
Given how rarely it happens, the work required to ensure this case is handled
without hiding any real problems, and how easy it is to just wait a few minutes
and try again, it's not a priority.

The mirror operators can minimize the chance of this case happening, but can not
eliminate it.

Switching to a different mirror will not eliminate the chance of this happening
again.

It happens much more often for people getting packages from the testing or
cauldron repositories where packages, not just the indexes, are replaced with
differently named files.

It's a situation that affects all file download sites that use indexes and
versions of files, not just Mageia repositories. It's something people learn to
expect to happen from time to time, and deal with appropriately.

The only way the situation can be guaranteed not to happen, is to not use any
sort of version in the file names, and to never delete files. Both things would
cause much harder to fix problems.
Comment 4 Nikolay Sabelnikov 2022-01-24 17:50:28 CET
The problem with this bug does not go away. How do I switch to another update mirror? We need a script for changing update mirrors for such cases.

Resolution: INVALID => (none)
Status: RESOLVED => REOPENED

Nikolay Sabelnikov 2022-01-24 18:04:54 CET

CC: (none) => 79625490833

Comment 5 Nikolay Sabelnikov 2022-01-24 18:27:34 CET
root@localhost ~ [1]# urpmq --list-url
Core Release (Installer) cdrom://x86_64/media/core
Nonfree Release (Installer) cdrom://x86_64/media/nonfree
Core Release (distrib1) http://mirror.yandex.ru/mageia/distrib/8/x86_64/media/core/release
Core Release Debug (distrib2) http://mirror.yandex.ru/mageia/distrib/8/x86_64/media/debug/core/release
Core Updates (distrib3) http://mirror.yandex.ru/mageia/distrib/8/x86_64/media/core/updates
Core Updates Debug (distrib4) http://mirror.yandex.ru/mageia/distrib/8/x86_64/media/debug/core/updates
Core Updates Testing (distrib5) http://mirror.yandex.ru/mageia/distrib/8/x86_64/media/core/updates_testing
Core Updates Testing Debug (distrib6) http://mirror.yandex.ru/mageia/distrib/8/x86_64/media/debug/core/updates_testing
Core Backports (distrib7) http://mirror.yandex.ru/mageia/distrib/8/x86_64/media/core/backports
Core Backports Debug (distrib8) http://mirror.yandex.ru/mageia/distrib/8/x86_64/media/debug/core/backports
Core Backports Testing (distrib9) http://mirror.yandex.ru/mageia/distrib/8/x86_64/media/core/backports_testing
Core Backports Testing Debug (distrib10) http://mirror.yandex.ru/mageia/distrib/8/x86_64/media/debug/core/backports_testing
Nonfree Release (distrib11) http://mirror.yandex.ru/mageia/distrib/8/x86_64/media/nonfree/release
Nonfree Release Debug (distrib12) http://mirror.yandex.ru/mageia/distrib/8/x86_64/media/debug/nonfree/release
Nonfree Updates (distrib13) http://mirror.yandex.ru/mageia/distrib/8/x86_64/media/nonfree/updates
Nonfree Updates Debug (distrib14) http://mirror.yandex.ru/mageia/distrib/8/x86_64/media/debug/nonfree/updates
Nonfree Updates Testing (distrib15) http://mirror.yandex.ru/mageia/distrib/8/x86_64/media/nonfree/updates_testing
Nonfree Updates Testing Debug (distrib16) http://mirror.yandex.ru/mageia/distrib/8/x86_64/media/debug/nonfree/updates_testing
Nonfree Backports (distrib17) http://mirror.yandex.ru/mageia/distrib/8/x86_64/media/nonfree/backports
Nonfree Backports Debug (distrib18) http://mirror.yandex.ru/mageia/distrib/8/x86_64/media/debug/nonfree/backports
Nonfree Backports Testing (distrib19) http://mirror.yandex.ru/mageia/distrib/8/x86_64/media/nonfree/backports_testing
Nonfree Backports Testing Debug (distrib20) http://mirror.yandex.ru/mageia/distrib/8/x86_64/media/debug/nonfree/backports_testing
Tainted Release (distrib21) http://mirror.yandex.ru/mageia/distrib/8/x86_64/media/tainted/release
Tainted Release Debug (distrib22) http://mirror.yandex.ru/mageia/distrib/8/x86_64/media/debug/tainted/release
Tainted Updates (distrib23) http://mirror.yandex.ru/mageia/distrib/8/x86_64/media/tainted/updates
Tainted Updates Debug (distrib24) http://mirror.yandex.ru/mageia/distrib/8/x86_64/media/debug/tainted/updates
Tainted Updates Testing (distrib25) http://mirror.yandex.ru/mageia/distrib/8/x86_64/media/tainted/updates_testing
Tainted Updates Testing Debug (distrib26) http://mirror.yandex.ru/mageia/distrib/8/x86_64/media/debug/tainted/updates_testing
Tainted Backports (distrib27) http://mirror.yandex.ru/mageia/distrib/8/x86_64/media/tainted/backports
Tainted Backports Debug (distrib28) http://mirror.yandex.ru/mageia/distrib/8/x86_64/media/debug/tainted/backports
Tainted Backports Testing (distrib29) http://mirror.yandex.ru/mageia/distrib/8/x86_64/media/tainted/backports_testing
Tainted Backports Testing Debug (distrib30) http://mirror.yandex.ru/mageia/distrib/8/x86_64/media/debug/tainted/backports_testing
Core 32bit Release (distrib31) http://mirror.yandex.ru/mageia/distrib/8/i586/media/core/release
Core 32bit Updates (distrib32) http://mirror.yandex.ru/mageia/distrib/8/i586/media/core/updates
Core 32bit Updates Testing (distrib33) http://mirror.yandex.ru/mageia/distrib/8/i586/media/core/updates_testing
Core 32bit Backports (distrib34) http://mirror.yandex.ru/mageia/distrib/8/i586/media/core/backports
Core 32bit Backports Testing (distrib35) http://mirror.yandex.ru/mageia/distrib/8/i586/media/core/backports_testing
Nonfree 32bit Release (distrib36) http://mirror.yandex.ru/mageia/distrib/8/i586/media/nonfree/release
Nonfree 32bit Updates (distrib37) http://mirror.yandex.ru/mageia/distrib/8/i586/media/nonfree/updates
Nonfree 32bit Updates Testing (distrib38) http://mirror.yandex.ru/mageia/distrib/8/i586/media/nonfree/updates_testing
Nonfree 32bit Backports (distrib39) http://mirror.yandex.ru/mageia/distrib/8/i586/media/nonfree/backports
Nonfree 32bit Backports Testing (distrib40) http://mirror.yandex.ru/mageia/distrib/8/i586/media/nonfree/backports_testing
Tainted 32bit Release (distrib41) http://mirror.yandex.ru/mageia/distrib/8/i586/media/tainted/release
Tainted 32bit Updates (distrib42) http://mirror.yandex.ru/mageia/distrib/8/i586/media/tainted/updates
Tainted 32bit Updates Testing (distrib43) http://mirror.yandex.ru/mageia/distrib/8/i586/media/tainted/updates_testing
Tainted 32bit Backports (distrib44) http://mirror.yandex.ru/mageia/distrib/8/i586/media/tainted/backports
Tainted 32bit Backports Testing (distrib45) http://mirror.yandex.ru/mageia/distrib/8/i586/media/tainted/backports_testing
root@localhost ~#
Comment 6 sturmvogel 2022-01-24 18:34:43 CET
How to switch to another mirror: https://wiki.mageia.org/en/Installing_and_removing_software#Setting_up_the_online_sources

Remove your old mirrors first.
Comment 7 Nikolay Sabelnikov 2022-01-24 18:41:12 CET
root@localhost ~# urpmi.removemedia -a
removed source "Core Release (Installer)"
removed source "Nonfree Release (Installer)"
removed source "Core Release (distrib1)"
removed source "Core Release Debug (distrib2)"
removed source "Core Updates (distrib3)"
removed source "Core Updates Debug (distrib4)"
removed source "Core Updates Testing (distrib5)"
removed source "Core Updates Testing Debug (distrib6)"
removed source "Core Backports (distrib7)"
removed source "Core Backports Debug (distrib8)"
removed source "Core Backports Testing (distrib9)"
removed source "Core Backports Testing Debug (distrib10)"
removed source "Nonfree Release (distrib11)"
removed source "Nonfree Release Debug (distrib12)"
removed source "Nonfree Updates (distrib13)"
removed source "Nonfree Updates Debug (distrib14)"
removed source "Nonfree Updates Testing (distrib15)"
removed source "Nonfree Updates Testing Debug (distrib16)"
removed source "Nonfree Backports (distrib17)"
removed source "Nonfree Backports Debug (distrib18)"
removed source "Nonfree Backports Testing (distrib19)"
removed source "Nonfree Backports Testing Debug (distrib20)"
removed source "Tainted Release (distrib21)"
removed source "Tainted Release Debug (distrib22)"
removed source "Tainted Updates (distrib23)"
removed source "Tainted Updates Debug (distrib24)"
removed source "Tainted Updates Testing (distrib25)"
removed source "Tainted Updates Testing Debug (distrib26)"
removed source "Tainted Backports (distrib27)"
removed source "Tainted Backports Debug (distrib28)"
removed source "Tainted Backports Testing (distrib29)"
removed source "Tainted Backports Testing Debug (distrib30)"
removed source "Core 32bit Release (distrib31)"
removed source "Core 32bit Updates (distrib32)"
removed source "Core 32bit Updates Testing (distrib33)"
removed source "Core 32bit Backports (distrib34)"
removed source "Core 32bit Backports Testing (distrib35)"
removed source "Nonfree 32bit Release (distrib36)"
removed source "Nonfree 32bit Updates (distrib37)"
removed source "Nonfree 32bit Updates Testing (distrib38)"
removed source "Nonfree 32bit Backports (distrib39)"
removed source "Nonfree 32bit Backports Testing (distrib40)"
removed source "Tainted 32bit Release (distrib41)"
removed source "Tainted 32bit Updates (distrib42)"
removed source "Tainted 32bit Updates Testing (distrib43)"
removed source "Tainted 32bit Backports (distrib44)"
removed source "Tainted 32bit Backports Testing (distrib45)"
root@localhost ~# urpmi.addmedia --distrib 'ftp://mirror.datacenter.by/pub/mirrors/mageia.org/distrib/$VERSION/$ARCH'
...extraction failed: curl failed: completed from 9

there is no access to the source with the distribution (the media.cfg file was not found)
unable to add source
root@localhost ~ [10]# urpmi.addmedia --distrib 'ftp://mirror.datacenter.by/pub/mirrors/mageia.org/distrib /$VERSION/$ARCH'
...extraction failed: curl failed: completed from 9

there is no access to the source with the distribution (the media.cfg file was not found)
it is not possible to add the source
root@localhost ~ [10]# urpmi.addmedia --distrib 'ftp://mirror .yandex.ru/mageia/distrib/$VERSION/$ARCH'
...extraction failed: curl failed: completed from 9

there is no access to the source with the distribution (the media.cfg file was not found)
it is not possible to add the source
root@localhost ~ [10]#
Comment 8 Nicolas Lécureuil 2022-01-24 18:43:12 CET
urpmi.addmedia --distrib 'ftp://mirror.datacenter.by/pub/mirrors/mageia.org/distrib/8/x86_64/'  is better $ARCH and $VERSION needs to be told.

CC: (none) => mageia

Comment 9 Nikolay Sabelnikov 2022-01-24 18:46:58 CET
(In reply to Nicolas Lécureuil from comment #8)
> urpmi.addmedia --distrib
> 'ftp://mirror.datacenter.by/pub/mirrors/mageia.org/distrib/8/x86_64/'  is
> better $ARCH and $VERSION needs to be told.
That is, specifically prescribe which version and distribution. I haven't worked with urpmi for a long time
Comment 10 Nikolay Sabelnikov 2022-01-24 19:00:06 CET
the mirror is set up, you can note that the mirror does not work on Yandex.

Resolution: (none) => FIXED
Status: REOPENED => RESOLVED


Note You need to log in before you can comment on or make changes to this bug.