Bug 32316 - Arte TV in yt-dlp is broken
Summary: Arte TV in yt-dlp is broken
Status: RESOLVED FIXED
Alias: None
Product: Mageia
Classification: Unclassified
Component: RPM Packages (show other bugs)
Version: 9
Hardware: All Linux
Priority: Normal normal
Target Milestone: ---
Assignee: QA Team
QA Contact:
URL: https://github.com/yt-dlp/yt-dlp/issu...
Whiteboard: MGA8TOO MGA8-64-OK MGA9-64-OK
Keywords: advisory, validated_update
Depends on:
Blocks:
 
Reported: 2023-09-23 21:18 CEST by papoteur
Modified: 2023-10-01 13:53 CEST (History)
7 users (show)

See Also:
Source RPM: yt-dlp-2023.06.22-1.mga9.src.rpm
CVE:
Status comment:


Attachments

Description papoteur 2023-09-23 21:18:02 CEST
Description of problem:
Since recently, arteTV is broken. Reported also upstream with a fix.
https://github.com/yt-dlp/yt-dlp/issues/8156
Comment 1 Lewis Smith 2023-09-23 21:35:44 CEST
Thanks for the report.
It seems you have just committed this fixed package in Cauldron (and thank you for doing that), so I am assigning this to you initially for M9 (what about M8?)

If you want other packagers to do those, please re-assign to pkg-bugs; I am CC'ing DavidG & Stig who updated it fairly recently.

Whiteboard: (none) => MGA9TOO, MGA8TOO?
CC: (none) => geiger.david68210, smelror
URL: (none) => https://github.com/yt-dlp/yt-dlp/issues/8156
Assignee: bugsquad => yvesbrungard

Comment 2 papoteur 2023-09-23 21:39:36 CEST
Submitting a version with the latest update and the fix.
yt-dlp-2023.07.06-1.1.mga9
yt-dlp-2023.07.06-1.1.mga8
Comment 3 papoteur 2023-09-23 21:41:30 CEST
Cauldron is already updated.

Assignee: yvesbrungard => qa-bugs
Whiteboard: MGA9TOO, MGA8TOO? => MGA8TOO

Comment 4 Nicolas Nicolas 2023-09-24 10:22:05 CEST
Hello,

Just tested the testing version from M9 repo and tested against a link from arte.tv site.

It is working with the fixed version.
Comment 5 Herman Viaene 2023-09-25 14:46:11 CEST
MGA8-64 Xfce on Acer Aspire 5253
No installation issues.
reading the upstream report and the yt-dlp man page (I admit: not completely, it would require a day's study) and cobbled following command together with a not expected result:
$ yt-dlp -vU https://www.arte.tv/fr/videos/100656-011-A/state-of-the-union-saison-2-1-10/ -o artetest
[debug] Command-line config: ['-vU', 'https://www.arte.tv/fr/videos/100656-011-A/state-of-the-union-saison-2-1-10/', '-o', 'artetest']
[debug] Encodings: locale UTF-8, fs utf-8, pref UTF-8, out utf-8, error utf-8, screen utf-8
[debug] yt-dlp version stable@2023.07.06 [b532a3481]
[debug] Lazy loading extractors is disabled
[debug] Python 3.8.14 (CPython x86_64 64bit) - Linux-5.15.126-server-1.mga8-x86_64-with-glibc2.2.5 (OpenSSL 1.1.1v  1 Aug 2023, glibc 2.32)
[debug] exe versions: ffmpeg 4.3.6, ffprobe 4.3.6
[debug] Optional libraries: Cryptodome-3.9.8, brotli-1.0.9, certifi-2022.12.07, mutagen-1.45.1, sqlite3-2.6.0, websockets-8.1
[debug] Proxy map: {}
[debug] Loaded 1855 extractors
[debug] Fetching release info: https://api.github.com/repos/yt-dlp/yt-dlp/releases/latest
Available version: stable@2023.09.24, Current version: stable@2023.07.06
[debug] Downloading _update_spec from https://github.com/yt-dlp/yt-dlp/releases/latest/download/_update_spec
ERROR: You installed yt-dlp with a package manager or setup.py; Use that to update
[ArteTV] Extracting URL: https://www.arte.tv/fr/videos/100656-011-A/state-of-the-union-saison-2-1-10/
[ArteTV] 100656-011-A: Downloading JSON metadata
WARNING: [ArteTV] Skipping stream with unknown protocol API_HLS_NG
WARNING: [ArteTV] Skipping stream with unknown protocol API_HLS_NG
ERROR: [ArteTV] 100656-011-A: No video formats found!; please report this issue on  https://github.com/yt-dlp/yt-dlp/issues?q= , filling out the appropriate issue template. Confirm you are on the latest version using  yt-dlp -U

As in last sentence once again
$ yt-dlp -U
Available version: stable@2023.09.24, Current version: stable@2023.07.06
ERROR: You installed yt-dlp with a package manager or setup.py; Use that to update

Looks like the original problem.

CC: (none) => herman.viaene

Comment 6 PC LX 2023-09-27 08:04:10 CEST
Installed without issues but fails to download videos from arte.tv site.


System: Mageia 8, x86_64, Plasma DE, AMD Ryzen 5 5600G


$ uname -a
Linux jupiter 6.1.45-desktop-1.mga8 #1 SMP PREEMPT_DYNAMIC Fri Aug 11 22:01:56 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
$ rpm -q yt-dlp 
yt-dlp-2023.06.22-1.mga8
$ yt-dlp -vU https://www.arte.tv/fr/videos/100656-011-A/state-of-the-union-saison-2-1-10/
[debug] Command-line config: ['-vU', 'https://www.arte.tv/fr/videos/100656-011-A/state-of-the-union-saison-2-1-10/']
[debug] Encodings: locale UTF-8, fs utf-8, pref UTF-8, out utf-8, error utf-8, screen utf-8
[debug] yt-dlp version stable@2023.06.22 [812cdfa06]
[debug] Lazy loading extractors is disabled
[debug] Python 3.8.14 (CPython x86_64 64bit) - Linux-6.1.45-desktop-1.mga8-x86_64-with-glibc2.2.5 (OpenSSL 1.1.1v  1 Aug 2023, glibc 2.32)
[debug] exe versions: ffmpeg 4.3.6, ffprobe 4.3.6
[debug] Optional libraries: Cryptodome-3.9.8, brotli-1.0.9, certifi-2022.12.07, mutagen-1.45.1, sqlite3-2.6.0, websockets-8.1
[debug] Proxy map: {}
[debug] Loaded 1851 extractors
[debug] Fetching release info: https://api.github.com/repos/yt-dlp/yt-dlp/releases/latest
Available version: stable@2023.09.24, Current version: stable@2023.06.22
[debug] Downloading _update_spec from https://github.com/yt-dlp/yt-dlp/releases/latest/download/_update_spec
ERROR: You installed yt-dlp with a package manager or setup.py; Use that to update
[ArteTV] Extracting URL: https://www.arte.tv/fr/videos/100656-011-A/state-of-the-union-saison-2-1-10/
[ArteTV] 100656-011-A: Downloading JSON metadata
WARNING: [ArteTV] Video is geo restricted. Retrying extraction with fake IP 53.44.201.205 (DE) as X-Forwarded-For.
[ArteTV] Extracting URL: https://www.arte.tv/fr/videos/100656-011-A/state-of-the-union-saison-2-1-10/
[ArteTV] 100656-011-A: Downloading JSON metadata
WARNING: [ArteTV] Skipping stream with unknown protocol API_HLS_NG
WARNING: [ArteTV] Skipping stream with unknown protocol API_HLS_NG
ERROR: [ArteTV] 100656-011-A: No video formats found!; please report this issue on  https://github.com/yt-dlp/yt-dlp/issues?q= , filling out the appropriate issue template. Confirm you are on the latest version using  yt-dlp -U
Traceback (most recent call last):
  File "/usr/lib/python3.8/site-packages/yt_dlp/YoutubeDL.py", line 1555, in wrapper
    return func(self, *args, **kwargs)
  File "/usr/lib/python3.8/site-packages/yt_dlp/YoutubeDL.py", line 1652, in __extract_info
    return self.process_ie_result(ie_result, download, extra_info)
  File "/usr/lib/python3.8/site-packages/yt_dlp/YoutubeDL.py", line 1711, in process_ie_result
    ie_result = self.process_video_result(ie_result, download=download)
  File "/usr/lib/python3.8/site-packages/yt_dlp/YoutubeDL.py", line 2653, in process_video_result
    self.raise_no_formats(info_dict)
  File "/usr/lib/python3.8/site-packages/yt_dlp/YoutubeDL.py", line 1067, in raise_no_formats
    raise ExtractorError(msg, video_id=info['id'], ie=info['extractor'],
yt_dlp.utils.ExtractorError: [ArteTV] 100656-011-A: No video formats found!; please report this issue on  https://github.com/yt-dlp/yt-dlp/issues?q= , filling out the appropriate issue template. Confirm you are on the latest version using  yt-dlp -U

CC: (none) => mageia

Comment 7 papoteur 2023-09-27 09:35:45 CEST
Hello,
In the mean time, a new release is out with fixes we want.
Thus I submitted (building now):
- yt-dlp-2023.09.24-1.1.mga9
- yt-dlp-2023.09.24-1.1.mga8

Indeed, the patch wasn't included in mga8 package :/
Comment 8 PC LX 2023-09-27 10:23:39 CEST
Installed and tested without issues.

The yt-dlp-2023.09.24-1.1.mga8 update fixes the problem, in this system at least.



System: Mageia 8, x86_64, Plasma DE, AMD Ryzen 5 5600G



$ uname -a
Linux jupiter 6.1.45-desktop-1.mga8 #1 SMP PREEMPT_DYNAMIC Fri Aug 11 22:01:56 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
$ rpm -q yt-dlp 
yt-dlp-2023.09.24-1.1.mga8
$ yt-dlp --version
2023.09.24
$ yt-dlp -vU https://www.arte.tv/fr/videos/100656-011-A/state-of-the-union-saison-2-1-10/
[debug] Command-line config: ['-vU', 'https://www.arte.tv/fr/videos/100656-011-A/state-of-the-union-saison-2-1-10/']
[debug] Encodings: locale UTF-8, fs utf-8, pref UTF-8, out utf-8, error utf-8, screen utf-8
[debug] yt-dlp version stable@2023.09.24 [088add956]
[debug] Lazy loading extractors is disabled
[debug] Python 3.8.14 (CPython x86_64 64bit) - Linux-6.1.45-desktop-1.mga8-x86_64-with-glibc2.2.5 (OpenSSL 1.1.1v  1 Aug 2023, glibc 2.32)
[debug] exe versions: ffmpeg 4.3.6, ffprobe 4.3.6
[debug] Optional libraries: Cryptodome-3.9.8, brotli-1.0.9, certifi-2022.12.07, mutagen-1.45.1, sqlite3-3.39.2, websockets-8.1
[debug] Proxy map: {}
[debug] Loaded 1886 extractors
[debug] Fetching release info: https://api.github.com/repos/yt-dlp/yt-dlp/releases/latest
Available version: stable@2023.09.24, Current version: stable@2023.09.24
yt-dlp is up to date (stable@2023.09.24)
[ArteTV] Extracting URL: https://www.arte.tv/fr/videos/100656-011-A/state-of-the-union-saison-2-1-10/
[ArteTV] 100656-011-A: Downloading JSON metadata
WARNING: [ArteTV] Video is geo restricted. Retrying extraction with fake IP 101.101.35.6 (NC) as X-Forwarded-For.
[ArteTV] Extracting URL: https://www.arte.tv/fr/videos/100656-011-A/state-of-the-union-saison-2-1-10/
[ArteTV] 100656-011-A: Downloading JSON metadata
[ArteTV] 100656-011-A: Downloading m3u8 information
[ArteTV] 100656-011-A: Downloading m3u8 information
[debug] Formats sorted by: hasvid, ie_pref, lang, quality, res, fps, hdr:12(7), vcodec:vp9.2(10), channels, acodec, size, br, asr, proto, vext, aext, hasaud, source, id
[debug] Default format spec: bestvideo*+bestaudio/best
[info] 100656-011-A: Downloading 1 format(s): VO-STF-2127+VO-STF-program_audio_0-VO
[debug] Invoking hlsnative downloader on "https://arte-cmafhls.akamaized.net/am/cmaf-webonly/100000/100600/100656-011-A_VO-STF/230503005344/medias/100656-011-A_v1080.m3u8"
[hlsnative] Downloading m3u8 manifest
[hlsnative] Total fragments: 106
[download] Destination: State of the Union - Saison 2 (1⧸10) [100656-011-A].fVO-STF-2127.mp4
[download]  42.6% of ~ 142.36MiB at  176.00KiB/s ETA 07:55 (frag 45/106)^R
[download] 100% of  140.59MiB in 00:00:59 at 2.36MiB/s
[debug] Invoking hlsnative downloader on "https://arte-cmafhls.akamaized.net/am/cmaf-webonly/100000/100600/100656-011-A_VO-STF/230503005344/medias/100656-011-A_aud_VO-ANG_1.m3u8"
[hlsnative] Downloading m3u8 manifest
[hlsnative] Total fragments: 106
[download] Destination: State of the Union - Saison 2 (1⧸10) [100656-011-A].fVO-STF-program_audio_0-VO.mp4
[download] 100% of    9.88MiB in 00:00:26 at 383.45KiB/s
[debug] ffmpeg command line: ffprobe -show_streams 'file:State of the Union - Saison 2 (1⧸10) [100656-011-A].fVO-STF-program_audio_0-VO.mp4'
[Merger] Merging formats into "State of the Union - Saison 2 (1⧸10) [100656-011-A].mp4"
[debug] ffmpeg command line: ffmpeg -y -loglevel repeat+info -i 'file:State of the Union - Saison 2 (1⧸10) [100656-011-A].fVO-STF-2127.mp4' -i 'file:State of the Union - Saison 2 (1⧸10) [100656-011-A].fVO-STF-program_audio_0-VO.mp4' -c copy -map 0:v:0 -map 1:a:0 -bsf:a:0 aac_adtstoasc -movflags +faststart 'file:State of the Union - Saison 2 (1⧸10) [100656-011-A].temp.mp4'
Deleting original file State of the Union - Saison 2 (1⧸10) [100656-011-A].fVO-STF-2127.mp4 (pass -k to keep)
Deleting original file State of the Union - Saison 2 (1⧸10) [100656-011-A].fVO-STF-program_audio_0-VO.mp4 (pass -k to keep)
Comment 9 katnatek 2023-09-28 03:15:29 CEST
Add MG8-64-OK due comment#8

Whiteboard: MGA8TOO => MGA8TOO MGA8-64-OK

Comment 10 Thomas Andrews 2023-09-30 04:15:49 CEST
MGA9-64 Plasma, i5-2500, Intel graphics, wired Internet. No installation issues.

Tested with Clipgrab as in bug 32049 comment 4. Entered a url from Arte TV, and Clipgrab searched for a while, then crashed. Running Clipgrab from Konsole simply says "segmentation fault (Core dumped)" when it crashes.

Working OK on Youtube, however...

CC: (none) => andrewsfarm

Comment 11 Thomas Andrews 2023-09-30 04:27:15 CEST
Almost forgot...

Before the update, Clipgrab would report that there were no downloadable videos at the Arte TV urls, but it did not crash.
Comment 12 papoteur 2023-09-30 16:15:16 CEST
I don't reproduce the crash, even if I don't have success in the downloading. It takes awhile, finish, but I don't get any file.
yt-dlp works fine with the same URL got from clipgrab.
Comment 13 Thomas Andrews 2023-10-01 03:51:55 CEST
It still crashes for me, but "yt-dlp <url> does work for me, so it would appear that the fault lies within Clipgrab. That would be another bug.

Since yt-dlp does work with Arte TV from the command line, and since Clipgrab does still work with other urls like Youtube, I'll give it an OK, and validate. 

It will still need a suggested advisory.

Keywords: (none) => validated_update
Whiteboard: MGA8TOO MGA8-64-OK => MGA8TOO MGA8-64-OK MGA9-64-OK
CC: (none) => sysadmin-bugs

Comment 14 katnatek 2023-10-01 04:03:29 CEST
Check this, please, first advisory with two versions for me

Advisory:
=========
outdated yt-dlp broke compatibility with video sites this update fix the issue

Reference: https://bugs.mageia.org/show_bug.cgi?id=32316

Packages in 8/Core/Updates_testing:
======================
yt-dlp-2023.09.24-1.1.mga8

Packages in 8/Core/Updates_testing:
======================
yt-dlp-2023.09.24-1.1.mga9


From SRPMS:
yt-dlp-2023.09.24-1.1.mga8.src.rpm
yt-dlp-2023.09.24-1.1.mga9.src.rpm
Comment 15 katnatek 2023-10-01 04:04:59 CEST
same but version corrected

Advisory:
=========
outdated yt-dlp broke compatibility with video sites this update fix the issue

Reference: https://bugs.mageia.org/show_bug.cgi?id=32316

Packages in 8/Core/Updates_testing:
======================
yt-dlp-2023.09.24-1.1.mga8

Packages in 9/Core/Updates_testing:
======================
yt-dlp-2023.09.24-1.1.mga9


From SRPMS:
yt-dlp-2023.09.24-1.1.mga8.src.rpm
yt-dlp-2023.09.24-1.1.mga9.src.rpm
Marja Van Waes 2023-10-01 12:13:03 CEST

CC: (none) => marja11
Keywords: (none) => advisory

Comment 16 Mageia Robot 2023-10-01 13:53:25 CEST
An update for this issue has been pushed to the Mageia Updates repository.

https://advisories.mageia.org/MGAA-2023-0085.html

Resolution: (none) => FIXED
Status: NEW => RESOLVED


Note You need to log in before you can comment on or make changes to this bug.