Bug 20781 - get_iplayer broken, update to latest version 3.00
Summary: get_iplayer broken, update to latest version 3.00
Status: RESOLVED FIXED
Alias: None
Product: Mageia
Classification: Unclassified
Component: RPM Packages (show other bugs)
Version: 6
Hardware: All Linux
Priority: Normal normal
Target Milestone: ---
Assignee: QA Team
QA Contact:
URL:
Whiteboard: MGA6-64-OK MGA6-32-OK
Keywords: advisory, validated_update
Depends on:
Blocks:
 
Reported: 2017-05-04 08:47 CEST by Charly Pammer
Modified: 2017-12-02 00:14 CET (History)
4 users (show)

See Also:
Source RPM: get_iplayer-2.94-1.mga5.src.rpm
CVE:
Status comment:


Attachments

Description Charly Pammer 2017-05-04 08:47:23 CEST
Current get_iplayer version 2.94 is broken as BBC changed a lot at their end. 
Attempt to download audio ends in error as BBC website cannot be queried for meta data.

Latest release 3.00 gets get_iplayer working again.

Quote from the release notes (https://github.com/get-iplayer/get_iplayer/wiki/release300):

<-- snipp -->
The BBC removed all the XML-based data sources used by get_iplayer on 2017-04-26, breaking a lot of get_iplayer functionality. That functionality has been restored, but there are changes to be aware of - get_iplayer has not survived unscathed. 
<-- snipp -->
Comment 1 Rémi Verschelde 2017-05-04 09:06:54 CEST
Assigning to all packagers as there is currently no registered maintainer for get_iplayer. Cauldron's package should also be updated.

Version: 5 => Cauldron
Assignee: bugsquad => pkg-bugs
Whiteboard: (none) => MGA5TOO

Marc Krämer 2017-11-29 10:54:15 CET

Assignee: pkg-bugs => mageia
CC: (none) => mageia

Comment 2 Marc Krämer 2017-11-29 21:13:43 CET
I have uploaded a updated package for Mageia 6.

You can test the new version by just calling
get_iplayer -f
which will update the cache. Afterwards you get the latest news by using
get_iplayer news

This will give you a list of the latest tv news.

Suggested advisory:
========================

Updated get_iplayer packages fix updated BBC website parsing problem.

========================

Updated packages in core/updates_testing:
========================
get_iplayer-3.07-1.mga6.noarch.rpm

Source RPMs: 
get_iplayer-3.07-1.mga6.src.rpm
Marc Krämer 2017-11-29 21:16:20 CET

Assignee: mageia => qa-bugs
Whiteboard: MGA5TOO => MGA5TOO MGA6TOO

Comment 3 Len Lawrence 2017-11-30 02:25:26 CET
Mageia 6 for x86_64

Had used this in the past until access to BBC programmes stopped.  Thought it was dead because the BBC seemed to want to discourage its use after adopting the nitro database format.  I shall need to resurrect and modify my old ruby interface.

Updated it to version 3.07.  Explored the man pages, which detail the many options which can be passed to the program.

$ get_iplayer --refresh
generated a new tv.cache in the directory .get_iplayer.
Column headers appear in a comment at the beginning of the file:
#index|type|name|pid|available|expires|episode|seriesnum|episodenum|versions|duration|desc|channel|categories|thumbnail|timeadded|guidance|web

A typical entry is:
49|tv|A303: Highway to the Sun|b0116ly6|2017-11-29T00:00:00+00:00|1514505600|-|||default|3600|Tom Fort whisks us through the landscape around the A303 road and 5,000 years of history.|BBC Four|||1511999490||http://www.bbc.co.uk/programmes/b0116ly6|

For recording various combinations of parameters can be used to specify a set of programmes.

Recorded the programme referenced above with the command:
$ get_iplayer --get --pid b0116ly6
<copyright notice>
Matches:
49:	A303: Highway to the Sun - -, BBC Four, b0116ly6
INFO: 1 matching programmes
WARNING: A UK TV licence is required to access BBC iPlayer TV content legally
INFO: Downloading tv: 'A303: Highway to the Sun - - (b0116ly6) [original]'
INFO: Downloaded: 1106.89 MB (00:59:03) @ 115.00 Mb/s (hlshd1) [audio+video]    
INFO: Converting to MP4
INFO: Tagging MP4

$ ls *.mp4
A303_Highway_to_the_Sun_-__b0116ly6_original.mp4

Played this file with vlc at DVD resolution.

$ get_iplayer --info --type=tv "An Island Parish"
This returned a lot of information about a series documentary including the modesizes and corresponding filesizes.

$ get_iplayer --list --type=tv "An Island Parish"
returns the value 8, the number of programmes in the series.

This is enough to demonstrate that get_iplayer is working fine for enquiries and PVR recording on 64-bit machines.

CC: (none) => tarazed25

Len Lawrence 2017-11-30 02:26:09 CET

Whiteboard: MGA5TOO MGA6TOO => MGA5TOO MGA6TOO MGA6-64-OK

Comment 4 Charly Pammer 2017-11-30 07:35:16 CET
As I filed this bug, I toyed around with the new package (on my 64bit MGA6). Looks good. get_iplayer works again now.

Thanks guys.
Comment 5 Marc Krämer 2017-11-30 11:52:55 CET
for testing please note: due to geo-blocking only radio shows can be downloaded world wide. Most tv shows are blocked outside uk.
Comment 6 Len Lawrence 2017-11-30 12:59:31 CET
Testing this in i586 virtualbox for mageia 6.

Installed version 2.94 then updated to 3.07.
Established the $HOME/.get_iplayer directory by running:
$ get_iplayer --refresh
INFO: Indexing tv programmes (concurrent)
....................................................................
INFO: Added 2984 tv programmes to cache
$ ls -l .get_iplayer
-rw-r--r-- 1 lcl lcl 733814 Nov 30 10:48 tv.cache

Extract from tv.cache:
4|tv|100 Women|b09gyqks|2017-11-24T22:00:00+00:00|1514286000|Education for Everyone|||default|1800|Divya Arya on why education in India is often regarded as more important for boys.|BBC News|||1512038923||http://www.bbc.co.uk/programmes/b09gyqks|
5|tv|3 Lle: Cyfres 2|p02b4zns|2017-11-25T16:30:00+00:00|1514219400|Eleri Siôn|||default|1800|Eleri Siôn sy'n ein tywys i dri lle o'i dewis hi heddiw. Presenter Eleri Siôn takes us ...|S4C|||1512038923||http://www.bbc.co.uk/programmes/p02b4zns|

Selected a program to be recorded:
$ get_iplayer --get --pid b09gyqks --subtitles-required
Matches:
4:	100 Women - Education for Everyone, BBC News, b09gyqks
INFO: 1 matching programmes
WARNING: A UK TV licence is required to access BBC iPlayer TV content legally
INFO: Downloading tv: '100 Women - 4. Education for Everyone (b09gyqks) [original]'
INFO: Downloaded: 489.20 MB (00:26:15) @ 144.95 Mb/s (hlshd1) [audio+video]     
INFO: Converting to MP4
INFO: Tagging MP4

This created 100_Women_-_4._Education_for_Everyone_b09gyqks_original.mp4 in the current directory ($HOME).  The file played fine with vlc.  Looking at codec details reveals that hlshd1 corresponds to DVD resolution (1280x720).

$ get_iplayer --list --type tv "Eleri Siôn"
(2)

That looks about right.

$ get_iplayer --get --type tv "Alexander and the Terrible, Horrible, No Good, Very Bad Day" --subtitles
Matches:
52:	Alexander and the Terrible, Horrible, No Good, Very Bad Day - -, BBC Two, b05t1bnt
INFO: 1 matching programmes

WARNING: No media streams found for requested programme versions and recording modes.

I guess that means the programme is no longer available.  It was found in the cache OK.

$ get_iplayer --get --type=tv "All Over the Place: Asia" --subtitles

That found 8 matches and proceeded to download them all.  Interrupted the flow after two had been filed.

INFO: Downloading tv: 'All Over the Place: Asia - 6. Hutongs, Noodles and Kabaddi (b08cblkf) [editorial]'
INFO: Downloaded: 519.68 MB (00:27:53) @ 138.58 Mb/s (hlshd1) [audio+video]     
INFO: Converting to MP4
INFO: Tagging MP4
INFO: Downloading subtitles
........................

Played the first file with vlc and enabled the subtitle track.  Working fine.

OK for 32 bits.

Whiteboard: MGA5TOO MGA6TOO MGA6-64-OK => MGA5TOO MGA6TOO MGA6-64-OK MGA6-32-OK

Comment 7 Len Lawrence 2017-11-30 15:42:08 CET
Mageia 5 :: x86_64

Installed version 2.94.  $HOME/.get_iplayer already existed.  Last time tv.cache was accessed was 2017-03-29 which fits in with the BBC's posting regarding 2017-04-26.

Attempting to refresh the cache produced lots of messages similar to
"WARNING: Failed to download programme schedule http://www.bbc.co.uk/s4c/programmes/schedules/last_week.xml"
and no hits.

Attempted to update the get_iplayer package but cannot find it and there is no mention of a build for Mageia 5 in the suggested advisory.
Comment 8 Dave Hodgins 2017-11-30 17:30:04 CET
Works on Mageia 6.

No update available to test in Mageia 5. Removing the MGA5TOO from the whiteboard
so this update can be pushed for Mageia 6. If an update for Mageia 5 is to be
done, it will have to go in a new bug report. Note Mageia 5 is only supposed
to get important security updates now, though a fix for an upstream web site
change like this would be ok.

Advisory committed to svn. Validating the update.

Whiteboard: MGA5TOO MGA6TOO MGA6-64-OK MGA6-32-OK => MGA6TOO MGA6-64-OK MGA6-32-OK
Keywords: (none) => advisory, validated_update
CC: (none) => davidwhodgins, sysadmin-bugs

Dave Hodgins 2017-11-30 19:15:22 CET

Whiteboard: MGA6TOO MGA6-64-OK MGA6-32-OK => MGA6-64-OK MGA6-32-OK
Version: Cauldron => 6

Comment 9 Mageia Robot 2017-12-02 00:14:11 CET
An update for this issue has been pushed to the Mageia Updates repository.

https://advisories.mageia.org/MGAA-2017-0119.html

Resolution: (none) => FIXED
Status: NEW => RESOLVED


Note You need to log in before you can comment on or make changes to this bug.