Commit graph

303 commits

Author SHA1 Message Date
Remita Amine
9ba5d1f2c4 [facebook] try to reduce unessessary tahoe requests 2021-10-23 01:06:51 +02:00
Remita Amine
61022d86b9 [facebook] remove hardcoded chrome user-agent
closes #18974
closes #25411
closes #26958
closes #27329
2021-10-23 01:06:51 +02:00
Andrey Smirnoff
b0635eb9af [smotri] Remove extractor (#27358) 2021-10-23 01:06:51 +02:00
Remita Amine
d64b39da56 [beampro] Remove Extractor
closes #17290
closes #22871
closes #23020
closes #23061
closes #26099
2021-10-23 01:06:51 +02:00
EntranceJew
45ee5c8ba2 [tubitv] Extract release year (#27317) 2021-10-23 01:06:51 +02:00
Remita Amine
51433a1efa [amcnetworks] Fix free content extraction(closes #20354) 2021-10-23 01:06:51 +02:00
Remita Amine
8a311118c5 [telequebec] Fix Extraction and Add Support for video.telequebec.tv
closes #25733
closes #26883
closes #27339
2021-10-23 01:06:51 +02:00
Remita Amine
d2f6235840 [generic] comment a test covered now by AmericasTestKitchenIE 2021-10-23 01:06:51 +02:00
Remita Amine
03f1dda5da [tvplay:home] Fix extraction(closes #21153) 2021-10-23 01:06:51 +02:00
Remita Amine
aad69ec1b5 [americastestkitchen] Fix Extraction and add support for Cook's Count…
…ry and Cook's Illustrated

closes #17234
closes #27322
2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
695d097a1b [slideslive] Add support for yoda service videos and extract subtitle…
…s (closes #27323)
2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
e895ca0d9f [extractor/generic] Remove unused import 2021-10-23 01:06:51 +02:00
Remita Amine
b89074356b [aenetworks] Fix extraction
- Fix Fastly format extraction
- Add support for play and watch subdomains
- Extract series metadata

closes #23363
closes #23390
closes #26795
closes #26985
2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
a0b9b17798 [extractor/common] Extract timestamp from Last-Modified header 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
10b7025196 [generic] Extract RSS video itunes metadata 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
021738dfa7 [generic] Extract RSS video timestamp 2021-10-23 01:06:51 +02:00
renalid
d3f521bbdc [generic] Extract RSS video description (#27177) 2021-10-23 01:06:51 +02:00
Remita Amine
d6457b9613 [nrk] reduce requests for Radio series 2021-10-23 01:06:51 +02:00
Remita Amine
2120179b61 [nrk] reduce the number of instalments requests 2021-10-23 01:06:51 +02:00
Remita Amine
392743d1e4 [nrk] improve format extraction 2021-10-23 01:06:51 +02:00
Remita Amine
917f2ec68d [nrk] improve extraction
- improve format extraction for old akamai formats
- update some of the tests
- add is_live value to entry info dict
- request instalments only when their available
- fix skole extraction
2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
9c92a54488 [peertube] Extract fps 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
c23e70b2e7 [peertube] Recognize audio-only formats (closes #27295) 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
c11211efce [teachable:course] Improve extraction (closes #24507, closes #27286) 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
427dfe7ca9 [nrk] Improve error extraction 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
24342b07db [nrktv] Relax _VALID_URL 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
3d5bbf574b [nrktv:series] Improve extraction (closes #21926) 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
8b78e040c0 [nrktv:series] Improve extraction 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
d98d4ea999 [nrktv:season] Improve extraction 2021-10-23 01:06:51 +02:00
Remita Amine
3935b7503d [nrk] fix call to moved method 2021-10-23 01:06:51 +02:00
Remita Amine
c3f178555c [nrk] fix typo 2021-10-23 01:06:51 +02:00
Remita Amine
9cd7a23c87 [nrk] improve format extraction and geo-restriction detection (closes…
#24221)
2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
3012eb0bee [pornhub] Handle HTTP errors gracefully (closes #26414) 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
9647acd865 [nrktv] Relax _VALID_URL (closes #27299, closes #26185) 2021-10-23 01:06:51 +02:00
Remita Amine
5657492d8b [zdf] extract webm formats(closes #26659) 2021-10-23 01:06:51 +02:00
Matthew Rayermann
a2c136b114 [nhk] Add audio clip test to NHK extractor (#27269) 2021-10-23 01:06:51 +02:00
Remita Amine
aae5e2a9ae [gamespot] Extract DASH and HTTP formats 2021-10-23 01:06:51 +02:00
Remita Amine
f1544fba1b [extractor/commons] improve Akamai HTTP formats extraction 2021-10-23 01:06:51 +02:00
Remita Amine
3e720fb782 [tver] correct episode_number key 2021-10-23 01:06:51 +02:00
Remita Amine
b4790d23c3 [extractor/common] improve Akamai HTTP format extraction
- Allow m3u8 manifest without an additional audio format
- Fix extraction for qualities starting with a number
Solution provided by @nixxo based on: https://stackoverflow.com/a/5984688
2021-10-23 01:06:51 +02:00
Remita Amine
7eaf5dfb74 [tver] Add new extractor (closes #26662)(closes #27284) 2021-10-23 01:06:51 +02:00
Remita Amine
a542d171f2 [extractors] Add QubIE import 2021-10-23 01:06:51 +02:00
Remita Amine
25b8a45235 [tva] Add support for qub.ca (closes #27235) 2021-10-23 01:06:51 +02:00
Remita Amine
cb2a719249 [toggle] Detect DRM protected videos (closes #16479)(closes #20805) 2021-10-23 01:06:51 +02:00
Remita Amine
1016c56cd3 [toggle] Add support for new MeWatch URLs (closes #27256) 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
00fc0dea8c [cspan] Extract info from jwplayer data (closes #3672, closes #3734, …
…closes #10638, closes #13030, closes #18806, closes #23148, closes #24461, closes #26171, closes #26800, closes #27263)
2021-10-23 01:06:51 +02:00
=?UTF-8?q?Roman=20Ber=C3=A1nek?=
db8e1543b1 [cspan] Pass Referer header with format's video URL (#26032) (closes …
…#25729)
2021-10-23 01:06:51 +02:00
Remita Amine
cf0fbf895a [mediaset] add support for movie URLs(closes #27240) 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
c7c2b1d972 [yandexmusic:track] Fix extraction (closes #26449, closes #26669, clo…
…ses #26747, closes #26748, closes #26762)
2021-10-23 01:06:51 +02:00
Michael Munch
176b13bab2 [drtv] Extend _VALID_URL (#27243) 2021-10-23 01:06:51 +02:00
bopol
af3b23c63d [ina] Add support for mobile URLs (#27229) 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Adrian=20Heine=20n=C3=A9=20Lang?=
c968fd04de [videa] Adapt to updates (#26301)
closes #25973, closes #25650.
2021-10-23 01:06:51 +02:00
Remita Amine
c3d9771ac6 [spreaker] fix SpreakerShowIE test URL 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
0f12f211cf [spreaker] Add extractor (closes #13480, closes #13877) 2021-10-23 01:06:51 +02:00
Remita Amine
fd0c0b9663 [viki] fix video API request(closes #27184) 2021-10-23 01:06:51 +02:00
Remita Amine
8ebadf3f79 [bbc] fix BBC Three clip extraction 2021-10-23 01:06:51 +02:00
Remita Amine
67f2b570ef [bbc] fix BBC News videos extraction 2021-10-23 01:06:51 +02:00
Remita Amine
c7e8522059 [medaltv] improve extraction 2021-10-23 01:06:51 +02:00
Joshua Lochner
7fff37c758 [medaltv] Add new extractor (#27149) 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
8315bccf62 [nrk] Fix extraction 2021-10-23 01:06:51 +02:00
Remita Amine
84e0c2cca9 [pinterest] Add support for large collections(more than 25 pins) 2021-10-23 01:06:51 +02:00
Remita Amine
2aa4d9aab1 [franceinter] flake8 2021-10-23 01:06:51 +02:00
renalid
aa8cbb45e3 [franceinter] add thumbnail url (#27153)
Co-authored-by: remitamine <remitamine@gmail.com>
2021-10-23 01:06:51 +02:00
Remita Amine
6908e58791 [box] Add new extractor(#5949) 2021-10-23 01:06:51 +02:00
Jia Rong Yee
711ef6c996 [nytimes] Add new cooking.nytimes.com extractor (#27143)
* [nytimes] support cooking.nytimes.com, resolves #27112

Co-authored-by: remitamine <remitamine@gmail.com>
2021-10-23 01:06:51 +02:00
Remita Amine
f20b6d8dd4 [rumble] add support for embed pages(#10785) 2021-10-23 01:06:51 +02:00
Remita Amine
2fdf3447c1 [skyit] add support for multiple Sky Italia websites(closes #26629) 2021-10-23 01:06:51 +02:00
Remita Amine
1dd494ee31 [extractor/common] add generic support for akamai http format extraction 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
0ffe0d8bbd [pinterest] Add extractor (closes #25747) 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
63d1574bc8 [svtplay] Fix test title 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
c315d7caf0 [svtplay] Add support for svt.se/barnkanalen (closes #24817) 2021-10-23 01:06:51 +02:00
Mattias Wadman
b6c66dbc79 [svt] Extract timestamp and thumbnail in more cases (#27130)
Add timestamp, set to "valid from" which i think could been seen as publish time.
Add thumbnail in more cases, seems to was only done in the embedded data case for some reason.
Switch svtplay test url to an existing video and also one with no expire date.
Also add an additional thumbnail url test regex.
2021-10-23 01:06:51 +02:00
Remita Amine
4e68d816b3 [infoq] fix format extraction(closes #25984) 2021-10-23 01:06:51 +02:00
renalid
eb38071416 [francetv] Update to fix thumbnail URL issue (#27120)
Fix the thumbnail URL. The issue was here for many years, never fixed. It's done ! :-)

Example : https://www.france.tv/france-2/de-gaulle-l-eclat-et-le-secret/de-gaulle-l-eclat-et-le-secret-saison-1/2035247-solitude.html

failed thumbnail url generated : http://pluzz.francetv.fr/staticftv/ref_emissions/2020-11-02/EMI_1104da66f533cc7dc5d0d07a181a18c2e2fe1d81_20201014122553940.jpg

right thumbnail url fixed : https://sivideo.webservices.francetelevisions.fr/staticftv/ref_emissions/2020-11-02/EMI_1104da66f533cc7dc5d0d07a181a18c2e2fe1d81_20201014122553940.jpg
2021-10-23 01:06:51 +02:00
Remita Amine
bf3df2dd79 [discoverynetworks] add support new TLC/DMAX URLs(closes #27100) 2021-10-23 01:06:50 +02:00
Remita Amine
1b9cc0baff [rai] fix protocol relative relinker URLs(closes #22766) 2021-10-23 01:06:50 +02:00
Remita Amine
9c2afc03ee [rai] fix unavailable video format detection 2021-10-23 01:06:50 +02:00
Remita Amine
081b5611f1 [rai] improve extraction 2021-10-23 01:06:50 +02:00
Leonardo Taccari
1f784e32ec [rai] Fix extraction for recent raiplay.it updates (#27077)
- Remove first test of RaiPlayIE: it is no longer available
- Make RaiPlayIE extension-agnostic (passing possible `.json' URLs is now
  supported too)
- Adjust RaiPlayLiveIE to recent raiplay.it updates.  Passing it as
  `url_transparent' is no longer supported (there is no longer an accessible
  ContentItem)
- Adjust RaiPlayPlaylistIE to recent raiplay.it updates and instruct it about
  ContentSet-s.
- Update a RaiIE test and remove two tests that are no longer availables

Thanks to @remitamine for the review!
2021-10-23 01:06:50 +02:00
Remita Amine
ab19e26c5d [viki] improve format extraction 2021-10-23 01:06:50 +02:00
beefchop
7f6aa287d7 [viki] fix stream extraction from mpd (#27092)
Co-authored-by: beefchop <beefchop@users.noreply.github.com>
2021-10-23 01:06:50 +02:00
Remita Amine
0a76a87779 [amara] improve extraction 2021-10-23 01:06:50 +02:00
Joost Verdoorn
3182075ad6 [Amara] Add new extractor (#20618)
* [Amara] Add new extractor
2021-10-23 01:06:50 +02:00
Remita Amine
a9fd199643 [vimeo:album] fix extraction(closes #27079) 2021-10-23 01:06:50 +02:00
Remita Amine
dc9feaf10e [mtv] fix mgid extraction(closes #26841) 2021-10-23 01:06:50 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
4f7945880e [youporn] Fix upload date extraction and make comment count optional …
…(closes #26986)
2021-10-23 01:06:50 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
7910bb7586 [arte] Rework extractors
* Reimplement embed and playlist extractors to delegate to the single entrypoint artetv extractor
  Beware reluctant download archive extractor keys breakage.
* Improve embeds detection (closes #27057)
- Remove obsolete code
2021-10-23 01:06:50 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
60ee706bbd [arte] Extract m3u8 formats (closes #27061) 2021-10-23 01:06:50 +02:00
Remita Amine
fe97445dc3 [mgtv] fix format extraction(closes #26415) 2021-10-23 01:06:50 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
00a35be6f7 [extractor/common] Output error for invalid URLs in _is_valid_url (re…
…fs #21400, refs #24151, refs #25617, refs #25618, refs #25586, refs #26068, refs #27072)
2021-10-23 01:06:50 +02:00
Remita Amine
276aef5dde [francetv] improve info extraction 2021-10-23 01:06:50 +02:00
gdzx
c8a6cd5640 [francetv] Add fallback video url extraction (#27047)
Fallback on another API endpoint when no video formats are found.

Closes ytdl-org#22561
2021-10-23 01:06:50 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
d445ef16e7 [spiegel] Fix extraction (closes #24206, closes #24767)
Code picked from PR #24767 since original repo is not available due to takedown.
2021-10-23 01:06:50 +02:00
Remita Amine
f91186eb70 [malltv] fix extraction(closes #27035) 2021-10-23 01:06:50 +02:00
Remita Amine
d420d23ad2 [bandcamp] extract playlist_description(closes #22684) 2021-10-23 01:06:50 +02:00
Remita Amine
e23e51ca94 [urplay] fix extraction(closes #26828) 2021-10-23 01:06:50 +02:00
Remita Amine
02f491e375 [lrt] fix extraction with empty tags(closes #20264) 2021-10-23 01:06:50 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
71d074ba46 [ndr:embed:base] Extract subtitles (closes #25447, closes #26106) 2021-10-23 01:06:50 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
cb9623206e [servus] Add support for pm-wissen.com (closes #25869) 2021-10-23 01:06:50 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
4b3da7ce47 [servus] Fix extraction (closes #26872, closes #26967, closes #26983,…
closes #27000)
2021-10-23 01:06:50 +02:00