Commit graph

541 commits

Author SHA1 Message Date
Remita Amine
02b371b81e [threeqsdn] Improve extraction(closes #21058) 2021-02-26 16:11:08 +01:00
0l-l0
5e672bbd59 [peertube] Extract files also from streamingPlaylists (#27728)
JSON objects with an empty "files" tag seem to be a valid PeerTube API
response. In those cases the "files" arrays contained in the
"streamingPlaylists" members can be used instead.
closes #26002
closes #27586
2021-02-26 16:10:59 +01:00
Remita Amine
716a12bbe7 [khanacademy] fix extraction(closes #2887)(closes #26803) 2021-02-26 16:10:53 +01:00
Remita Amine
533f1a3d59 [spike] Update Paramount Network feed URL(closes #27715) 2021-02-26 16:10:48 +01:00
nixxo
3311732cc4 [rai] improve subtitles extraction (#27705)
closes #27698
2021-02-26 16:10:40 +01:00
Remita Amine
d445754878 [canvas] Match only supported VRT NU URLs(#27707) 2021-02-26 16:10:31 +01:00
Remita Amine
c20b7305d7 [extractors] add BibelTVIE import 2021-02-26 16:10:26 +01:00
Remita Amine
d09dc9da38 [bibeltv] Add new extractor(closes #14361) 2021-02-26 16:10:21 +01:00
Remita Amine
ba94de7b0d [bfmtv] Add new extractor(closes #16053)(closes #26615) 2021-02-26 16:10:17 +01:00
Remita Amine
b1b5f6effe [sbs] Add support for ondemand play and news embed URLs(closes #17650…
…)(closes #27629)
2021-02-26 16:10:13 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
c80f8c2006 [twitch] Refactor 2021-02-26 16:10:08 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
d83dfdc63a [twitch] Drop legacy kraken API v5 code altogether 2021-02-26 16:10:04 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
ff8d551021 [twitch:vod] Switch to GraphQL for video metadata 2021-02-26 16:10:00 +01:00
Remita Amine
ff330d9727 [canvas] Fix VRT NU extraction(closes #26957)(closes #27053) 2021-02-26 16:09:56 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
189885594b [twitch] Improve access token extraction and remove unused code (clos…
…es #27646)
2021-02-26 16:09:51 +01:00
23rd
948dc5834d [twitch] Switch access token to GraphQL and refactor. 2021-02-26 16:09:46 +01:00
nixxo
24f5760134 [rai] Detect ContentItem in iframe (closes #12652) (#27673)
Co-authored-by: Sergey M. <dstftw@gmail.com>
2021-02-26 16:09:42 +01:00
Remita Amine
eb001126da [ketnet] fix extraction(closes #27662) 2021-02-26 16:09:38 +01:00
Remita Amine
7f4e988520 [dplay] Add suport Discovery+ domains(closes #27680) 2021-02-26 16:09:33 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
e94762a1a7 [motherless] Fix review issues and improve extraction (closes #26495,…
closes #27450)
2021-02-26 16:09:21 +01:00
cladmi
a72df1d249 [motherless] Fix recent videos upload date extraction (closes #27661)
Less than a week old videos use a '20h ago' or '1d ago' format.

I kept the support for 'Ago' with uppercase start at is was already in the code.
2021-02-26 16:09:15 +01:00
Kevin O'Connor
903c90bd4c [downloader/hls] Disable decryption in tests (#27660)
Tests truncate the download to 10241 bytes, which is not divisible by 16
and cannot be decrypted. Tests don't really care about the decrypted
content, just that the data they retrieved is the expected data.
Therefore, it's fine to just return the encrypted data to tests.

See: #27621 and #27620
2021-02-26 16:08:56 +01:00
Yurii H
055e9eb904 [iheart] Update test description value (#27037)
the description has no HTML tags now.
2021-02-26 16:08:50 +01:00
Remita Amine
25dff12eb1 [nrk] fix extraction for videos without a legalAge rating 2021-02-26 16:08:44 +01:00
Remita Amine
67ff5da6ea [iheart] clean HTML tags from episode description 2021-02-26 16:08:39 +01:00
Remita Amine
8818f177ab [iheart] remove print statement 2021-02-26 16:08:34 +01:00
Remita Amine
1dc43fd3fc [googleplus] Remove Extractor(closes #4955)(closes #7400) 2021-02-26 16:08:27 +01:00
Remita Amine
607b324dff [applepodcasts] Add new extractor(#25918) 2021-02-26 16:08:20 +01:00
Remita Amine
1b1752a1b5 [googlepodcasts] Add new extractor 2021-02-26 16:08:15 +01:00
Remita Amine
e52adb5328 [iheart] Add new extractor for iHeartRadio(#27037) 2021-02-26 16:06:26 +01:00
Remita Amine
626d26e13a [acast] clean podcast URLs 2021-02-26 16:06:22 +01:00
Remita Amine
1e653be1d0 [stitcher] clean podcast URLs 2021-02-26 16:06:16 +01:00
Remita Amine
017215032a [utils] add a function to clean podcast URLs 2021-02-26 16:06:12 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
e98e8454c5 [xfileshare] Add support for aparat.cam (closes #27651) 2021-02-26 16:06:04 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
a22e2b59b4 [nrktv] Add subtitles test 2021-02-26 16:06:00 +01:00
Remita Amine
3f2bf67bc9 [twitter] Add support for summary card(closes #25121) 2021-02-26 16:05:55 +01:00
Remita Amine
28c4062a58 [twitter] try to use a Generic fallback for unknown twitter cards(clo…
…ses #25982)
2021-02-26 16:05:50 +01:00
Remita Amine
3f43c99d4a [stitcher] Add support for shows and show metadata extraction(closes …
…#20510)
2021-02-26 16:05:44 +01:00
Remita Amine
8406b57ac6 [stv] improve episode id extraction(closes #23083) 2021-02-26 16:05:39 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
8e538fc605 [nrk] Fix age limit extraction 2021-02-26 16:05:31 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
b51ed7b039 [nrk] Improve series metadata extraction (closes #27473) 2021-02-26 16:05:26 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
785078cb08 [nrk] PEP 8 2021-02-26 16:05:21 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
57a63ed4a1 [nrk] Improve episode and season number extraction 2021-02-26 16:05:12 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
c00a4d81ca [nrktv] Fix tests 2021-02-26 16:05:07 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
aa829b6cd3 [nrk] Improve series metadata extraction 2021-02-26 16:04:49 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
db48c8dbfe [nrk] Extract subtitles 2021-02-26 16:04:44 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
eff203d3ae [nrk] Fix age limit extraction 2021-02-26 16:04:38 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
d9673551d7 [nrk] Inline _extract_from_playback 2021-02-26 16:04:34 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
634ebea93d [nrk] Improve video id extraction 2021-02-26 16:04:15 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
e1145c77fd [nrk] Add more shortcut tests 2021-02-26 16:04:08 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
18be494898 [nrk] Improve extraction (closes #27634, closes #27635)
+ Add support for mp3 formats
* Generalize and delegate all item extractors to nrk, beware ie key breakages
+ Add support for podcasts
+ Generalize nrk shortcut form to support all kind of ids
2021-02-26 16:04:02 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
973258396d [nrktv] Switch to playback endpoint
mediaelement endpoint is no longer in use.
2021-02-26 16:02:33 +01:00
Remita Amine
417963200c [vvvvid] fix season metadata extraction(#18130) 2021-02-26 16:02:17 +01:00
Remita Amine
51535e0624 [stitcher] fix extraction(closes #20811)(closes #27606) 2021-02-26 16:02:04 +01:00
Remita Amine
5ccde7fdb3 [acast] fix extraction(closes #21444)(closes #27612)(closes #27613) 2021-02-26 16:01:52 +01:00
Remita Amine
56a45e91d2 [arcpublishing] add missing staticmethod decorator 2021-02-26 16:01:45 +01:00
Remita Amine
a13444f117 [arcpublishing] Add new extractor
closes #2298
closes #9340
closes #17200
2021-02-26 16:01:11 +01:00
Remita Amine
fc156473d9 [sky] add support for Sports News articles and Brighcove videos(close…
…s #13054)
2021-02-26 15:54:49 +01:00
Remita Amine
2aafa2f712 [vvvvid] skip unplayable episodes and extract akamai formats(closes #…
…27599)
2021-02-26 15:54:41 +01:00
Remita Amine
0ade73d562 [yandexvideo] fix extraction for Python 3.4 2021-02-26 15:54:32 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
52fd0e8bb8 [redditr] Fix review issues and extract source thumbnail (closes #27503) 2021-02-26 15:54:14 +01:00
ozburo
e4f3383802 [redditr] Extract all thumbnails 2021-02-26 15:54:08 +01:00
Remita Amine
9a6885f335 [vvvvid] imporove info extraction 2021-02-26 15:54:01 +01:00
nixxo
0165049a52 [vvvvid] add playlists support (#27574)
closes #18130
2021-02-26 15:53:57 +01:00
Remita Amine
97eb5b61b7 [yandexdisk] extract info from webpage
the public API does not return metadata when download limit is reached
2021-02-26 15:53:51 +01:00
Remita Amine
355b6d9ab6 [yandexdisk] fix extraction(closes #17861)(closes #27131) 2021-02-26 15:53:46 +01:00
Remita Amine
95b5454a31 [yandexvideo] use old api call as fallback 2021-02-26 15:53:41 +01:00
Remita Amine
a2f4d6ec07 [yandexvideo] fix extraction(closes #25000) 2021-02-26 15:53:33 +01:00
Remita Amine
2c4b3dd864 [utils] accept only supported protocols in url_or_none 2021-02-26 15:53:27 +01:00
Remita Amine
10af8572d4 [YoutubeDL] Allow format filtering using audio language(#16209) 2021-02-26 15:53:16 +01:00
Remita Amine
c7d0af171f [nbc] Remove CSNNE extractor 2021-02-26 15:52:06 +01:00
Remita Amine
f1931b8ba8 [nbc] fix NBCSport VPlayer URL extraction(closes #16640) 2021-02-26 15:51:59 +01:00
Remita Amine
3ca3074dc3 [aenetworks] fix HistoryPlayerIE tests 2021-02-26 15:51:52 +01:00
Remita Amine
f7bef2772c [aenetworks] add support for biography.com (closes #3863) 2021-02-26 15:51:25 +01:00
Remita Amine
50162a3580 [uktvplay] match new video URLs(closes #17909) 2021-02-26 15:49:59 +01:00
Remita Amine
1dbf12006f [sevenplay] detect API errors 2021-02-26 15:49:54 +01:00
Remita Amine
db69be3ccc [tenplay] fix format extraction(closes #26653) 2021-02-26 15:49:47 +01:00
Remita Amine
21f2e0a12e [brightcove] raise ExtractorError for DRM protected videos(closes #23…
…467)(closes #27568)
2021-02-26 15:49:42 +01:00
Remita Amine
838ac10bc7 [aparat] Fix extraction
closes #22285
closes #22611
closes #23348
closes #24354
closes #24591
closes #24904
closes #25418
closes #26070
closes #26350
closes #26738
closes #27563
2021-02-26 15:49:32 +01:00
Remita Amine
f3474e105d [brightcove] remove sonyliv specific code 2021-02-26 15:49:26 +01:00
Remita Amine
afa77db731 [piksel] import format extraction 2021-02-26 15:49:21 +01:00
Remita Amine
68335e76a7 [zype] Add support for uplynk videos 2021-02-26 15:49:14 +01:00
Remita Amine
d5bf4b0fea [toggle] add support for live.mewatch.sg (closes #27555) 2021-02-26 15:49:07 +01:00
JamKage
7b1f0173c1 [go] Added support for FXNetworks (#26826)
Co-authored-by: James Kirrage <james.kirrage@mortgagegym.com>

closes #13972
closes #22467
closes #23754
2021-02-26 15:48:48 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
2a0a9bac02 [teachable] Improve embed detection (closes #26923) 2021-02-26 15:46:56 +01:00
Remita Amine
217918987a [mitele] fix free video extraction(#24624)(closes #25827)(closes #26757) 2021-02-26 15:46:52 +01:00
Remita Amine
7490ed64b4 [telecinco] fix extraction 2021-02-26 15:46:46 +01:00
Sergey M
c4445c3311 [youtube] Update invidious.snopyta.org (#22667)
Co-authored-by: sofutru <54445344+sofutru@users.noreply.github.com>
2021-02-26 15:46:39 +01:00
Remita Amine
2d3b82a754 [amcnetworks] improve auth only video detection(closes #27548) 2021-02-26 15:46:29 +01:00
Laura Liberda
92bd8a446e VHX embeds
https://github.com/ytdl-org/youtube-dl/issues/27546
2021-02-26 15:45:57 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
1d9552c236 [instagram] Fix test 2021-02-26 15:39:10 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
97c3432659 [instagram] Fix comment count extraction 2021-02-26 15:39:04 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
477e444c3b [instagram] Add support for reel URLs (closes #26234, closes #26250) 2021-02-26 15:38:59 +01:00
Remita Amine
c298be2ebd [bbc] switch to media selector v6
closes #23232
closes #23933
closes #26303
closes #26432
closes #26821
closes #27538
2021-02-26 15:38:53 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
ff12ad0ee4 [instagram] Improve thumbnail extraction 2021-02-26 15:38:48 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
73c5dc4104 [instagram] Improve extraction (closes #22880) 2021-02-26 15:38:42 +01:00
Andrew Udvare
d7c028a33e [instagram] Fix extraction when authenticated (closes #27422) 2021-02-26 15:38:34 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
10a6f841a7 [spankbang] Remove unused import 2021-02-26 15:38:28 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
50dfe7adb8 [spangbang:playlist] Fix extraction (closes #24087) 2021-02-26 15:38:20 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
84b7f91b28 [spangbang] Add support for playlist videos 2021-02-26 15:38:12 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
dc69c587bf [pornhub] Fix review issues (closes #27393) 2021-02-26 15:36:38 +01:00
JChris246
226faa5521 [pornhub] Fix lq formats extraction (closes #27386) 2021-02-26 15:36:31 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
5b75c620bd [bongacams] Add extractor (closes #27440) 2021-02-26 15:36:23 +01:00
Remita Amine
b88f43a813 [theweatherchannel] fix extraction (closes #25930)(closes #26051) 2021-02-26 15:36:17 +01:00
Remita Amine
8567d4488f [sprout] correct typo 2021-02-26 15:36:11 +01:00
Remita Amine
4d81f83267 [sprout] Add support for Universal Kids (closes #22518) 2021-02-26 15:36:04 +01:00
Remita Amine
5f00c83c35 [theplatform] allow passing geo bypass countries from other extractors 2021-02-26 15:35:57 +01:00
Remita Amine
90a021a137 [ctv] Add new extractor (closes #27525) 2021-02-26 15:35:17 +01:00
Remita Amine
f350e326ac [9c9media] improve info extraction 2021-02-26 15:35:11 +01:00
Remita Amine
0445f9de8d [sonyliv] fix title for movies 2021-02-26 15:34:50 +01:00
Remita Amine
08d63a28df [sonyliv] fix extraction(closes #25667) 2021-02-26 15:34:41 +01:00
Remita Amine
6e80cb939b [streetvoice] fix extraction(closes #27455)(closes #27492) 2021-02-26 15:34:30 +01:00
Remita Amine
00e2c2ddea [facebook] add support for watchparty pages(closes #27507) 2021-02-26 15:33:41 +01:00
Remita Amine
437ab525e9 [cbslocal] fix video extraction 2021-02-26 15:26:26 +01:00
Remita Amine
fc441623a8 [brightcove] add another method to extract policyKey 2021-02-26 15:26:18 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
4317f7c6fa [mewatch] Relax _VALID_URL (closes #27506) 2021-02-26 15:26:14 +01:00
Remita Amine
ed14efaed2 [anvato] remove NFLTokenGenerator
until a better solution is introduced that:
- works with lazy_extractors
- allows for 3rd party token generators
2021-02-26 15:24:16 +01:00
Remita Amine
3c6c586e4b [tastytrade] Remove Extractor(closes #25716)
covered by GenericIE via BrighcoveNewIE
2021-02-26 15:24:11 +01:00
Remita Amine
b3acd855b8 [niconico] fix playlist extraction(closes #27428) 2021-02-26 15:24:05 +01:00
Remita Amine
90988f4772 [everyonesmixtape] Remove Extractor 2021-02-26 15:23:53 +01:00
Remita Amine
ef03683547 [kanalplay] Remove Extractor 2021-02-26 15:22:09 +01:00
Remita Amine
027f07edd3 [nba] rewrite extractor 2021-02-26 15:21:32 +01:00
Remita Amine
cb5a16067b [turner] improve info extraction 2021-02-26 15:21:20 +01:00
Remita Amine
9d2fabe5d4 [common] remove unwanted query params from unsigned akamai manifest URLs 2021-02-26 15:21:13 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
457ef9b4b5 [generic] Improve RSS age limit extraction 2021-02-26 15:20:52 +01:00
renalid
c359b19034 [generic] Fix RSS itunes thumbnail extraction (#27405) 2021-02-26 15:20:47 +01:00
Trevor Nelson
4f7380c8f5 [redditr] Extract duration (#27426) 2021-02-26 15:20:42 +01:00
Remita Amine
76c441edf0 [anvato] Disable NFLTokenGenerator(closes #27449) 2021-02-26 15:20:36 +01:00
Remita Amine
597505ed41 [zaq1] Remove extractor 2021-02-26 15:20:12 +01:00
Remita Amine
794a3becfb [asiancrush] fix extraction and add support for retrocrush.tv
closes #25577
closes #25829
2021-02-26 15:17:04 +01:00
Remita Amine
7346665442 [nfl] fix extraction(closes #22245) 2021-02-26 15:16:34 +01:00
Remita Amine
3463c192f6 [anvato] update ANVACK table and add experimental token generator for…
… NFL
2021-02-26 15:16:29 +01:00
Remita Amine
441fbc4056 [sky] relax SkySports URL regex (closes #27435) 2021-02-26 15:16:18 +01:00
Remita Amine
dfb69009b9 [tv5unis] Add new extractor(closes #22399)(closes #24890) 2021-02-26 15:16:13 +01:00
Remita Amine
1315296aed [videomore] add support more.tv (closes #27088) 2021-02-26 15:16:07 +01:00
Remita Amine
1859fa8ac4 [nhk:program] Add support for audio programs and program clips 2021-02-26 15:15:53 +01:00
Matthew Rayermann
27765ca68f [nhk] Add support for NHK video programs (#27230) 2021-02-26 15:15:47 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
2c85578a1f [mdr] Bypass geo restriction 2021-02-26 15:15:34 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
1339530c44 [mdr] Improve extraction (closes #24346, closes #26873) 2021-02-26 15:15:27 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
c4dfcc3d9c [eporner] Fix view count extraction and make optional (closes #23306) 2021-02-26 15:14:15 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
e4b993e9db [extractor/common] Improve JSON-LD interaction statistic extraction (…
…refs #23306)
2021-02-26 15:14:10 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
2f63edb44a [eporner] Fix embed test URL 2021-02-26 15:13:58 +01:00
spvkgn
ff7c31e4f2 [eporner] Fix hash extraction and extend _VALID_URL (#27396)
Co-authored-by: Sergey M <dstftw@gmail.com>
2021-02-26 15:13:48 +01:00
Remita Amine
f42fea5402 [slideslive] use m3u8 entry protocol for m3u8 formats(closes #27400) 2021-02-26 15:13:40 +01:00
Remita Amine
a7f325972c [downloader/hls] delegate manifests with media initialization to ffmpeg 2021-02-26 15:13:34 +01:00
Remita Amine
0f3f3e9046 [twitcasting] fix format extraction and improve info extraction(close…
…s #24868)
2021-02-26 15:13:28 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
51d290f5d7 [extractor/common] Document duration meta field for playlists 2021-02-26 15:13:21 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
28bbfdff53 [linuxacademy] Fix authentication and extraction (closes #21129, clos…
…es #26223, closes #27402)
2021-02-26 15:13:12 +01:00
Remita Amine
0311375dc5 [itv] clean description from HTML tags (closes #27399) 2021-02-26 15:13:05 +01:00
Remita Amine
a1e7449703 [hotstart] fix and improve extraction
- fix format extraction (closes #26690)
- extract thumbnail URL (closes #16079, closes #20412)
- support country specific playlist URLs (closes #23496)
- select the last id in video URL (closes #26412)
2021-02-26 15:12:42 +01:00