laudom/haruhi-dl
2
0
Fork 0
Code Issues 13 Pull requests Packages Projects Releases Wiki Activity
18568 commits 2 branches 27 tags 47 MiB
Commit graph

692 commits

Author SHA1 Message Date
Remita Amine 78d9c01473 [aol] add support for yahoo videos(closes #26650) 2021-10-23 01:06:52 +02:00
Remita Amine 0aca265418 [yahoo] fix single video extraction 2021-10-23 01:06:52 +02:00
Remita Amine 2287106362 [ninegag] improve extraction 2021-10-23 01:06:52 +02:00
DrWursterich 554ca47216 [9gag] Fix Extraction (#23022) 2021-10-23 01:06:52 +02:00
Brian Marks 23ed695eaa [americastestkitchen] Improve metadata extraction for ATK episodes (#… 
…27860)
 2021-10-23 01:06:52 +02:00
Remita Amine 6e0744819c [aljazeera] fix extraction(closes #20911)(closes #27779) 2021-10-23 01:06:52 +02:00
Remita Amine 81e163b024 [minds] improve extraction 2021-10-23 01:06:52 +02:00
Tatsh ca4bfa3da3 [Minds] Add new extractor (#17934) 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Adrian=20Heine=20n=C3=A9=20Lang?= 58fa22f684 [ard] Fix title and description extraction and update tests (#27761) 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Adrian=20Heine=20n=C3=A9=20Lang?= f808eef2f3 [aenetworks] Fix test (#27847) 2021-10-23 01:06:52 +02:00
Remita Amine 6b6c8bf1f0 [spotify] Add new extractor for Spotify Podcasts(closes #27443) 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 79a5e77e79 [mixcloud:playlist:base] Fix video id extraction in flat playlist mod… 
…e (refs #27787)
 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 6f17f97383 [animeondemand] Add support for lazy playlist extraction (closes #27829) 2021-10-23 01:06:52 +02:00
Remita Amine 2dcad362e8 [twitter] Add tests for more cards 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 720ee011e2 [youporn] Restrict fallback download URL (refs #27822) 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 4b782259f2 [youporn] Improve height and tbr extraction (refs #23659, refs #20425) 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 1855ad87cd [youporn] Fix extraction (closes #27822) 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= cd5366e41d [twitter] Add support for unified cards (closes #27826) 2021-10-23 01:06:52 +02:00
main() 6fdbcc1c59 [twitch] Set OAuth token for GraphQL requests using auth-token cookie… 
… (#27790)

Co-authored-by: remitamine <remitamine@gmail.com>
 2021-10-23 01:06:52 +02:00
Aarni Koskela 9fb1f50a15 [Mixcloud] Harmonize ID generation from lists with full ID generation… 
… (#27787)

Mixcloud IDs are generated as `username_slug` when the full ID dict has been
downloaded.  When downloading a list (e.g. uploads, favorites, ...), the temporary
ID is just the `slug`.  This made e.g. archive file usage require the download
of stream metadata before the download can be rejected as already downloaded.

This commit attempts to get the uploader username during the GraphQL query, so the
temporary IDs are generated similarly.
 2021-10-23 01:06:52 +02:00
Remita Amine e5ef69ca71 [cspan] improve info extraction(closes #27791) 2021-10-23 01:06:52 +02:00
Remita Amine ca8ab55941 [adn] improve info extraction 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Adrian=20Heine=20n=C3=A9=20Lang?= 258cd9f44e [ADN] Fix extraction (#27732) 
Closes #26963.
 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 12ca40436c [twitch] Improve login error extraction 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 82b487f429 [twitch] Fix authentication (refs #27743) 2021-10-23 01:06:52 +02:00
Remita Amine 7501f94648 [threeqsdn] Improve extraction(closes #21058) 2021-10-23 01:06:52 +02:00
0l-l0 1adc5f4c47 [peertube] Extract files also from streamingPlaylists (#27728) 
JSON objects with an empty "files" tag seem to be a valid PeerTube API
response. In those cases the "files" arrays contained in the
"streamingPlaylists" members can be used instead.
closes #26002
closes #27586
 2021-10-23 01:06:52 +02:00
Remita Amine 9c305e65fb [khanacademy] fix extraction(closes #2887)(closes #26803) 2021-10-23 01:06:52 +02:00
Remita Amine 2c106247f3 [spike] Update Paramount Network feed URL(closes #27715) 2021-10-23 01:06:52 +02:00
nixxo a447f25d5c [rai] improve subtitles extraction (#27705) 
closes #27698
 2021-10-23 01:06:52 +02:00
Remita Amine 3caed2e161 [canvas] Match only supported VRT NU URLs(#27707) 2021-10-23 01:06:52 +02:00
Remita Amine 1c3eda7037 [extractors] add BibelTVIE import 2021-10-23 01:06:52 +02:00
Remita Amine 84d85be122 [bibeltv] Add new extractor(closes #14361) 2021-10-23 01:06:52 +02:00
Remita Amine 245f1d834f [bfmtv] Add new extractor(closes #16053)(closes #26615) 2021-10-23 01:06:52 +02:00
Remita Amine da1bf36474 [sbs] Add support for ondemand play and news embed URLs(closes #17650… 
…)(closes #27629)
 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 16ff1e6bdf [twitch] Refactor 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= ced3ed1c25 [twitch] Drop legacy kraken API v5 code altogether 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 0b6351b649 [twitch:vod] Switch to GraphQL for video metadata 2021-10-23 01:06:52 +02:00
Remita Amine acac4f3f2c [canvas] Fix VRT NU extraction(closes #26957)(closes #27053) 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 3ef8a0fb3d [twitch] Improve access token extraction and remove unused code (clos… 
…es #27646)
 2021-10-23 01:06:52 +02:00
23rd 8ad9ab6bf1 [twitch] Switch access token to GraphQL and refactor. 2021-10-23 01:06:52 +02:00
nixxo 57f417b3cd [rai] Detect ContentItem in iframe (closes #12652) (#27673) 
Co-authored-by: Sergey M. <dstftw@gmail.com>
 2021-10-23 01:06:52 +02:00
Remita Amine f24ce9e12a [ketnet] fix extraction(closes #27662) 2021-10-23 01:06:52 +02:00
Remita Amine 330c49718a [dplay] Add suport Discovery+ domains(closes #27680) 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 5984740aed [motherless] Fix review issues and improve extraction (closes #26495,… 
… closes #27450)
 2021-10-23 01:06:52 +02:00
cladmi b3e644ee0d [motherless] Fix recent videos upload date extraction (closes #27661) 
Less than a week old videos use a '20h ago' or '1d ago' format.

I kept the support for 'Ago' with uppercase start at is was already in the code.
 2021-10-23 01:06:52 +02:00
Yurii H 598916af95 [iheart] Update test description value (#27037) 
the description has no HTML tags now.
 2021-10-23 01:06:52 +02:00
Remita Amine 59d82ec275 [nrk] fix extraction for videos without a legalAge rating 2021-10-23 01:06:52 +02:00
Remita Amine 0a8305247c [iheart] clean HTML tags from episode description 2021-10-23 01:06:52 +02:00
Remita Amine 4d731a9917 [iheart] remove print statement 2021-10-23 01:06:52 +02:00
Remita Amine c23155171b [googleplus] Remove Extractor(closes #4955)(closes #7400) 2021-10-23 01:06:52 +02:00
Remita Amine 5a6c27fd90 [applepodcasts] Add new extractor(#25918) 2021-10-23 01:06:52 +02:00
Remita Amine 12049cc72a [googlepodcasts] Add new extractor 2021-10-23 01:06:52 +02:00
Remita Amine 0c069db053 [iheart] Add new extractor for iHeartRadio(#27037) 2021-10-23 01:06:52 +02:00
Remita Amine 49dc695b8b [acast] clean podcast URLs 2021-10-23 01:06:52 +02:00
Remita Amine 888a8d4c64 [stitcher] clean podcast URLs 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 97cdea36f2 [xfileshare] Add support for aparat.cam (closes #27651) 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= d0177a6f30 [nrktv] Add subtitles test 2021-10-23 01:06:52 +02:00
Remita Amine 881049eef5 [twitter] Add support for summary card(closes #25121) 2021-10-23 01:06:52 +02:00
Remita Amine a39405150b [twitter] try to use a Generic fallback for unknown twitter cards(clo… 
…ses #25982)
 2021-10-23 01:06:52 +02:00
Remita Amine f6560b19c4 [stitcher] Add support for shows and show metadata extraction(closes … 
…#20510)
 2021-10-23 01:06:52 +02:00
Remita Amine 7db31b6628 [stv] improve episode id extraction(closes #23083) 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= c09836e567 [nrk] Fix age limit extraction 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 74e9abdd95 [nrk] Improve series metadata extraction (closes #27473) 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 0047ca78b2 [nrk] PEP 8 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 6aa2ce5a53 [nrk] Improve episode and season number extraction 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= dd3fe3a68e [nrktv] Fix tests 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 28011fbf5d [nrk] Improve series metadata extraction 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= d1cc5993a9 [nrk] Extract subtitles 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= ee3e906f25 [nrk] Fix age limit extraction 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 2f5c7ee1f9 [nrk] Inline _extract_from_playback 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 3042ced564 [nrk] Improve video id extraction 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= f78fbf70e7 [nrk] Add more shortcut tests 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 6ed6badbe2 [nrk] Improve extraction (closes #27634, closes #27635) 
+ Add support for mp3 formats
* Generalize and delegate all item extractors to nrk, beware ie key breakages
+ Add support for podcasts
+ Generalize nrk shortcut form to support all kind of ids
 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= f224645ac3 [nrktv] Switch to playback endpoint 
mediaelement endpoint is no longer in use.
 2021-10-23 01:06:52 +02:00
Remita Amine 67215062ea [vvvvid] fix season metadata extraction(#18130) 2021-10-23 01:06:52 +02:00
Remita Amine ca8965d28b [stitcher] fix extraction(closes #20811)(closes #27606) 2021-10-23 01:06:52 +02:00
Remita Amine 91dd4819e8 [acast] fix extraction(closes #21444)(closes #27612)(closes #27613) 2021-10-23 01:06:52 +02:00
Remita Amine 7e985046a0 [arcpublishing] add missing staticmethod decorator 2021-10-23 01:06:52 +02:00
Remita Amine 4336684bca [arcpublishing] Add new extractor 
closes #2298
closes #9340
closes #17200
 2021-10-23 01:06:52 +02:00
Remita Amine f8af3b480f [sky] add support for Sports News articles and Brighcove videos(close… 
…s #13054)
 2021-10-23 01:06:52 +02:00
Remita Amine 6fec676bf2 [vvvvid] skip unplayable episodes and extract akamai formats(closes #… 
…27599)
 2021-10-23 01:06:52 +02:00
Remita Amine 9014fa950e [yandexvideo] fix extraction for Python 3.4 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= b8ebc9bd91 [redditr] Fix review issues and extract source thumbnail (closes #27503) 2021-10-23 01:06:52 +02:00
ozburo b83833f1f4 [redditr] Extract all thumbnails 2021-10-23 01:06:52 +02:00
Remita Amine 4f49d50c61 [vvvvid] imporove info extraction 2021-10-23 01:06:52 +02:00
nixxo 8188302a03 [vvvvid] add playlists support (#27574) 
closes #18130
 2021-10-23 01:06:52 +02:00
Remita Amine 2c8306ce89 [yandexdisk] extract info from webpage 
the public API does not return metadata when download limit is reached
 2021-10-23 01:06:52 +02:00
Remita Amine 5643182c7c [yandexdisk] fix extraction(closes #17861)(closes #27131) 2021-10-23 01:06:52 +02:00
Remita Amine ba2ee853d0 [yandexvideo] use old api call as fallback 2021-10-23 01:06:52 +02:00
Remita Amine 7dc64629d5 [yandexvideo] fix extraction(closes #25000) 2021-10-23 01:06:52 +02:00
Remita Amine 93c2a90d46 [nbc] Remove CSNNE extractor 2021-10-23 01:06:52 +02:00
Remita Amine 21652ea04f [nbc] fix NBCSport VPlayer URL extraction(closes #16640) 2021-10-23 01:06:52 +02:00
Remita Amine 6a185bd70e [aenetworks] fix HistoryPlayerIE tests 2021-10-23 01:06:52 +02:00
Remita Amine 78c85eee12 [aenetworks] add support for biography.com (closes #3863) 2021-10-23 01:06:52 +02:00
Remita Amine f40b51b20b [uktvplay] match new video URLs(closes #17909) 2021-10-23 01:06:52 +02:00
Remita Amine 03ec618950 [sevenplay] detect API errors 2021-10-23 01:06:52 +02:00
Remita Amine 8215e72574 [tenplay] fix format extraction(closes #26653) 2021-10-23 01:06:52 +02:00
Remita Amine de72e99bd4 [brightcove] raise ExtractorError for DRM protected videos(closes #23… 
…467)(closes #27568)
 2021-10-23 01:06:52 +02:00
Remita Amine 107ca3cbb4 [aparat] Fix extraction 
closes #22285
closes #22611
closes #23348
closes #24354
closes #24591
closes #24904
closes #25418
closes #26070
closes #26350
closes #26738
closes #27563
 2021-10-23 01:06:52 +02:00
Remita Amine 5a2545d9e1 [brightcove] remove sonyliv specific code 2021-10-23 01:06:52 +02:00
Remita Amine c75135ffe9 [piksel] import format extraction 2021-10-23 01:06:52 +02:00
Remita Amine 4a4b71739b [zype] Add support for uplynk videos 2021-10-23 01:06:52 +02:00
Remita Amine c80af1ed8b [toggle] add support for live.mewatch.sg (closes #27555) 2021-10-23 01:06:52 +02:00
JamKage 4174222eb4 [go] Added support for FXNetworks (#26826) 
Co-authored-by: James Kirrage <james.kirrage@mortgagegym.com>

closes #13972
closes #22467
closes #23754
 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 2edeaf4d05 [teachable] Improve embed detection (closes #26923) 2021-10-23 01:06:52 +02:00
Remita Amine 4e37a9ea6c [mitele] fix free video extraction(#24624)(closes #25827)(closes #26757) 2021-10-23 01:06:52 +02:00
Remita Amine 1c1e20603b [telecinco] fix extraction 2021-10-23 01:06:52 +02:00
Sergey M acd96ffe3c [youtube] Update invidious.snopyta.org (#22667) 
Co-authored-by: sofutru <54445344+sofutru@users.noreply.github.com>
 2021-10-23 01:06:52 +02:00
Remita Amine a684623f86 [amcnetworks] improve auth only video detection(closes #27548) 2021-10-23 01:06:52 +02:00
Laura Liberda 571c02ab38 VHX embeds 
https://github.com/ytdl-org/youtube-dl/issues/27546
 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= c90c6e0db7 [instagram] Fix test 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 0309b4a494 [instagram] Fix comment count extraction 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 6f05e08af3 [instagram] Add support for reel URLs (closes #26234, closes #26250) 2021-10-23 01:06:52 +02:00
Remita Amine 16f8b4442c [bbc] switch to media selector v6 
closes #23232
closes #23933
closes #26303
closes #26432
closes #26821
closes #27538
 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 36d012f932 [instagram] Improve thumbnail extraction 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 6e617eb2e8 [instagram] Improve extraction (closes #22880) 2021-10-23 01:06:51 +02:00
Andrew Udvare 22c3b77c77 [instagram] Fix extraction when authenticated (closes #27422) 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= ede86727f3 [spankbang] Remove unused import 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 1cb545ef2a [spangbang:playlist] Fix extraction (closes #24087) 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= de08d2ebb6 [spangbang] Add support for playlist videos 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= c7a0d780b6 [pornhub] Fix review issues (closes #27393) 2021-10-23 01:06:51 +02:00
JChris246 6ba48137c2 [pornhub] Fix lq formats extraction (closes #27386) 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= e1b44f86a8 [bongacams] Add extractor (closes #27440) 2021-10-23 01:06:51 +02:00
Remita Amine 1d866fe2b3 [theweatherchannel] fix extraction (closes #25930)(closes #26051) 2021-10-23 01:06:51 +02:00
Remita Amine ac0b651c35 [sprout] correct typo 2021-10-23 01:06:51 +02:00
Remita Amine 7246d188ec [sprout] Add support for Universal Kids (closes #22518) 2021-10-23 01:06:51 +02:00
Remita Amine 866f1a801d [theplatform] allow passing geo bypass countries from other extractors 2021-10-23 01:06:51 +02:00
Remita Amine 93e7f9943c [ctv] Add new extractor (closes #27525) 2021-10-23 01:06:51 +02:00
Remita Amine a8abf2770e [9c9media] improve info extraction 2021-10-23 01:06:51 +02:00
Remita Amine 522b9ee05b [sonyliv] fix title for movies 2021-10-23 01:06:51 +02:00
Remita Amine 6baf86c39d [sonyliv] fix extraction(closes #25667) 2021-10-23 01:06:51 +02:00
Remita Amine 14a2647111 [streetvoice] fix extraction(closes #27455)(closes #27492) 2021-10-23 01:06:51 +02:00
Remita Amine 97e449e183 [facebook] add support for watchparty pages(closes #27507) 2021-10-23 01:06:51 +02:00
Remita Amine ff3bc594e7 [cbslocal] fix video extraction 2021-10-23 01:06:51 +02:00
Remita Amine 50377f35a0 [brightcove] add another method to extract policyKey 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 15058fcdea [mewatch] Relax _VALID_URL (closes #27506) 2021-10-23 01:06:51 +02:00
Remita Amine 25f997a417 [anvato] remove NFLTokenGenerator 
until a better solution is introduced that:
- works with lazy_extractors
- allows for 3rd party token generators
 2021-10-23 01:06:51 +02:00
Remita Amine 23a5bcc4df [tastytrade] Remove Extractor(closes #25716) 
covered by GenericIE via BrighcoveNewIE
 2021-10-23 01:06:51 +02:00
Remita Amine 3e93d39835 [niconico] fix playlist extraction(closes #27428) 2021-10-23 01:06:51 +02:00
Remita Amine bfd375ccb7 [everyonesmixtape] Remove Extractor 2021-10-23 01:06:51 +02:00
Remita Amine 4dd69eb6fd [kanalplay] Remove Extractor 2021-10-23 01:06:51 +02:00
Remita Amine 8f1118f75d [nba] rewrite extractor 2021-10-23 01:06:51 +02:00
Remita Amine adbb3cdd89 [turner] improve info extraction 2021-10-23 01:06:51 +02:00
Remita Amine 4969a2783c [common] remove unwanted query params from unsigned akamai manifest URLs 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 86cf5a2aa7 [generic] Improve RSS age limit extraction 2021-10-23 01:06:51 +02:00
renalid e1b808fa40 [generic] Fix RSS itunes thumbnail extraction (#27405) 2021-10-23 01:06:51 +02:00
Trevor Nelson 1da4c42b9f [redditr] Extract duration (#27426) 2021-10-23 01:06:51 +02:00
Remita Amine aaabef0220 [anvato] Disable NFLTokenGenerator(closes #27449) 2021-10-23 01:06:51 +02:00
Remita Amine 4eab6d5637 [zaq1] Remove extractor 2021-10-23 01:06:51 +02:00
Remita Amine 76995ec854 [asiancrush] fix extraction and add support for retrocrush.tv 
closes #25577
closes #25829
 2021-10-23 01:06:51 +02:00
Remita Amine 7b2415f4f9 [nfl] fix extraction(closes #22245) 2021-10-23 01:06:51 +02:00
Remita Amine c2c2b20b39 [anvato] update ANVACK table and add experimental token generator for… 
… NFL
 2021-10-23 01:06:51 +02:00
Remita Amine a1952d3a0b [sky] relax SkySports URL regex (closes #27435) 2021-10-23 01:06:51 +02:00
Remita Amine 4bc794225a [tv5unis] Add new extractor(closes #22399)(closes #24890) 2021-10-23 01:06:51 +02:00
Remita Amine a78d792adb [videomore] add support more.tv (closes #27088) 2021-10-23 01:06:51 +02:00
Remita Amine b2d4c847ed [nhk:program] Add support for audio programs and program clips 2021-10-23 01:06:51 +02:00
Matthew Rayermann 7e6e4c9a29 [nhk] Add support for NHK video programs (#27230) 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= f0db042d42 [mdr] Bypass geo restriction 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= b331a819bc [mdr] Improve extraction (closes #24346, closes #26873) 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= c700190a05 [eporner] Fix view count extraction and make optional (closes #23306) 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 1060552241 [extractor/common] Improve JSON-LD interaction statistic extraction (… 
…refs #23306)
 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= c7e6e03982 [eporner] Fix embed test URL 2021-10-23 01:06:51 +02:00
spvkgn aa655226dd [eporner] Fix hash extraction and extend _VALID_URL (#27396) 
Co-authored-by: Sergey M <dstftw@gmail.com>
 2021-10-23 01:06:51 +02:00
Remita Amine 948c21b310 [slideslive] use m3u8 entry protocol for m3u8 formats(closes #27400) 2021-10-23 01:06:51 +02:00
Remita Amine 2257ec4792 [twitcasting] fix format extraction and improve info extraction(close… 
…s #24868)
 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 09824dd983 [extractor/common] Document duration meta field for playlists 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= d5b9b7ffc1 [linuxacademy] Fix authentication and extraction (closes #21129, clos… 
…es #26223, closes #27402)
 2021-10-23 01:06:51 +02:00
Remita Amine 096b76fb8f [itv] clean description from HTML tags (closes #27399) 2021-10-23 01:06:51 +02:00
Remita Amine 26a7c4416c [hotstart] fix and improve extraction 
- fix format extraction (closes #26690)
- extract thumbnail URL (closes #16079, closes #20412)
- support country specific playlist URLs (closes #23496)
- select the last id in video URL (closes #26412)
 2021-10-23 01:06:51 +02:00
toniz4 a16737d123 [youtube] Add some invidious instances (#27373) 
Co-authored-by: Cássio <heyitscassio@cock.li>
 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 940c972e32 [ruutu] Extract more metadata and detect non-free videos (closes #21154) 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 9551a110d5 [ruutu] Authenticate format URLs (closes #21031, closes #26782) 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= ee2b2e978d [ruutu] Add support for static.nelonenmedia.fi (closes #25412) 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 0f76bf3b16 [ruutu] Extend _VALID_URL (closes #24839) 2021-10-23 01:06:51 +02:00
Remita Amine 1f42f0d662 [facebook] Add support archived live video URLs(closes #15859) 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 85b2a459dd [wdr] Extent subtitles extraction and improve overall extraction (clo… 
…ses #22672, closes #22723)
 2021-10-23 01:06:51 +02:00
Remita Amine ce1265ba8b [facebook] add support for videos attached to Relay based story pages… 
…(#10795)
 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 271de5e36b [wdr:page] Add support for kinder.wdr.de (closes #27350) 2021-10-23 01:06:51 +02:00
Remita Amine 7178c3e070 [facebook] Add another regex for handleServerJS 2021-10-23 01:06:51 +02:00
Remita Amine 80e135e246 [facebook] fix embed page extraction 2021-10-23 01:06:51 +02:00
Remita Amine a494221ffa [PATCH] [facebook] add support for Relay post pages(closes #26935) 2021-10-23 01:06:51 +02:00
Remita Amine 3a0bdc1456 [facebook] proper support for watch videos(closes #22795)(#27062) 2021-10-23 01:06:51 +02:00
Remita Amine 6970a136ec Revert "[facebook] add support for watch videos(closes #22795)" 
This reverts commit dc65041c224497f46b2984df02c234ce54bdedfd.
 2021-10-23 01:06:51 +02:00
Remita Amine ab0118de82 [facebook] add support for watch videos(closes #22795) 2021-10-23 01:06:51 +02:00
Remita Amine cfa38c154d [facebook] add support for group posts with multiple videos(closes #1… 
…9131)
 2021-10-23 01:06:51 +02:00
Remita Amine 885a3a9383 [itv] remove old extractio method and fix series metadata extraction 
closes #23177
closes #26897
 2021-10-23 01:06:51 +02:00
Remita Amine 131b5bbf6e [facebook] redirect Mobile URLs to Desktop URLs 
closes #24831
closes #25624
 2021-10-23 01:06:51 +02:00
Remita Amine 7d43250e35 [facebook] Add support for Relay based pages(closes #26823) 2021-10-23 01:06:51 +02:00
Remita Amine 9ba5d1f2c4 [facebook] try to reduce unessessary tahoe requests 2021-10-23 01:06:51 +02:00
Remita Amine 61022d86b9 [facebook] remove hardcoded chrome user-agent 
closes #18974
closes #25411
closes #26958
closes #27329
 2021-10-23 01:06:51 +02:00
Andrey Smirnoff b0635eb9af [smotri] Remove extractor (#27358) 2021-10-23 01:06:51 +02:00
Remita Amine d64b39da56 [beampro] Remove Extractor 
closes #17290
closes #22871
closes #23020
closes #23061
closes #26099
 2021-10-23 01:06:51 +02:00
EntranceJew 45ee5c8ba2 [tubitv] Extract release year (#27317) 2021-10-23 01:06:51 +02:00
Remita Amine 51433a1efa [amcnetworks] Fix free content extraction(closes #20354) 2021-10-23 01:06:51 +02:00
Remita Amine 8a311118c5 [telequebec] Fix Extraction and Add Support for video.telequebec.tv 
closes #25733
closes #26883
closes #27339
 2021-10-23 01:06:51 +02:00
Remita Amine d2f6235840 [generic] comment a test covered now by AmericasTestKitchenIE 2021-10-23 01:06:51 +02:00
Remita Amine 03f1dda5da [tvplay:home] Fix extraction(closes #21153) 2021-10-23 01:06:51 +02:00
Remita Amine aad69ec1b5 [americastestkitchen] Fix Extraction and add support for Cook's Count… 
…ry and Cook's Illustrated

closes #17234
closes #27322
 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 695d097a1b [slideslive] Add support for yoda service videos and extract subtitle… 
…s (closes #27323)
 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= e895ca0d9f [extractor/generic] Remove unused import 2021-10-23 01:06:51 +02:00
Remita Amine b89074356b [aenetworks] Fix extraction 
- Fix Fastly format extraction
- Add support for play and watch subdomains
- Extract series metadata

closes #23363
closes #23390
closes #26795
closes #26985
 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= a0b9b17798 [extractor/common] Extract timestamp from Last-Modified header 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 10b7025196 [generic] Extract RSS video itunes metadata 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 021738dfa7 [generic] Extract RSS video timestamp 2021-10-23 01:06:51 +02:00
renalid d3f521bbdc [generic] Extract RSS video description (#27177) 2021-10-23 01:06:51 +02:00
Remita Amine d6457b9613 [nrk] reduce requests for Radio series 2021-10-23 01:06:51 +02:00
Remita Amine 2120179b61 [nrk] reduce the number of instalments requests 2021-10-23 01:06:51 +02:00
Remita Amine 392743d1e4 [nrk] improve format extraction 2021-10-23 01:06:51 +02:00
Remita Amine 917f2ec68d [nrk] improve extraction 
- improve format extraction for old akamai formats
- update some of the tests
- add is_live value to entry info dict
- request instalments only when their available
- fix skole extraction
 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 9c92a54488 [peertube] Extract fps 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= c23e70b2e7 [peertube] Recognize audio-only formats (closes #27295) 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= c11211efce [teachable:course] Improve extraction (closes #24507, closes #27286) 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 427dfe7ca9 [nrk] Improve error extraction 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 24342b07db [nrktv] Relax _VALID_URL 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 3d5bbf574b [nrktv:series] Improve extraction (closes #21926) 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 8b78e040c0 [nrktv:series] Improve extraction 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= d98d4ea999 [nrktv:season] Improve extraction 2021-10-23 01:06:51 +02:00
Remita Amine 3935b7503d [nrk] fix call to moved method 2021-10-23 01:06:51 +02:00
Remita Amine c3f178555c [nrk] fix typo 2021-10-23 01:06:51 +02:00
Remita Amine 9cd7a23c87 [nrk] improve format extraction and geo-restriction detection (closes… 
… #24221)
 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 3012eb0bee [pornhub] Handle HTTP errors gracefully (closes #26414) 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 9647acd865 [nrktv] Relax _VALID_URL (closes #27299, closes #26185) 2021-10-23 01:06:51 +02:00
Remita Amine 5657492d8b [zdf] extract webm formats(closes #26659) 2021-10-23 01:06:51 +02:00
Matthew Rayermann a2c136b114 [nhk] Add audio clip test to NHK extractor (#27269) 2021-10-23 01:06:51 +02:00
Remita Amine aae5e2a9ae [gamespot] Extract DASH and HTTP formats 2021-10-23 01:06:51 +02:00
Remita Amine f1544fba1b [extractor/commons] improve Akamai HTTP formats extraction 2021-10-23 01:06:51 +02:00
Remita Amine 3e720fb782 [tver] correct episode_number key 2021-10-23 01:06:51 +02:00
Remita Amine b4790d23c3 [extractor/common] improve Akamai HTTP format extraction 
- Allow m3u8 manifest without an additional audio format
- Fix extraction for qualities starting with a number
Solution provided by @nixxo based on: https://stackoverflow.com/a/5984688
 2021-10-23 01:06:51 +02:00
Remita Amine 7eaf5dfb74 [tver] Add new extractor (closes #26662)(closes #27284) 2021-10-23 01:06:51 +02:00
Remita Amine a542d171f2 [extractors] Add QubIE import 2021-10-23 01:06:51 +02:00
Remita Amine 25b8a45235 [tva] Add support for qub.ca (closes #27235) 2021-10-23 01:06:51 +02:00
Remita Amine cb2a719249 [toggle] Detect DRM protected videos (closes #16479)(closes #20805) 2021-10-23 01:06:51 +02:00
Remita Amine 1016c56cd3 [toggle] Add support for new MeWatch URLs (closes #27256) 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 00fc0dea8c [cspan] Extract info from jwplayer data (closes #3672, closes #3734, … 
…closes #10638, closes #13030, closes #18806, closes #23148, closes #24461, closes #26171, closes #26800, closes #27263)
 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Roman=20Ber=C3=A1nek?= db8e1543b1 [cspan] Pass Referer header with format's video URL (#26032) (closes … 
…#25729)
 2021-10-23 01:06:51 +02:00
Remita Amine cf0fbf895a [mediaset] add support for movie URLs(closes #27240) 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= c7c2b1d972 [yandexmusic:track] Fix extraction (closes #26449, closes #26669, clo… 
…ses #26747, closes #26748, closes #26762)
 2021-10-23 01:06:51 +02:00
Michael Munch 176b13bab2 [drtv] Extend _VALID_URL (#27243) 2021-10-23 01:06:51 +02:00
bopol af3b23c63d [ina] Add support for mobile URLs (#27229) 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Adrian=20Heine=20n=C3=A9=20Lang?= c968fd04de [videa] Adapt to updates (#26301) 
closes #25973, closes #25650.
 2021-10-23 01:06:51 +02:00
Remita Amine c3d9771ac6 [spreaker] fix SpreakerShowIE test URL 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 0f12f211cf [spreaker] Add extractor (closes #13480, closes #13877) 2021-10-23 01:06:51 +02:00
Remita Amine fd0c0b9663 [viki] fix video API request(closes #27184) 2021-10-23 01:06:51 +02:00
Remita Amine 8ebadf3f79 [bbc] fix BBC Three clip extraction 2021-10-23 01:06:51 +02:00
Remita Amine 67f2b570ef [bbc] fix BBC News videos extraction 2021-10-23 01:06:51 +02:00
Remita Amine c7e8522059 [medaltv] improve extraction 2021-10-23 01:06:51 +02:00
Joshua Lochner 7fff37c758 [medaltv] Add new extractor (#27149) 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 8315bccf62 [nrk] Fix extraction 2021-10-23 01:06:51 +02:00
Remita Amine 84e0c2cca9 [pinterest] Add support for large collections(more than 25 pins) 2021-10-23 01:06:51 +02:00
Remita Amine 2aa4d9aab1 [franceinter] flake8 2021-10-23 01:06:51 +02:00
renalid aa8cbb45e3 [franceinter] add thumbnail url (#27153) 
Co-authored-by: remitamine <remitamine@gmail.com>
 2021-10-23 01:06:51 +02:00
Remita Amine 6908e58791 [box] Add new extractor(#5949) 2021-10-23 01:06:51 +02:00
Jia Rong Yee 711ef6c996 [nytimes] Add new cooking.nytimes.com extractor (#27143) 
* [nytimes] support cooking.nytimes.com, resolves #27112

Co-authored-by: remitamine <remitamine@gmail.com>
 2021-10-23 01:06:51 +02:00
Remita Amine f20b6d8dd4 [rumble] add support for embed pages(#10785) 2021-10-23 01:06:51 +02:00
Remita Amine 2fdf3447c1 [skyit] add support for multiple Sky Italia websites(closes #26629) 2021-10-23 01:06:51 +02:00
Remita Amine 1dd494ee31 [extractor/common] add generic support for akamai http format extraction 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 0ffe0d8bbd [pinterest] Add extractor (closes #25747) 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 63d1574bc8 [svtplay] Fix test title 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= c315d7caf0 [svtplay] Add support for svt.se/barnkanalen (closes #24817) 2021-10-23 01:06:51 +02:00
Mattias Wadman b6c66dbc79 [svt] Extract timestamp and thumbnail in more cases (#27130) 
Add timestamp, set to "valid from" which i think could been seen as publish time.
Add thumbnail in more cases, seems to was only done in the embedded data case for some reason.
Switch svtplay test url to an existing video and also one with no expire date.
Also add an additional thumbnail url test regex.
 2021-10-23 01:06:51 +02:00
Remita Amine 4e68d816b3 [infoq] fix format extraction(closes #25984) 2021-10-23 01:06:51 +02:00
renalid eb38071416 [francetv] Update to fix thumbnail URL issue (#27120) 
Fix the thumbnail URL. The issue was here for many years, never fixed. It's done ! :-)

Example : https://www.france.tv/france-2/de-gaulle-l-eclat-et-le-secret/de-gaulle-l-eclat-et-le-secret-saison-1/2035247-solitude.html

failed thumbnail url generated : http://pluzz.francetv.fr/staticftv/ref_emissions/2020-11-02/EMI_1104da66f533cc7dc5d0d07a181a18c2e2fe1d81_20201014122553940.jpg

right thumbnail url fixed : https://sivideo.webservices.francetelevisions.fr/staticftv/ref_emissions/2020-11-02/EMI_1104da66f533cc7dc5d0d07a181a18c2e2fe1d81_20201014122553940.jpg
 2021-10-23 01:06:51 +02:00
Remita Amine bf3df2dd79 [discoverynetworks] add support new TLC/DMAX URLs(closes #27100) 2021-10-23 01:06:50 +02:00
Remita Amine 1b9cc0baff [rai] fix protocol relative relinker URLs(closes #22766) 2021-10-23 01:06:50 +02:00
Remita Amine 9c2afc03ee [rai] fix unavailable video format detection 2021-10-23 01:06:50 +02:00
Remita Amine 081b5611f1 [rai] improve extraction 2021-10-23 01:06:50 +02:00
Leonardo Taccari 1f784e32ec [rai] Fix extraction for recent raiplay.it updates (#27077) 
- Remove first test of RaiPlayIE: it is no longer available
- Make RaiPlayIE extension-agnostic (passing possible `.json' URLs is now
  supported too)
- Adjust RaiPlayLiveIE to recent raiplay.it updates.  Passing it as
  `url_transparent' is no longer supported (there is no longer an accessible
  ContentItem)
- Adjust RaiPlayPlaylistIE to recent raiplay.it updates and instruct it about
  ContentSet-s.
- Update a RaiIE test and remove two tests that are no longer availables

Thanks to @remitamine for the review!
 2021-10-23 01:06:50 +02:00
Remita Amine ab19e26c5d [viki] improve format extraction 2021-10-23 01:06:50 +02:00
beefchop 7f6aa287d7 [viki] fix stream extraction from mpd (#27092) 
Co-authored-by: beefchop <beefchop@users.noreply.github.com>
 2021-10-23 01:06:50 +02:00
Remita Amine 0a76a87779 [amara] improve extraction 2021-10-23 01:06:50 +02:00
Joost Verdoorn 3182075ad6 [Amara] Add new extractor (#20618) 
* [Amara] Add new extractor
 2021-10-23 01:06:50 +02:00
Remita Amine a9fd199643 [vimeo:album] fix extraction(closes #27079) 2021-10-23 01:06:50 +02:00
Remita Amine dc9feaf10e [mtv] fix mgid extraction(closes #26841) 2021-10-23 01:06:50 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 4f7945880e [youporn] Fix upload date extraction and make comment count optional … 
…(closes #26986)
 2021-10-23 01:06:50 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 7910bb7586 [arte] Rework extractors 
* Reimplement embed and playlist extractors to delegate to the single entrypoint artetv extractor
  Beware reluctant download archive extractor keys breakage.
* Improve embeds detection (closes #27057)
- Remove obsolete code
 2021-10-23 01:06:50 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 60ee706bbd [arte] Extract m3u8 formats (closes #27061) 2021-10-23 01:06:50 +02:00
Remita Amine fe97445dc3 [mgtv] fix format extraction(closes #26415) 2021-10-23 01:06:50 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 00a35be6f7 [extractor/common] Output error for invalid URLs in _is_valid_url (re… 
…fs #21400, refs #24151, refs #25617, refs #25618, refs #25586, refs #26068, refs #27072)
 2021-10-23 01:06:50 +02:00
Remita Amine 276aef5dde [francetv] improve info extraction 2021-10-23 01:06:50 +02:00
gdzx c8a6cd5640 [francetv] Add fallback video url extraction (#27047) 
Fallback on another API endpoint when no video formats are found.

Closes ytdl-org#22561
 2021-10-23 01:06:50 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= d445ef16e7 [spiegel] Fix extraction (closes #24206, closes #24767) 
Code picked from PR #24767 since original repo is not available due to takedown.
 2021-10-23 01:06:50 +02:00
Remita Amine f91186eb70 [malltv] fix extraction(closes #27035) 2021-10-23 01:06:50 +02:00
Remita Amine d420d23ad2 [bandcamp] extract playlist_description(closes #22684) 2021-10-23 01:06:50 +02:00
Remita Amine e23e51ca94 [urplay] fix extraction(closes #26828) 2021-10-23 01:06:50 +02:00
Remita Amine 02f491e375 [lrt] fix extraction with empty tags(closes #20264) 2021-10-23 01:06:50 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 71d074ba46 [ndr:embed:base] Extract subtitles (closes #25447, closes #26106) 2021-10-23 01:06:50 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= cb9623206e [servus] Add support for pm-wissen.com (closes #25869) 2021-10-23 01:06:50 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 4b3da7ce47 [servus] Fix extraction (closes #26872, closes #26967, closes #26983,… 
… closes #27000)
 2021-10-23 01:06:50 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 23c968301c [xtube] Fix extraction (closes #26996) 2021-10-23 01:06:50 +02:00
Remita Amine 41ba58cea2 [lrt] fix extraction 2021-10-23 01:06:50 +02:00
Remita Amine 099936f4e6 [condenast] fix extraction and extract subtitles 2021-10-23 01:06:50 +02:00
Remita Amine 3ac79c2585 [bandcamp] fix extraction 2021-10-23 01:06:50 +02:00
Remita Amine fc645d1052 [rai] fix RaiPlay extraction 2021-10-23 01:06:50 +02:00
Remita Amine 065a8e40de [usanetwork] fix extraction 2021-10-23 01:06:50 +02:00
Remita Amine 8ff536d5be [nbc] fix NBCNews/Today/MSNBC extraction 2021-10-23 01:06:50 +02:00
Remita Amine d23d09c709 [cnbc] fix extraction 2021-10-23 01:06:50 +02:00
Laura Liberda f42428e8e0 tvn24: next.js frontend extraction without playwright 
thanks to @ptrcnull
 2021-02-25 15:35:14 +01:00
Laura Liberda 07f5e2ae1c common: next.js data searcher 2021-02-25 15:22:17 +01:00
Laura Liberda 3ac7b35f1b PolskaPress extractor 2021-02-24 17:06:33 +01:00