laudom/haruhi-dl
2
0
Fork 0
Code Issues 13 Pull requests Projects Releases Packages Wiki Activity
18375 commits 2 branches 27 tags 47 MiB
Commit graph

524 commits

Author SHA1 Message Date
main()
6fdbcc1c59 [twitch] Set OAuth token for GraphQL requests using auth-token cookie… 
… (#27790)

Co-authored-by: remitamine <remitamine@gmail.com>
 2021-10-23 01:06:52 +02:00
Aarni Koskela
9fb1f50a15 [Mixcloud] Harmonize ID generation from lists with full ID generation… 
… (#27787)

Mixcloud IDs are generated as `username_slug` when the full ID dict has been
downloaded.  When downloading a list (e.g. uploads, favorites, ...), the temporary
ID is just the `slug`.  This made e.g. archive file usage require the download
of stream metadata before the download can be rejected as already downloaded.

This commit attempts to get the uploader username during the GraphQL query, so the
temporary IDs are generated similarly.
 2021-10-23 01:06:52 +02:00
Remita Amine
e5ef69ca71 [cspan] improve info extraction(closes #27791) 2021-10-23 01:06:52 +02:00
Remita Amine
ca8ab55941 [adn] improve info extraction 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Adrian=20Heine=20n=C3=A9=20Lang?=
258cd9f44e [ADN] Fix extraction (#27732) 
Closes #26963.
 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
12ca40436c [twitch] Improve login error extraction 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
82b487f429 [twitch] Fix authentication (refs #27743) 2021-10-23 01:06:52 +02:00
Remita Amine
7501f94648 [threeqsdn] Improve extraction(closes #21058) 2021-10-23 01:06:52 +02:00
0l-l0
1adc5f4c47 [peertube] Extract files also from streamingPlaylists (#27728) 
JSON objects with an empty "files" tag seem to be a valid PeerTube API
response. In those cases the "files" arrays contained in the
"streamingPlaylists" members can be used instead.
closes #26002
closes #27586
 2021-10-23 01:06:52 +02:00
Remita Amine
9c305e65fb [khanacademy] fix extraction(closes #2887)(closes #26803) 2021-10-23 01:06:52 +02:00
Remita Amine
2c106247f3 [spike] Update Paramount Network feed URL(closes #27715) 2021-10-23 01:06:52 +02:00
nixxo
a447f25d5c [rai] improve subtitles extraction (#27705) 
closes #27698
 2021-10-23 01:06:52 +02:00
Remita Amine
3caed2e161 [canvas] Match only supported VRT NU URLs(#27707) 2021-10-23 01:06:52 +02:00
Remita Amine
1c3eda7037 [extractors] add BibelTVIE import 2021-10-23 01:06:52 +02:00
Remita Amine
84d85be122 [bibeltv] Add new extractor(closes #14361) 2021-10-23 01:06:52 +02:00
Remita Amine
245f1d834f [bfmtv] Add new extractor(closes #16053)(closes #26615) 2021-10-23 01:06:52 +02:00
Remita Amine
da1bf36474 [sbs] Add support for ondemand play and news embed URLs(closes #17650… 
…)(closes #27629)
 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
16ff1e6bdf [twitch] Refactor 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
ced3ed1c25 [twitch] Drop legacy kraken API v5 code altogether 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
0b6351b649 [twitch:vod] Switch to GraphQL for video metadata 2021-10-23 01:06:52 +02:00
Remita Amine
acac4f3f2c [canvas] Fix VRT NU extraction(closes #26957)(closes #27053) 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
3ef8a0fb3d [twitch] Improve access token extraction and remove unused code (clos… 
…es #27646)
 2021-10-23 01:06:52 +02:00
23rd
8ad9ab6bf1 [twitch] Switch access token to GraphQL and refactor. 2021-10-23 01:06:52 +02:00
nixxo
57f417b3cd [rai] Detect ContentItem in iframe (closes #12652) (#27673) 
Co-authored-by: Sergey M. <dstftw@gmail.com>
 2021-10-23 01:06:52 +02:00
Remita Amine
f24ce9e12a [ketnet] fix extraction(closes #27662) 2021-10-23 01:06:52 +02:00
Remita Amine
330c49718a [dplay] Add suport Discovery+ domains(closes #27680) 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
5984740aed [motherless] Fix review issues and improve extraction (closes #26495,… 
… closes #27450)
 2021-10-23 01:06:52 +02:00
cladmi
b3e644ee0d [motherless] Fix recent videos upload date extraction (closes #27661) 
Less than a week old videos use a '20h ago' or '1d ago' format.

I kept the support for 'Ago' with uppercase start at is was already in the code.
 2021-10-23 01:06:52 +02:00
Yurii H
598916af95 [iheart] Update test description value (#27037) 
the description has no HTML tags now.
 2021-10-23 01:06:52 +02:00
Remita Amine
59d82ec275 [nrk] fix extraction for videos without a legalAge rating 2021-10-23 01:06:52 +02:00
Remita Amine
0a8305247c [iheart] clean HTML tags from episode description 2021-10-23 01:06:52 +02:00
Remita Amine
4d731a9917 [iheart] remove print statement 2021-10-23 01:06:52 +02:00
Remita Amine
c23155171b [googleplus] Remove Extractor(closes #4955)(closes #7400) 2021-10-23 01:06:52 +02:00
Remita Amine
5a6c27fd90 [applepodcasts] Add new extractor(#25918) 2021-10-23 01:06:52 +02:00
Remita Amine
12049cc72a [googlepodcasts] Add new extractor 2021-10-23 01:06:52 +02:00
Remita Amine
0c069db053 [iheart] Add new extractor for iHeartRadio(#27037) 2021-10-23 01:06:52 +02:00
Remita Amine
49dc695b8b [acast] clean podcast URLs 2021-10-23 01:06:52 +02:00
Remita Amine
888a8d4c64 [stitcher] clean podcast URLs 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
97cdea36f2 [xfileshare] Add support for aparat.cam (closes #27651) 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
d0177a6f30 [nrktv] Add subtitles test 2021-10-23 01:06:52 +02:00
Remita Amine
881049eef5 [twitter] Add support for summary card(closes #25121) 2021-10-23 01:06:52 +02:00
Remita Amine
a39405150b [twitter] try to use a Generic fallback for unknown twitter cards(clo… 
…ses #25982)
 2021-10-23 01:06:52 +02:00
Remita Amine
f6560b19c4 [stitcher] Add support for shows and show metadata extraction(closes … 
…#20510)
 2021-10-23 01:06:52 +02:00
Remita Amine
7db31b6628 [stv] improve episode id extraction(closes #23083) 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
c09836e567 [nrk] Fix age limit extraction 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
74e9abdd95 [nrk] Improve series metadata extraction (closes #27473) 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
0047ca78b2 [nrk] PEP 8 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
6aa2ce5a53 [nrk] Improve episode and season number extraction 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
dd3fe3a68e [nrktv] Fix tests 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
28011fbf5d [nrk] Improve series metadata extraction 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
d1cc5993a9 [nrk] Extract subtitles 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
ee3e906f25 [nrk] Fix age limit extraction 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
2f5c7ee1f9 [nrk] Inline _extract_from_playback 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
3042ced564 [nrk] Improve video id extraction 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
f78fbf70e7 [nrk] Add more shortcut tests 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
6ed6badbe2 [nrk] Improve extraction (closes #27634, closes #27635) 
+ Add support for mp3 formats
* Generalize and delegate all item extractors to nrk, beware ie key breakages
+ Add support for podcasts
+ Generalize nrk shortcut form to support all kind of ids
 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
f224645ac3 [nrktv] Switch to playback endpoint 
mediaelement endpoint is no longer in use.
 2021-10-23 01:06:52 +02:00
Remita Amine
67215062ea [vvvvid] fix season metadata extraction(#18130) 2021-10-23 01:06:52 +02:00
Remita Amine
ca8965d28b [stitcher] fix extraction(closes #20811)(closes #27606) 2021-10-23 01:06:52 +02:00
Remita Amine
91dd4819e8 [acast] fix extraction(closes #21444)(closes #27612)(closes #27613) 2021-10-23 01:06:52 +02:00
Remita Amine
7e985046a0 [arcpublishing] add missing staticmethod decorator 2021-10-23 01:06:52 +02:00
Remita Amine
4336684bca [arcpublishing] Add new extractor 
closes #2298
closes #9340
closes #17200
 2021-10-23 01:06:52 +02:00
Remita Amine
f8af3b480f [sky] add support for Sports News articles and Brighcove videos(close… 
…s #13054)
 2021-10-23 01:06:52 +02:00
Remita Amine
6fec676bf2 [vvvvid] skip unplayable episodes and extract akamai formats(closes #… 
…27599)
 2021-10-23 01:06:52 +02:00
Remita Amine
9014fa950e [yandexvideo] fix extraction for Python 3.4 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
b8ebc9bd91 [redditr] Fix review issues and extract source thumbnail (closes #27503) 2021-10-23 01:06:52 +02:00
ozburo
b83833f1f4 [redditr] Extract all thumbnails 2021-10-23 01:06:52 +02:00
Remita Amine
4f49d50c61 [vvvvid] imporove info extraction 2021-10-23 01:06:52 +02:00
nixxo
8188302a03 [vvvvid] add playlists support (#27574) 
closes #18130
 2021-10-23 01:06:52 +02:00
Remita Amine
2c8306ce89 [yandexdisk] extract info from webpage 
the public API does not return metadata when download limit is reached
 2021-10-23 01:06:52 +02:00
Remita Amine
5643182c7c [yandexdisk] fix extraction(closes #17861)(closes #27131) 2021-10-23 01:06:52 +02:00
Remita Amine
ba2ee853d0 [yandexvideo] use old api call as fallback 2021-10-23 01:06:52 +02:00
Remita Amine
7dc64629d5 [yandexvideo] fix extraction(closes #25000) 2021-10-23 01:06:52 +02:00
Remita Amine
93c2a90d46 [nbc] Remove CSNNE extractor 2021-10-23 01:06:52 +02:00
Remita Amine
21652ea04f [nbc] fix NBCSport VPlayer URL extraction(closes #16640) 2021-10-23 01:06:52 +02:00
Remita Amine
6a185bd70e [aenetworks] fix HistoryPlayerIE tests 2021-10-23 01:06:52 +02:00
Remita Amine
78c85eee12 [aenetworks] add support for biography.com (closes #3863) 2021-10-23 01:06:52 +02:00
Remita Amine
f40b51b20b [uktvplay] match new video URLs(closes #17909) 2021-10-23 01:06:52 +02:00
Remita Amine
03ec618950 [sevenplay] detect API errors 2021-10-23 01:06:52 +02:00
Remita Amine
8215e72574 [tenplay] fix format extraction(closes #26653) 2021-10-23 01:06:52 +02:00
Remita Amine
de72e99bd4 [brightcove] raise ExtractorError for DRM protected videos(closes #23… 
…467)(closes #27568)
 2021-10-23 01:06:52 +02:00
Remita Amine
107ca3cbb4 [aparat] Fix extraction 
closes #22285
closes #22611
closes #23348
closes #24354
closes #24591
closes #24904
closes #25418
closes #26070
closes #26350
closes #26738
closes #27563
 2021-10-23 01:06:52 +02:00
Remita Amine
5a2545d9e1 [brightcove] remove sonyliv specific code 2021-10-23 01:06:52 +02:00
Remita Amine
c75135ffe9 [piksel] import format extraction 2021-10-23 01:06:52 +02:00
Remita Amine
4a4b71739b [zype] Add support for uplynk videos 2021-10-23 01:06:52 +02:00
Remita Amine
c80af1ed8b [toggle] add support for live.mewatch.sg (closes #27555) 2021-10-23 01:06:52 +02:00
JamKage
4174222eb4 [go] Added support for FXNetworks (#26826) 
Co-authored-by: James Kirrage <james.kirrage@mortgagegym.com>

closes #13972
closes #22467
closes #23754
 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
2edeaf4d05 [teachable] Improve embed detection (closes #26923) 2021-10-23 01:06:52 +02:00
Remita Amine
4e37a9ea6c [mitele] fix free video extraction(#24624)(closes #25827)(closes #26757) 2021-10-23 01:06:52 +02:00
Remita Amine
1c1e20603b [telecinco] fix extraction 2021-10-23 01:06:52 +02:00
Sergey M
acd96ffe3c [youtube] Update invidious.snopyta.org (#22667) 
Co-authored-by: sofutru <54445344+sofutru@users.noreply.github.com>
 2021-10-23 01:06:52 +02:00
Remita Amine
a684623f86 [amcnetworks] improve auth only video detection(closes #27548) 2021-10-23 01:06:52 +02:00
Laura Liberda
571c02ab38 VHX embeds 
https://github.com/ytdl-org/youtube-dl/issues/27546
 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
c90c6e0db7 [instagram] Fix test 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
0309b4a494 [instagram] Fix comment count extraction 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
6f05e08af3 [instagram] Add support for reel URLs (closes #26234, closes #26250) 2021-10-23 01:06:52 +02:00
Remita Amine
16f8b4442c [bbc] switch to media selector v6 
closes #23232
closes #23933
closes #26303
closes #26432
closes #26821
closes #27538
 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
36d012f932 [instagram] Improve thumbnail extraction 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
6e617eb2e8 [instagram] Improve extraction (closes #22880) 2021-10-23 01:06:51 +02:00
Andrew Udvare
22c3b77c77 [instagram] Fix extraction when authenticated (closes #27422) 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
ede86727f3 [spankbang] Remove unused import 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
1cb545ef2a [spangbang:playlist] Fix extraction (closes #24087) 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
de08d2ebb6 [spangbang] Add support for playlist videos 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
c7a0d780b6 [pornhub] Fix review issues (closes #27393) 2021-10-23 01:06:51 +02:00
JChris246
6ba48137c2 [pornhub] Fix lq formats extraction (closes #27386) 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
e1b44f86a8 [bongacams] Add extractor (closes #27440) 2021-10-23 01:06:51 +02:00
Remita Amine
1d866fe2b3 [theweatherchannel] fix extraction (closes #25930)(closes #26051) 2021-10-23 01:06:51 +02:00
Remita Amine
ac0b651c35 [sprout] correct typo 2021-10-23 01:06:51 +02:00
Remita Amine
7246d188ec [sprout] Add support for Universal Kids (closes #22518) 2021-10-23 01:06:51 +02:00
Remita Amine
866f1a801d [theplatform] allow passing geo bypass countries from other extractors 2021-10-23 01:06:51 +02:00
Remita Amine
93e7f9943c [ctv] Add new extractor (closes #27525) 2021-10-23 01:06:51 +02:00
Remita Amine
a8abf2770e [9c9media] improve info extraction 2021-10-23 01:06:51 +02:00
Remita Amine
522b9ee05b [sonyliv] fix title for movies 2021-10-23 01:06:51 +02:00
Remita Amine
6baf86c39d [sonyliv] fix extraction(closes #25667) 2021-10-23 01:06:51 +02:00
Remita Amine
14a2647111 [streetvoice] fix extraction(closes #27455)(closes #27492) 2021-10-23 01:06:51 +02:00
Remita Amine
97e449e183 [facebook] add support for watchparty pages(closes #27507) 2021-10-23 01:06:51 +02:00
Remita Amine
ff3bc594e7 [cbslocal] fix video extraction 2021-10-23 01:06:51 +02:00
Remita Amine
50377f35a0 [brightcove] add another method to extract policyKey 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
15058fcdea [mewatch] Relax _VALID_URL (closes #27506) 2021-10-23 01:06:51 +02:00
Remita Amine
25f997a417 [anvato] remove NFLTokenGenerator 
until a better solution is introduced that:
- works with lazy_extractors
- allows for 3rd party token generators
 2021-10-23 01:06:51 +02:00
Remita Amine
23a5bcc4df [tastytrade] Remove Extractor(closes #25716) 
covered by GenericIE via BrighcoveNewIE
 2021-10-23 01:06:51 +02:00
Remita Amine
3e93d39835 [niconico] fix playlist extraction(closes #27428) 2021-10-23 01:06:51 +02:00
Remita Amine
bfd375ccb7 [everyonesmixtape] Remove Extractor 2021-10-23 01:06:51 +02:00
Remita Amine
4dd69eb6fd [kanalplay] Remove Extractor 2021-10-23 01:06:51 +02:00
Remita Amine
8f1118f75d [nba] rewrite extractor 2021-10-23 01:06:51 +02:00
Remita Amine
adbb3cdd89 [turner] improve info extraction 2021-10-23 01:06:51 +02:00
Remita Amine
4969a2783c [common] remove unwanted query params from unsigned akamai manifest URLs 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
86cf5a2aa7 [generic] Improve RSS age limit extraction 2021-10-23 01:06:51 +02:00
renalid
e1b808fa40 [generic] Fix RSS itunes thumbnail extraction (#27405) 2021-10-23 01:06:51 +02:00
Trevor Nelson
1da4c42b9f [redditr] Extract duration (#27426) 2021-10-23 01:06:51 +02:00
Remita Amine
aaabef0220 [anvato] Disable NFLTokenGenerator(closes #27449) 2021-10-23 01:06:51 +02:00
Remita Amine
4eab6d5637 [zaq1] Remove extractor 2021-10-23 01:06:51 +02:00
Remita Amine
76995ec854 [asiancrush] fix extraction and add support for retrocrush.tv 
closes #25577
closes #25829
 2021-10-23 01:06:51 +02:00
Remita Amine
7b2415f4f9 [nfl] fix extraction(closes #22245) 2021-10-23 01:06:51 +02:00
Remita Amine
c2c2b20b39 [anvato] update ANVACK table and add experimental token generator for… 
… NFL
 2021-10-23 01:06:51 +02:00
Remita Amine
a1952d3a0b [sky] relax SkySports URL regex (closes #27435) 2021-10-23 01:06:51 +02:00
Remita Amine
4bc794225a [tv5unis] Add new extractor(closes #22399)(closes #24890) 2021-10-23 01:06:51 +02:00
Remita Amine
a78d792adb [videomore] add support more.tv (closes #27088) 2021-10-23 01:06:51 +02:00
Remita Amine
b2d4c847ed [nhk:program] Add support for audio programs and program clips 2021-10-23 01:06:51 +02:00
Matthew Rayermann
7e6e4c9a29 [nhk] Add support for NHK video programs (#27230) 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
f0db042d42 [mdr] Bypass geo restriction 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
b331a819bc [mdr] Improve extraction (closes #24346, closes #26873) 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
c700190a05 [eporner] Fix view count extraction and make optional (closes #23306) 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
1060552241 [extractor/common] Improve JSON-LD interaction statistic extraction (… 
…refs #23306)
 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
c7e6e03982 [eporner] Fix embed test URL 2021-10-23 01:06:51 +02:00
spvkgn
aa655226dd [eporner] Fix hash extraction and extend _VALID_URL (#27396) 
Co-authored-by: Sergey M <dstftw@gmail.com>
 2021-10-23 01:06:51 +02:00
Remita Amine
948c21b310 [slideslive] use m3u8 entry protocol for m3u8 formats(closes #27400) 2021-10-23 01:06:51 +02:00
Remita Amine
2257ec4792 [twitcasting] fix format extraction and improve info extraction(close… 
…s #24868)
 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
09824dd983 [extractor/common] Document duration meta field for playlists 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
d5b9b7ffc1 [linuxacademy] Fix authentication and extraction (closes #21129, clos… 
…es #26223, closes #27402)
 2021-10-23 01:06:51 +02:00