laudom/haruhi-dl
2
0
Fork 0
Code Issues 13 Pull requests Projects Releases Packages Wiki Activity
18366 commits 2 branches 27 tags 47 MiB
Commit graph

518 commits

Author SHA1 Message Date
Guillem Vela
77a502d82b [ccma] improve metadata extraction(closes #27994) 
- extract age_limit, alt_title, categories, series and episode_number
- fix timestamp multiple subtitles extraction
 2021-10-23 01:06:53 +02:00
Remita Amine
41b390b21e [egghead] fix typo 2021-10-23 01:06:53 +02:00
Viren Rajput
97becd9c42 [egghead] update API domain(closes #28038) 2021-10-23 01:06:53 +02:00
Remita Amine
db09c2ce61 [vidzi] remove extractor(closes #12629) 2021-10-23 01:06:53 +02:00
Remita Amine
5eab5ac665 [vidio] improve metadata extraction 2021-10-23 01:06:53 +02:00
=?UTF-8?q?Adrian=20Heine=20n=C3=A9=20Lang?=
ac7d81f386 [AENetworks] update AENetworksShowIE test playlist id (#27851) 2021-10-23 01:06:52 +02:00
nixxo
4de0c0695a [vvvvid] add support for youtube embeds (#27825) 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Adrian=20Heine=20n=C3=A9=20Lang?=
d78a905c93 [awaan] Extract uploader id (#27963) 2021-10-23 01:06:52 +02:00
Remita Amine
90854501c3 [medialaan] add support DPG Media MyChannels based websites 
closes #14871
closes #15597
closes #16106
closes #16489
 2021-10-23 01:06:52 +02:00
Remita Amine
d7156eead8 [abcnews] fix extraction(closes #12394)(closes #27920) 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Adrian=20Heine=20n=C3=A9=20Lang?=
9f1e642faf [AMP] Fix upload_date and timestamp extraction (#27970) 2021-10-23 01:06:52 +02:00
Remita Amine
e653b73d7b [tv4] relax _VALID_URL(closes #27964) 2021-10-23 01:06:52 +02:00
Remita Amine
72ccf1ea95 [tv2] improve MTV Uutiset Article extraction 2021-10-23 01:06:52 +02:00
tpikonen
4297f217fd [tv2] Add support for mtvuutiset.fi (#27744) 2021-10-23 01:06:52 +02:00
Remita Amine
21a21fdd12 [adn] improve login warning reporting 2021-10-23 01:06:52 +02:00
Remita Amine
6f32443da8 [zype] fix uplynk id extraction(closes #27956) 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Adrian=20Heine=20n=C3=A9=20Lang?=
10e0bc3eeb [ADN] Implement login (#27937) 
closes #17091
closes #27841
 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
e752371a7e [franceculture] Make thumbnail optional (closes #18807) 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Aur=C3=A9lien=20Grosdidier?=
b68a24ee06 [franceculture] Fix extraction (closes #27891) (#27903) 
Co-authored-by: Sergey M. <dstftw@gmail.com>
 2021-10-23 01:06:52 +02:00
aarubui
e6f46e50df [njpwworld] fix extraction (#27890) 2021-10-23 01:06:52 +02:00
Remita Amine
b6aeee6944 [comedycentral] fix extraction(closes #27905) 2021-10-23 01:06:52 +02:00
Remita Amine
89d8d831ab [wat] remove unused variable 2021-10-23 01:06:52 +02:00
Remita Amine
a4afcb7a2f [wat] fix format extraction(closes #27901) 2021-10-23 01:06:52 +02:00
Remita Amine
0ca38e7fb2 [americastestkitchen] improve season extraction 2021-10-23 01:06:52 +02:00
Brian Marks
e4d12c6925 [americastestkitchen] Add support for downloading entire seasons (#27… 
…861)
 2021-10-23 01:06:52 +02:00
Remita Amine
9cd160bcf0 [trovo] Add new extractor(closes #26125) 2021-10-23 01:06:52 +02:00
Remita Amine
78d9c01473 [aol] add support for yahoo videos(closes #26650) 2021-10-23 01:06:52 +02:00
Remita Amine
0aca265418 [yahoo] fix single video extraction 2021-10-23 01:06:52 +02:00
Remita Amine
2287106362 [ninegag] improve extraction 2021-10-23 01:06:52 +02:00
DrWursterich
554ca47216 [9gag] Fix Extraction (#23022) 2021-10-23 01:06:52 +02:00
Brian Marks
23ed695eaa [americastestkitchen] Improve metadata extraction for ATK episodes (#… 
…27860)
 2021-10-23 01:06:52 +02:00
Remita Amine
6e0744819c [aljazeera] fix extraction(closes #20911)(closes #27779) 2021-10-23 01:06:52 +02:00
Remita Amine
81e163b024 [minds] improve extraction 2021-10-23 01:06:52 +02:00
Tatsh
ca4bfa3da3 [Minds] Add new extractor (#17934) 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Adrian=20Heine=20n=C3=A9=20Lang?=
58fa22f684 [ard] Fix title and description extraction and update tests (#27761) 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Adrian=20Heine=20n=C3=A9=20Lang?=
f808eef2f3 [aenetworks] Fix test (#27847) 2021-10-23 01:06:52 +02:00
Remita Amine
6b6c8bf1f0 [spotify] Add new extractor for Spotify Podcasts(closes #27443) 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
79a5e77e79 [mixcloud:playlist:base] Fix video id extraction in flat playlist mod… 
…e (refs #27787)
 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
6f17f97383 [animeondemand] Add support for lazy playlist extraction (closes #27829) 2021-10-23 01:06:52 +02:00
Remita Amine
2dcad362e8 [twitter] Add tests for more cards 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
720ee011e2 [youporn] Restrict fallback download URL (refs #27822) 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
4b782259f2 [youporn] Improve height and tbr extraction (refs #23659, refs #20425) 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
1855ad87cd [youporn] Fix extraction (closes #27822) 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
cd5366e41d [twitter] Add support for unified cards (closes #27826) 2021-10-23 01:06:52 +02:00
main()
6fdbcc1c59 [twitch] Set OAuth token for GraphQL requests using auth-token cookie… 
… (#27790)

Co-authored-by: remitamine <remitamine@gmail.com>
 2021-10-23 01:06:52 +02:00
Aarni Koskela
9fb1f50a15 [Mixcloud] Harmonize ID generation from lists with full ID generation… 
… (#27787)

Mixcloud IDs are generated as `username_slug` when the full ID dict has been
downloaded.  When downloading a list (e.g. uploads, favorites, ...), the temporary
ID is just the `slug`.  This made e.g. archive file usage require the download
of stream metadata before the download can be rejected as already downloaded.

This commit attempts to get the uploader username during the GraphQL query, so the
temporary IDs are generated similarly.
 2021-10-23 01:06:52 +02:00
Remita Amine
e5ef69ca71 [cspan] improve info extraction(closes #27791) 2021-10-23 01:06:52 +02:00
Remita Amine
ca8ab55941 [adn] improve info extraction 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Adrian=20Heine=20n=C3=A9=20Lang?=
258cd9f44e [ADN] Fix extraction (#27732) 
Closes #26963.
 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
12ca40436c [twitch] Improve login error extraction 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
82b487f429 [twitch] Fix authentication (refs #27743) 2021-10-23 01:06:52 +02:00
Remita Amine
7501f94648 [threeqsdn] Improve extraction(closes #21058) 2021-10-23 01:06:52 +02:00
0l-l0
1adc5f4c47 [peertube] Extract files also from streamingPlaylists (#27728) 
JSON objects with an empty "files" tag seem to be a valid PeerTube API
response. In those cases the "files" arrays contained in the
"streamingPlaylists" members can be used instead.
closes #26002
closes #27586
 2021-10-23 01:06:52 +02:00
Remita Amine
9c305e65fb [khanacademy] fix extraction(closes #2887)(closes #26803) 2021-10-23 01:06:52 +02:00
Remita Amine
2c106247f3 [spike] Update Paramount Network feed URL(closes #27715) 2021-10-23 01:06:52 +02:00
nixxo
a447f25d5c [rai] improve subtitles extraction (#27705) 
closes #27698
 2021-10-23 01:06:52 +02:00
Remita Amine
3caed2e161 [canvas] Match only supported VRT NU URLs(#27707) 2021-10-23 01:06:52 +02:00
Remita Amine
1c3eda7037 [extractors] add BibelTVIE import 2021-10-23 01:06:52 +02:00
Remita Amine
84d85be122 [bibeltv] Add new extractor(closes #14361) 2021-10-23 01:06:52 +02:00
Remita Amine
245f1d834f [bfmtv] Add new extractor(closes #16053)(closes #26615) 2021-10-23 01:06:52 +02:00
Remita Amine
da1bf36474 [sbs] Add support for ondemand play and news embed URLs(closes #17650… 
…)(closes #27629)
 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
16ff1e6bdf [twitch] Refactor 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
ced3ed1c25 [twitch] Drop legacy kraken API v5 code altogether 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
0b6351b649 [twitch:vod] Switch to GraphQL for video metadata 2021-10-23 01:06:52 +02:00
Remita Amine
acac4f3f2c [canvas] Fix VRT NU extraction(closes #26957)(closes #27053) 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
3ef8a0fb3d [twitch] Improve access token extraction and remove unused code (clos… 
…es #27646)
 2021-10-23 01:06:52 +02:00
23rd
8ad9ab6bf1 [twitch] Switch access token to GraphQL and refactor. 2021-10-23 01:06:52 +02:00
nixxo
57f417b3cd [rai] Detect ContentItem in iframe (closes #12652) (#27673) 
Co-authored-by: Sergey M. <dstftw@gmail.com>
 2021-10-23 01:06:52 +02:00
Remita Amine
f24ce9e12a [ketnet] fix extraction(closes #27662) 2021-10-23 01:06:52 +02:00
Remita Amine
330c49718a [dplay] Add suport Discovery+ domains(closes #27680) 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
5984740aed [motherless] Fix review issues and improve extraction (closes #26495,… 
… closes #27450)
 2021-10-23 01:06:52 +02:00
cladmi
b3e644ee0d [motherless] Fix recent videos upload date extraction (closes #27661) 
Less than a week old videos use a '20h ago' or '1d ago' format.

I kept the support for 'Ago' with uppercase start at is was already in the code.
 2021-10-23 01:06:52 +02:00
Yurii H
598916af95 [iheart] Update test description value (#27037) 
the description has no HTML tags now.
 2021-10-23 01:06:52 +02:00
Remita Amine
59d82ec275 [nrk] fix extraction for videos without a legalAge rating 2021-10-23 01:06:52 +02:00
Remita Amine
0a8305247c [iheart] clean HTML tags from episode description 2021-10-23 01:06:52 +02:00
Remita Amine
4d731a9917 [iheart] remove print statement 2021-10-23 01:06:52 +02:00
Remita Amine
c23155171b [googleplus] Remove Extractor(closes #4955)(closes #7400) 2021-10-23 01:06:52 +02:00
Remita Amine
5a6c27fd90 [applepodcasts] Add new extractor(#25918) 2021-10-23 01:06:52 +02:00
Remita Amine
12049cc72a [googlepodcasts] Add new extractor 2021-10-23 01:06:52 +02:00
Remita Amine
0c069db053 [iheart] Add new extractor for iHeartRadio(#27037) 2021-10-23 01:06:52 +02:00
Remita Amine
49dc695b8b [acast] clean podcast URLs 2021-10-23 01:06:52 +02:00
Remita Amine
888a8d4c64 [stitcher] clean podcast URLs 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
97cdea36f2 [xfileshare] Add support for aparat.cam (closes #27651) 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
d0177a6f30 [nrktv] Add subtitles test 2021-10-23 01:06:52 +02:00
Remita Amine
881049eef5 [twitter] Add support for summary card(closes #25121) 2021-10-23 01:06:52 +02:00
Remita Amine
a39405150b [twitter] try to use a Generic fallback for unknown twitter cards(clo… 
…ses #25982)
 2021-10-23 01:06:52 +02:00
Remita Amine
f6560b19c4 [stitcher] Add support for shows and show metadata extraction(closes … 
…#20510)
 2021-10-23 01:06:52 +02:00
Remita Amine
7db31b6628 [stv] improve episode id extraction(closes #23083) 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
c09836e567 [nrk] Fix age limit extraction 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
74e9abdd95 [nrk] Improve series metadata extraction (closes #27473) 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
0047ca78b2 [nrk] PEP 8 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
6aa2ce5a53 [nrk] Improve episode and season number extraction 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
dd3fe3a68e [nrktv] Fix tests 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
28011fbf5d [nrk] Improve series metadata extraction 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
d1cc5993a9 [nrk] Extract subtitles 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
ee3e906f25 [nrk] Fix age limit extraction 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
2f5c7ee1f9 [nrk] Inline _extract_from_playback 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
3042ced564 [nrk] Improve video id extraction 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
f78fbf70e7 [nrk] Add more shortcut tests 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
6ed6badbe2 [nrk] Improve extraction (closes #27634, closes #27635) 
+ Add support for mp3 formats
* Generalize and delegate all item extractors to nrk, beware ie key breakages
+ Add support for podcasts
+ Generalize nrk shortcut form to support all kind of ids
 2021-10-23 01:06:52 +02:00