lunax/haruhi-dl
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity
18355 commits 2 branches 26 tags 46 MiB
Commit graph

541 commits

Author SHA1 Message Date
nixxo
148394b527 [vvvvid] add support for youtube embeds (#27825) 2021-02-26 16:25:08 +01:00
=?UTF-8?q?Adrian=20Heine=20n=C3=A9=20Lang?=
00197b5fa8 [awaan] Extract uploader id (#27963) 2021-02-26 16:24:30 +01:00
Remita Amine
6a18fcbd8a [medialaan] add support DPG Media MyChannels based websites 
closes #14871
closes #15597
closes #16106
closes #16489
 2021-02-26 16:24:11 +01:00
Remita Amine
8d47c811f1 [abcnews] fix extraction(closes #12394)(closes #27920) 2021-02-26 16:19:08 +01:00
=?UTF-8?q?Adrian=20Heine=20n=C3=A9=20Lang?=
288b2cc25b [AMP] Fix upload_date and timestamp extraction (#27970) 2021-02-26 16:19:03 +01:00
Remita Amine
95fa7a8985 [tv4] relax _VALID_URL(closes #27964) 2021-02-26 16:18:56 +01:00
Remita Amine
743a3f4c00 [tv2] improve MTV Uutiset Article extraction 2021-02-26 16:18:51 +01:00
tpikonen
6e3cdd8515 [tv2] Add support for mtvuutiset.fi (#27744) 2021-02-26 16:18:45 +01:00
Remita Amine
d5cdaae9c8 [adn] improve login warning reporting 2021-02-26 16:18:40 +01:00
Remita Amine
36552561a6 [zype] fix uplynk id extraction(closes #27956) 2021-02-26 16:18:36 +01:00
=?UTF-8?q?Adrian=20Heine=20n=C3=A9=20Lang?=
5c5e031816 [ADN] Implement login (#27937) 
closes #17091
closes #27841
 2021-02-26 16:18:31 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
b94ec338ad [franceculture] Make thumbnail optional (closes #18807) 2021-02-26 16:18:24 +01:00
=?UTF-8?q?Aur=C3=A9lien=20Grosdidier?=
d2324df444 [franceculture] Fix extraction (closes #27891) (#27903) 
Co-authored-by: Sergey M. <dstftw@gmail.com>
 2021-02-26 16:18:19 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
c5f2993484 [options] Clarify --extract-audio help string (closes #27878) 2021-02-26 16:18:10 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
1752b8b8c8 Introduce --output-na-placeholder (closes #27896) 2021-02-26 16:17:36 +01:00
aarubui
886d51e368 [njpwworld] fix extraction (#27890) 2021-02-26 16:17:10 +01:00
Remita Amine
48680ac382 [comedycentral] fix extraction(closes #27905) 2021-02-26 16:17:05 +01:00
Remita Amine
8976512791 [wat] remove unused variable 2021-02-26 16:16:59 +01:00
Remita Amine
e5ac4c2a67 [wat] fix format extraction(closes #27901) 2021-02-26 16:16:55 +01:00
Remita Amine
64c8ca8464 [americastestkitchen] improve season extraction 2021-02-26 16:16:44 +01:00
Brian Marks
9b58478829 [americastestkitchen] Add support for downloading entire seasons (#27… 
…861)
 2021-02-26 16:16:38 +01:00
Remita Amine
d381066e1d [trovo] Add new extractor(closes #26125) 2021-02-26 16:16:18 +01:00
Remita Amine
6e51fd65a8 [aol] add support for yahoo videos(closes #26650) 2021-02-26 16:14:37 +01:00
Remita Amine
6295bb4307 [yahoo] fix single video extraction 2021-02-26 16:14:27 +01:00
Remita Amine
b99e3e93f3 [ninegag] improve extraction 2021-02-26 16:14:21 +01:00
DrWursterich
5a5b791576 [9gag] Fix Extraction (#23022) 2021-02-26 16:14:15 +01:00
Brian Marks
300dfe0df2 [americastestkitchen] Improve metadata extraction for ATK episodes (#… 
…27860)
 2021-02-26 16:14:08 +01:00
Remita Amine
4d3655d3d9 [aljazeera] fix extraction(closes #20911)(closes #27779) 2021-02-26 16:13:59 +01:00
Remita Amine
6bec24872b [minds] improve extraction 2021-02-26 16:13:55 +01:00
Tatsh
4630d90a5a [Minds] Add new extractor (#17934) 2021-02-26 16:13:47 +01:00
=?UTF-8?q?Adrian=20Heine=20n=C3=A9=20Lang?=
dd74d8e9d0 [ard] Fix title and description extraction and update tests (#27761) 2021-02-26 16:13:38 +01:00
=?UTF-8?q?Adrian=20Heine=20n=C3=A9=20Lang?=
22b81f3cf4 [aenetworks] Fix test (#27847) 2021-02-26 16:13:32 +01:00
Remita Amine
2e2fed69ef [spotify] Add new extractor for Spotify Podcasts(closes #27443) 2021-02-26 16:13:26 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
9167f6a104 [mixcloud:playlist:base] Fix video id extraction in flat playlist mod… 
…e (refs #27787)
 2021-02-26 16:13:15 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
b55f99df9a [animeondemand] Add support for lazy playlist extraction (closes #27829) 2021-02-26 16:13:09 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
cc74091612 [YoutubeDL] Protect from infinite recursion due to recursively nested… 
… playlists (closes #27833)
 2021-02-26 16:13:02 +01:00
Remita Amine
c613cf5aaa [twitter] Add tests for more cards 2021-02-26 16:12:57 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
43c1032e32 [youporn] Restrict fallback download URL (refs #27822) 2021-02-26 16:12:51 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
7361b972e3 [youporn] Improve height and tbr extraction (refs #23659, refs #20425) 2021-02-26 16:12:46 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
8de14bb3eb [youporn] Fix extraction (closes #27822) 2021-02-26 16:12:41 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
2423972ddc [twitter] Add support for unified cards (closes #27826) 2021-02-26 16:12:36 +01:00
main()
04eccf71c1 [twitch] Set OAuth token for GraphQL requests using auth-token cookie… 
… (#27790)

Co-authored-by: remitamine <remitamine@gmail.com>
 2021-02-26 16:12:29 +01:00
Aaron Zeng
e225806484 [YoutubeDL] Ignore failure to create existing directory (#27811) 2021-02-26 16:12:22 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
5b7e334c86 [YoutubeDL] Raise syntax error for format selection expressions with … 
…multiple + operators (closes #27803)
 2021-02-26 16:12:06 +01:00
Aarni Koskela
4737de0eee [Mixcloud] Harmonize ID generation from lists with full ID generation… 
… (#27787)

Mixcloud IDs are generated as `username_slug` when the full ID dict has been
downloaded.  When downloading a list (e.g. uploads, favorites, ...), the temporary
ID is just the `slug`.  This made e.g. archive file usage require the download
of stream metadata before the download can be rejected as already downloaded.

This commit attempts to get the uploader username during the GraphQL query, so the
temporary IDs are generated similarly.
 2021-02-26 16:12:00 +01:00
Remita Amine
bb8fb80a18 [cspan] improve info extraction(closes #27791) 2021-02-26 16:11:53 +01:00
Remita Amine
8e3ed83758 [adn] improve info extraction 2021-02-26 16:11:47 +01:00
=?UTF-8?q?Adrian=20Heine=20n=C3=A9=20Lang?=
a1c65b0c5f [ADN] Fix extraction (#27732) 
Closes #26963.
 2021-02-26 16:11:40 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
527cad1c28 [twitch] Improve login error extraction 2021-02-26 16:11:18 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
d695e5396b [twitch] Fix authentication (refs #27743) 2021-02-26 16:11:14 +01:00
Remita Amine
02b371b81e [threeqsdn] Improve extraction(closes #21058) 2021-02-26 16:11:08 +01:00
0l-l0
5e672bbd59 [peertube] Extract files also from streamingPlaylists (#27728) 
JSON objects with an empty "files" tag seem to be a valid PeerTube API
response. In those cases the "files" arrays contained in the
"streamingPlaylists" members can be used instead.
closes #26002
closes #27586
 2021-02-26 16:10:59 +01:00
Remita Amine
716a12bbe7 [khanacademy] fix extraction(closes #2887)(closes #26803) 2021-02-26 16:10:53 +01:00
Remita Amine
533f1a3d59 [spike] Update Paramount Network feed URL(closes #27715) 2021-02-26 16:10:48 +01:00
nixxo
3311732cc4 [rai] improve subtitles extraction (#27705) 
closes #27698
 2021-02-26 16:10:40 +01:00
Remita Amine
d445754878 [canvas] Match only supported VRT NU URLs(#27707) 2021-02-26 16:10:31 +01:00
Remita Amine
c20b7305d7 [extractors] add BibelTVIE import 2021-02-26 16:10:26 +01:00
Remita Amine
d09dc9da38 [bibeltv] Add new extractor(closes #14361) 2021-02-26 16:10:21 +01:00
Remita Amine
ba94de7b0d [bfmtv] Add new extractor(closes #16053)(closes #26615) 2021-02-26 16:10:17 +01:00
Remita Amine
b1b5f6effe [sbs] Add support for ondemand play and news embed URLs(closes #17650… 
…)(closes #27629)
 2021-02-26 16:10:13 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
c80f8c2006 [twitch] Refactor 2021-02-26 16:10:08 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
d83dfdc63a [twitch] Drop legacy kraken API v5 code altogether 2021-02-26 16:10:04 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
ff8d551021 [twitch:vod] Switch to GraphQL for video metadata 2021-02-26 16:10:00 +01:00
Remita Amine
ff330d9727 [canvas] Fix VRT NU extraction(closes #26957)(closes #27053) 2021-02-26 16:09:56 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
189885594b [twitch] Improve access token extraction and remove unused code (clos… 
…es #27646)
 2021-02-26 16:09:51 +01:00
23rd
948dc5834d [twitch] Switch access token to GraphQL and refactor. 2021-02-26 16:09:46 +01:00
nixxo
24f5760134 [rai] Detect ContentItem in iframe (closes #12652) (#27673) 
Co-authored-by: Sergey M. <dstftw@gmail.com>
 2021-02-26 16:09:42 +01:00
Remita Amine
eb001126da [ketnet] fix extraction(closes #27662) 2021-02-26 16:09:38 +01:00
Remita Amine
7f4e988520 [dplay] Add suport Discovery+ domains(closes #27680) 2021-02-26 16:09:33 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
e94762a1a7 [motherless] Fix review issues and improve extraction (closes #26495,… 
… closes #27450)
 2021-02-26 16:09:21 +01:00
cladmi
a72df1d249 [motherless] Fix recent videos upload date extraction (closes #27661) 
Less than a week old videos use a '20h ago' or '1d ago' format.

I kept the support for 'Ago' with uppercase start at is was already in the code.
 2021-02-26 16:09:15 +01:00
Kevin O'Connor
903c90bd4c [downloader/hls] Disable decryption in tests (#27660) 
Tests truncate the download to 10241 bytes, which is not divisible by 16
and cannot be decrypted. Tests don't really care about the decrypted
content, just that the data they retrieved is the expected data.
Therefore, it's fine to just return the encrypted data to tests.

See: #27621 and #27620
 2021-02-26 16:08:56 +01:00
Yurii H
055e9eb904 [iheart] Update test description value (#27037) 
the description has no HTML tags now.
 2021-02-26 16:08:50 +01:00
Remita Amine
25dff12eb1 [nrk] fix extraction for videos without a legalAge rating 2021-02-26 16:08:44 +01:00
Remita Amine
67ff5da6ea [iheart] clean HTML tags from episode description 2021-02-26 16:08:39 +01:00
Remita Amine
8818f177ab [iheart] remove print statement 2021-02-26 16:08:34 +01:00
Remita Amine
1dc43fd3fc [googleplus] Remove Extractor(closes #4955)(closes #7400) 2021-02-26 16:08:27 +01:00
Remita Amine
607b324dff [applepodcasts] Add new extractor(#25918) 2021-02-26 16:08:20 +01:00
Remita Amine
1b1752a1b5 [googlepodcasts] Add new extractor 2021-02-26 16:08:15 +01:00
Remita Amine
e52adb5328 [iheart] Add new extractor for iHeartRadio(#27037) 2021-02-26 16:06:26 +01:00
Remita Amine
626d26e13a [acast] clean podcast URLs 2021-02-26 16:06:22 +01:00
Remita Amine
1e653be1d0 [stitcher] clean podcast URLs 2021-02-26 16:06:16 +01:00
Remita Amine
017215032a [utils] add a function to clean podcast URLs 2021-02-26 16:06:12 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
e98e8454c5 [xfileshare] Add support for aparat.cam (closes #27651) 2021-02-26 16:06:04 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
a22e2b59b4 [nrktv] Add subtitles test 2021-02-26 16:06:00 +01:00
Remita Amine
3f2bf67bc9 [twitter] Add support for summary card(closes #25121) 2021-02-26 16:05:55 +01:00
Remita Amine
28c4062a58 [twitter] try to use a Generic fallback for unknown twitter cards(clo… 
…ses #25982)
 2021-02-26 16:05:50 +01:00
Remita Amine
3f43c99d4a [stitcher] Add support for shows and show metadata extraction(closes … 
…#20510)
 2021-02-26 16:05:44 +01:00
Remita Amine
8406b57ac6 [stv] improve episode id extraction(closes #23083) 2021-02-26 16:05:39 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
8e538fc605 [nrk] Fix age limit extraction 2021-02-26 16:05:31 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
b51ed7b039 [nrk] Improve series metadata extraction (closes #27473) 2021-02-26 16:05:26 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
785078cb08 [nrk] PEP 8 2021-02-26 16:05:21 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
57a63ed4a1 [nrk] Improve episode and season number extraction 2021-02-26 16:05:12 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
c00a4d81ca [nrktv] Fix tests 2021-02-26 16:05:07 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
aa829b6cd3 [nrk] Improve series metadata extraction 2021-02-26 16:04:49 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
db48c8dbfe [nrk] Extract subtitles 2021-02-26 16:04:44 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
eff203d3ae [nrk] Fix age limit extraction 2021-02-26 16:04:38 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
d9673551d7 [nrk] Inline _extract_from_playback 2021-02-26 16:04:34 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
634ebea93d [nrk] Improve video id extraction 2021-02-26 16:04:15 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
e1145c77fd [nrk] Add more shortcut tests 2021-02-26 16:04:08 +01:00