Commit graph

695 commits

Author SHA1 Message Date
Remita Amine
8210d0d578 [applepodcasts] fix extraction(closes #28445) 2021-03-20 20:29:16 +01:00
Remita Amine
1df8de409f [rtve] improve extraction
- extract all formats
- fix RTVE Infantil extraction(closes #24851)
- extract is_live and series
2021-03-20 20:29:11 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
bc2dfba575 [southpark] Fix extraction and add support for southparkstudios.com (…
…closes #26763, closes #28413)
2021-03-20 20:29:05 +01:00
Remita Amine
7e5f6863ca [sportdeutschland] fix extraction(closes #21856)(closes #28425) 2021-03-20 20:28:59 +01:00
Remita Amine
8e580fb912 [pinterest] reduce the number of HLS format requests 2021-03-20 20:28:52 +01:00
Remita Amine
a84bff7941 [tver] improve title extraction(closes #28418) 2021-03-20 20:28:41 +01:00
Remita Amine
c07c6fd0bf [fujitv] fix HLS formats extension(closes #28416) 2021-03-20 20:28:35 +01:00
Remita Amine
0bf5bb20bb [shahid] fix format extraction(closes #28383) 2021-03-20 20:28:28 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
19f1ef28f1 [bandcamp] Extract release_timestamp 2021-03-20 20:28:21 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
06a0a2404e Introduce release_timestamp meta field (refs #28386) 2021-03-20 20:28:11 +01:00
Lauren Liberda
b7c5d42047 [pornhub] Detect flagged videos
Original author: dstftw
2021-03-20 20:27:13 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
8332796684 [pornhub] Extract formats from get_media end point (#28395) 2021-03-20 20:25:13 +01:00
Remita Amine
fd211154d3 [bilibili] fix video info extraction(closes #28341) 2021-03-20 20:25:07 +01:00
Remita Amine
e6efc4cc87 [cbs] add support for Paramount+ (closes #28342) 2021-03-20 20:25:02 +01:00
Remita Amine
9f9d5f98fd [trovo] Add Origin header to VOD formats(closes #28346) 2021-03-20 20:24:57 +01:00
Remita Amine
6e95b224c2 [voxmedia] fix volume embed extraction(closes #28338) 2021-03-20 20:24:52 +01:00
Remita Amine
0eab1a6949 [9c9media] fix extraction for videos with multiple ContentPackages(cl…
…oses #28309)
2021-03-20 20:24:44 +01:00
Remita Amine
a28058ddeb [bbc] correct catched exception type 2021-03-20 20:24:38 +01:00
dirkf
62d5e81ff1 [bbc] add support for BBC Reel videos(closes #21870, closes #23660, c…
…loses #28268)
2021-03-20 20:24:32 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
ef668c9585 [zdf] Rework extractors (closes #11606, closes #13473, closes #17354,…
closes #21185, closes #26711, closes #27068, closes #27930, closes #28198, closes #28199, closes #28274)

* Generalize unique video ids for zdf based extractors
* Improve extraction
* Fix 3sat and phoenix
2021-03-20 20:24:19 +01:00
Remita Amine
f67e11c888 [stretchinternet] Fix extraction(closes #28297) 2021-03-20 20:20:26 +01:00
Remita Amine
28d7757c8b [urplay] fix episode data extraction(closes #28292) 2021-03-20 20:20:03 +01:00
Remita Amine
d49b9356ce [bandaichannel] Add new extractor(closes #21404) 2021-03-20 20:19:49 +01:00
Lauren Liberda
efffe9e670 [tvp:embed] extracting video subtitles 2021-03-20 16:13:40 +01:00
Lauren Liberda
8e8af58d04 fix possible crash 2021-03-16 22:23:13 +01:00
Lauren Liberda
4ddca367de support for vtt subtitles in m3u8 manifests 2021-03-16 21:34:15 +01:00
Lauren Liberda
3e7425297f [pulsevideo] unduplicating formats 2021-03-16 15:23:46 +01:00
Lauren Liberda
3b151afce7 [polskieradio] radiokierowcow.pl extractor 2021-03-16 14:57:21 +01:00
Lauren Liberda
999ab0298b [youtube] some formats are now just static 2021-03-15 23:50:56 +01:00
Lauren Liberda
510512606a [youtube] better signature handling for DASH formats 2021-03-15 23:25:24 +01:00
Lauren Liberda
a8e3f00134 [generic] extracting mpd manifests properly 2021-03-14 00:15:17 +01:00
Lauren Liberda
ca57ada0fc + bittorrent magnet extractor 2021-03-12 04:59:48 +01:00
Lauren Liberda
ade6eb8abc [generic] detecting bittorrent manifest files 2021-03-12 04:10:40 +01:00
Lauren Liberda
6f3c4fd2f8 [peertube] bittorrent formats 2021-03-12 03:04:49 +01:00
Lauren Liberda
58538a2c64 initial bittorrent support 2021-03-12 03:04:37 +01:00
Lauren Liberda
3426d75467 [tiktok] hashtag and music extractors 2021-03-11 22:13:57 +01:00
Lauren Liberda
199edacd48 [onnetwork] refactor 2021-03-10 17:58:23 +01:00
Lauren Liberda
9e535b8762 [polskieradio] podcast support 2021-03-09 19:47:12 +01:00
Lauren Liberda
0b5407d6ec [youtube] more descriptive geo-lock messages (with countries) 2021-03-09 18:30:31 +01:00
Timothy Wynn
c10469c0a8 Update go.py 2021-03-07 22:52:29 +01:00
Lauren Liberda
9759eb7182 removed a lot of deprecated platform support code 2021-03-05 22:45:56 +01:00
Lauren Liberda
c42920795e [playwright] more verbose errors if --verbose 2021-03-05 15:41:47 +01:00
Lauren Liberda
0de898ecb5 [youtube] signature function caching 2021-03-04 21:05:12 +01:00
Lauren Liberda
ec0abef671 fix links to ytdl issues 2021-03-04 14:22:51 +01:00
Lauren Liberda
3e69892860 videotarget extractor 2021-03-03 23:15:44 +01:00
Lauren Liberda
3240e9f582 acast player extractor 2021-03-03 20:17:44 +01:00
ba5cda94c7 version 2021.03.01 2021-03-01 23:16:35 +01:00
Lauren Liberda
1786d6c1c4 [peertube] playlist, channel and account extractor 2021-03-01 21:44:26 +01:00
Lauren Liberda
0234f9eacc [cda] logging in with a user account 2021-03-01 18:18:43 +01:00
09b397e541 version 2021.02.27 2021-02-27 02:18:34 +01:00
Laura Liberda
e4639cf66f add --use-proxy-sites option 2021-02-27 02:16:00 +01:00
Laura Liberda
44adc8a082 nitter extractor 2021-02-27 01:52:19 +01:00
bopol
6178129851 [nitter] Add new extractor 2021-02-27 01:05:58 +01:00
Laura Liberda
57114f45ea [ipla] reformat code 2021-02-27 00:33:12 +01:00
c5e2afea28 version 2021.02.26 2021-02-26 23:47:53 +01:00
5a9cef5476 new youtube crypto 2021-02-26 23:46:27 +01:00
Laura Liberda
98be3a5cab make sure py2 throws a deprecation notice 2021-02-26 21:00:17 +01:00
Laura Liberda
67692545da fix crash in generic extractor 2021-02-26 18:47:47 +01:00
Alexander Seiler
57da386d5c [srgssr] improve extraction
- extract subtitle
- fix extraction for new videos
- update srf download domains

closes #14717
closes #14725
closes #27231
closes #28238
2021-02-26 18:19:42 +01:00
Remita Amine
302b6ffb09 [vvvvid] reduce season request payload size 2021-02-26 18:19:38 +01:00
nixxo
2b6555f2eb [vvvvid] extract series sublists playlist_title (#27601) (#27618) 2021-02-26 18:19:33 +01:00
Remita Amine
cf883f24cc [dplay] Extract Ad-Free uplynk URLs(#28160) 2021-02-26 18:19:28 +01:00
Remita Amine
36ee1ad35d [wat] detect DRM protected videos(closes #27958) 2021-02-26 18:19:22 +01:00
Remita Amine
ff1ee8a80e [tf1] improve extraction(closes #27980)(closes #28040) 2021-02-26 18:19:16 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
7a3bf913b8 [tmz] Fix and improve extraction (closes #24603, closes #24687, close…
…s #28211)
2021-02-26 18:19:11 +01:00
Remita Amine
77ba700626 [gedidigital] improve asset id matching 2021-02-26 18:19:07 +01:00
nixxo
1c08ff576b [gedidigital] Add new extractor(closes #7347)(closes #26946) 2021-02-26 18:18:58 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
a52155b129 [apa] Improve extraction (closes #27750) 2021-02-26 18:18:33 +01:00
Adrian Heine
21daa7ea91 [apa] Fix extraction 2021-02-26 18:18:28 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
6e796716f9 [youporn] Skip test 2021-02-26 18:18:22 +01:00
piplongrun
a3b6d4d975 [youporn] Extract duration (#28019)
Co-authored-by: Sergey M <dstftw@gmail.com>
2021-02-26 18:18:12 +01:00
Isaac-the-Man
f9fa934413 [samplefocus] Add new extractor(closes #27763) 2021-02-26 18:17:50 +01:00
Remita Amine
fd1c09264d [vimeo] add support for unlisted video source format extraction 2021-02-26 18:17:44 +01:00
Remita Amine
fa6393bfd5 [viki] improve extraction(closes #26522)(closes #28203)
- extract uploader_url and episode_number
- report login required error
- extract 480p formats
- fix API v4 calls
2021-02-26 18:17:39 +01:00
Remita Amine
e3b224a330 [ninegag] unscape title(#28201) 2021-02-26 18:17:34 +01:00
Remita Amine
131c65b8ba [dplay] add support for de.hgtv.com (closes #28182) 2021-02-26 18:17:09 +01:00
Remita Amine
f10f61fa0e [dplay] Add support for discoveryplus.com (closes #24698) 2021-02-26 18:17:01 +01:00
dmsummers
fc9e0b111d [simplecast] Add new extractor(closes #24107) 2021-02-26 18:16:47 +01:00
Max
f23361c5d2 [postprocessor/embedthumbnail] Recognize atomicparsley binary in lowe…
…rcase (#28112)
2021-02-26 18:12:11 +01:00
Stephen Stair
2a7bf89e70 [storyfire] Add new extractor(closes #25628)(closes #26349) 2021-02-26 18:12:05 +01:00
Remita Amine
a5d4fcbbd5 [zhihu] Add new extractor(closes #28177) 2021-02-26 18:11:59 +01:00
Remita Amine
727a4a5b79 [ccma] fix timestamp parsing in python 2 2021-02-26 18:11:46 +01:00
Remita Amine
eb88460be9 [videopress] add support for video.wordpress.com 2021-02-26 18:10:30 +01:00
Remita Amine
3fc10250f2 [kakao] improve info extraction and detect geo restriction(closes #26…
…577)
2021-02-26 18:04:54 +01:00
Remita Amine
221f01621a [xboxclips] fix extraction(closes #27151) 2021-02-26 18:04:46 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
89b41a73aa [ard] Improve formats extraction (closes #28155) 2021-02-26 18:04:40 +01:00
Kevin Velghe
ec2eaef0ca [canvas] Add new extractor for Dagelijkse Kost (#28119) 2021-02-26 18:04:23 +01:00
Remita Amine
87dee740af [ign] fix extraction(closes #24771) 2021-02-26 18:04:15 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
22b2970a2d [xhamster] Extract formats from xplayer settings and extract filesize…
…s (closes #28114)
2021-02-26 18:04:08 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
2df9ac2526 [archiveorg] Fix and improve extraction (closes #21330, closes #23586…
…, closes #25277, closes #26780, closes #27109, closes #27236, closes #28063)
2021-02-26 18:03:59 +01:00
=?UTF-8?q?Adrian=20Heine=20n=C3=A9=20Lang?=
1432a02035 [urplay] Fix extraction (closes #28073) (#28074) 2021-02-26 18:03:49 +01:00
=?UTF-8?q?Adrian=20Heine=20n=C3=A9=20Lang?=
1da3c67651 [azmedien] Fix extraction (#28064) 2021-02-26 18:03:38 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
4d9300cc44 [pornhub] Implement lazy playlist extraction 2021-02-26 18:02:37 +01:00
Sergey M
f21660e963 [pornhub] Add placeholder netrc machine 2021-02-26 18:02:15 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
044b166cda [svtplay] Fix video id extraction (closes #28058) 2021-02-26 18:00:39 +01:00
Sergey M
f2cffa26d4 [pornhub] Add support for authentication (closes #18797, closes #21416, closes #24294) 2021-02-26 18:00:16 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
00fe24846c [pornhub:user] Add support for URLs unavailable via /videos page and …
…improve paging (closes #27853)
2021-02-26 16:28:34 +01:00
Remita Amine
21321d23dc [bravotv] add support for oxygen.com(closes #13357)(closes #22500) 2021-02-26 16:28:28 +01:00
Guillem Vela
6cf6a0cf15 [ccma] improve metadata extraction(closes #27994)
- extract age_limit, alt_title, categories, series and episode_number
- fix timestamp multiple subtitles extraction
2021-02-26 16:28:15 +01:00
Remita Amine
e9b3810524 [egghead] fix typo 2021-02-26 16:26:44 +01:00
Viren Rajput
cd74c846a6 [egghead] update API domain(closes #28038) 2021-02-26 16:26:38 +01:00
Remita Amine
e2095ebc11 [vidzi] remove extractor(closes #12629) 2021-02-26 16:26:30 +01:00
Remita Amine
591d23365c [vidio] improve metadata extraction 2021-02-26 16:26:08 +01:00
=?UTF-8?q?Adrian=20Heine=20n=C3=A9=20Lang?=
aec7e2fbb1 [AENetworks] update AENetworksShowIE test playlist id (#27851) 2021-02-26 16:25:20 +01:00
nixxo
148394b527 [vvvvid] add support for youtube embeds (#27825) 2021-02-26 16:25:08 +01:00
=?UTF-8?q?Adrian=20Heine=20n=C3=A9=20Lang?=
00197b5fa8 [awaan] Extract uploader id (#27963) 2021-02-26 16:24:30 +01:00
Remita Amine
6a18fcbd8a [medialaan] add support DPG Media MyChannels based websites
closes #14871
closes #15597
closes #16106
closes #16489
2021-02-26 16:24:11 +01:00
Remita Amine
8d47c811f1 [abcnews] fix extraction(closes #12394)(closes #27920) 2021-02-26 16:19:08 +01:00
=?UTF-8?q?Adrian=20Heine=20n=C3=A9=20Lang?=
288b2cc25b [AMP] Fix upload_date and timestamp extraction (#27970) 2021-02-26 16:19:03 +01:00
Remita Amine
95fa7a8985 [tv4] relax _VALID_URL(closes #27964) 2021-02-26 16:18:56 +01:00
Remita Amine
743a3f4c00 [tv2] improve MTV Uutiset Article extraction 2021-02-26 16:18:51 +01:00
tpikonen
6e3cdd8515 [tv2] Add support for mtvuutiset.fi (#27744) 2021-02-26 16:18:45 +01:00
Remita Amine
d5cdaae9c8 [adn] improve login warning reporting 2021-02-26 16:18:40 +01:00
Remita Amine
36552561a6 [zype] fix uplynk id extraction(closes #27956) 2021-02-26 16:18:36 +01:00
=?UTF-8?q?Adrian=20Heine=20n=C3=A9=20Lang?=
5c5e031816 [ADN] Implement login (#27937)
closes #17091
closes #27841
2021-02-26 16:18:31 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
b94ec338ad [franceculture] Make thumbnail optional (closes #18807) 2021-02-26 16:18:24 +01:00
=?UTF-8?q?Aur=C3=A9lien=20Grosdidier?=
d2324df444 [franceculture] Fix extraction (closes #27891) (#27903)
Co-authored-by: Sergey M. <dstftw@gmail.com>
2021-02-26 16:18:19 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
c5f2993484 [options] Clarify --extract-audio help string (closes #27878) 2021-02-26 16:18:10 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
1752b8b8c8 Introduce --output-na-placeholder (closes #27896) 2021-02-26 16:17:36 +01:00
aarubui
886d51e368 [njpwworld] fix extraction (#27890) 2021-02-26 16:17:10 +01:00
Remita Amine
48680ac382 [comedycentral] fix extraction(closes #27905) 2021-02-26 16:17:05 +01:00
Remita Amine
8976512791 [wat] remove unused variable 2021-02-26 16:16:59 +01:00
Remita Amine
e5ac4c2a67 [wat] fix format extraction(closes #27901) 2021-02-26 16:16:55 +01:00
Remita Amine
64c8ca8464 [americastestkitchen] improve season extraction 2021-02-26 16:16:44 +01:00
Brian Marks
9b58478829 [americastestkitchen] Add support for downloading entire seasons (#27…
…861)
2021-02-26 16:16:38 +01:00
Remita Amine
d381066e1d [trovo] Add new extractor(closes #26125) 2021-02-26 16:16:18 +01:00
Remita Amine
6e51fd65a8 [aol] add support for yahoo videos(closes #26650) 2021-02-26 16:14:37 +01:00
Remita Amine
6295bb4307 [yahoo] fix single video extraction 2021-02-26 16:14:27 +01:00
Remita Amine
b99e3e93f3 [ninegag] improve extraction 2021-02-26 16:14:21 +01:00
DrWursterich
5a5b791576 [9gag] Fix Extraction (#23022) 2021-02-26 16:14:15 +01:00
Brian Marks
300dfe0df2 [americastestkitchen] Improve metadata extraction for ATK episodes (#…
…27860)
2021-02-26 16:14:08 +01:00
Remita Amine
4d3655d3d9 [aljazeera] fix extraction(closes #20911)(closes #27779) 2021-02-26 16:13:59 +01:00
Remita Amine
6bec24872b [minds] improve extraction 2021-02-26 16:13:55 +01:00
Tatsh
4630d90a5a [Minds] Add new extractor (#17934) 2021-02-26 16:13:47 +01:00
=?UTF-8?q?Adrian=20Heine=20n=C3=A9=20Lang?=
dd74d8e9d0 [ard] Fix title and description extraction and update tests (#27761) 2021-02-26 16:13:38 +01:00
=?UTF-8?q?Adrian=20Heine=20n=C3=A9=20Lang?=
22b81f3cf4 [aenetworks] Fix test (#27847) 2021-02-26 16:13:32 +01:00
Remita Amine
2e2fed69ef [spotify] Add new extractor for Spotify Podcasts(closes #27443) 2021-02-26 16:13:26 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
9167f6a104 [mixcloud:playlist:base] Fix video id extraction in flat playlist mod…
…e (refs #27787)
2021-02-26 16:13:15 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
b55f99df9a [animeondemand] Add support for lazy playlist extraction (closes #27829) 2021-02-26 16:13:09 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
cc74091612 [YoutubeDL] Protect from infinite recursion due to recursively nested…
… playlists (closes #27833)
2021-02-26 16:13:02 +01:00
Remita Amine
c613cf5aaa [twitter] Add tests for more cards 2021-02-26 16:12:57 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
43c1032e32 [youporn] Restrict fallback download URL (refs #27822) 2021-02-26 16:12:51 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
7361b972e3 [youporn] Improve height and tbr extraction (refs #23659, refs #20425) 2021-02-26 16:12:46 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
8de14bb3eb [youporn] Fix extraction (closes #27822) 2021-02-26 16:12:41 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
2423972ddc [twitter] Add support for unified cards (closes #27826) 2021-02-26 16:12:36 +01:00
main()
04eccf71c1 [twitch] Set OAuth token for GraphQL requests using auth-token cookie…
… (#27790)

Co-authored-by: remitamine <remitamine@gmail.com>
2021-02-26 16:12:29 +01:00
Aaron Zeng
e225806484 [YoutubeDL] Ignore failure to create existing directory (#27811) 2021-02-26 16:12:22 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
5b7e334c86 [YoutubeDL] Raise syntax error for format selection expressions with …
…multiple + operators (closes #27803)
2021-02-26 16:12:06 +01:00
Aarni Koskela
4737de0eee [Mixcloud] Harmonize ID generation from lists with full ID generation…
… (#27787)

Mixcloud IDs are generated as `username_slug` when the full ID dict has been
downloaded.  When downloading a list (e.g. uploads, favorites, ...), the temporary
ID is just the `slug`.  This made e.g. archive file usage require the download
of stream metadata before the download can be rejected as already downloaded.

This commit attempts to get the uploader username during the GraphQL query, so the
temporary IDs are generated similarly.
2021-02-26 16:12:00 +01:00
Remita Amine
bb8fb80a18 [cspan] improve info extraction(closes #27791) 2021-02-26 16:11:53 +01:00