Commit graph

563 commits

Author SHA1 Message Date
Laura Liberda
e4639cf66f add --use-proxy-sites option 2021-02-27 02:16:00 +01:00
Laura Liberda
44adc8a082 nitter extractor 2021-02-27 01:52:19 +01:00
bopol
6178129851 [nitter] Add new extractor 2021-02-27 01:05:58 +01:00
Laura Liberda
57114f45ea [ipla] reformat code 2021-02-27 00:33:12 +01:00
5a9cef5476 new youtube crypto 2021-02-26 23:46:27 +01:00
Laura Liberda
67692545da fix crash in generic extractor 2021-02-26 18:47:47 +01:00
Alexander Seiler
57da386d5c [srgssr] improve extraction
- extract subtitle
- fix extraction for new videos
- update srf download domains

closes #14717
closes #14725
closes #27231
closes #28238
2021-02-26 18:19:42 +01:00
Remita Amine
302b6ffb09 [vvvvid] reduce season request payload size 2021-02-26 18:19:38 +01:00
nixxo
2b6555f2eb [vvvvid] extract series sublists playlist_title (#27601) (#27618) 2021-02-26 18:19:33 +01:00
Remita Amine
cf883f24cc [dplay] Extract Ad-Free uplynk URLs(#28160) 2021-02-26 18:19:28 +01:00
Remita Amine
36ee1ad35d [wat] detect DRM protected videos(closes #27958) 2021-02-26 18:19:22 +01:00
Remita Amine
ff1ee8a80e [tf1] improve extraction(closes #27980)(closes #28040) 2021-02-26 18:19:16 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
7a3bf913b8 [tmz] Fix and improve extraction (closes #24603, closes #24687, close…
…s #28211)
2021-02-26 18:19:11 +01:00
Remita Amine
77ba700626 [gedidigital] improve asset id matching 2021-02-26 18:19:07 +01:00
nixxo
1c08ff576b [gedidigital] Add new extractor(closes #7347)(closes #26946) 2021-02-26 18:18:58 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
a52155b129 [apa] Improve extraction (closes #27750) 2021-02-26 18:18:33 +01:00
Adrian Heine
21daa7ea91 [apa] Fix extraction 2021-02-26 18:18:28 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
6e796716f9 [youporn] Skip test 2021-02-26 18:18:22 +01:00
piplongrun
a3b6d4d975 [youporn] Extract duration (#28019)
Co-authored-by: Sergey M <dstftw@gmail.com>
2021-02-26 18:18:12 +01:00
Isaac-the-Man
f9fa934413 [samplefocus] Add new extractor(closes #27763) 2021-02-26 18:17:50 +01:00
Remita Amine
fd1c09264d [vimeo] add support for unlisted video source format extraction 2021-02-26 18:17:44 +01:00
Remita Amine
fa6393bfd5 [viki] improve extraction(closes #26522)(closes #28203)
- extract uploader_url and episode_number
- report login required error
- extract 480p formats
- fix API v4 calls
2021-02-26 18:17:39 +01:00
Remita Amine
e3b224a330 [ninegag] unscape title(#28201) 2021-02-26 18:17:34 +01:00
Remita Amine
131c65b8ba [dplay] add support for de.hgtv.com (closes #28182) 2021-02-26 18:17:09 +01:00
Remita Amine
f10f61fa0e [dplay] Add support for discoveryplus.com (closes #24698) 2021-02-26 18:17:01 +01:00
dmsummers
fc9e0b111d [simplecast] Add new extractor(closes #24107) 2021-02-26 18:16:47 +01:00
Stephen Stair
2a7bf89e70 [storyfire] Add new extractor(closes #25628)(closes #26349) 2021-02-26 18:12:05 +01:00
Remita Amine
a5d4fcbbd5 [zhihu] Add new extractor(closes #28177) 2021-02-26 18:11:59 +01:00
Remita Amine
727a4a5b79 [ccma] fix timestamp parsing in python 2 2021-02-26 18:11:46 +01:00
Remita Amine
eb88460be9 [videopress] add support for video.wordpress.com 2021-02-26 18:10:30 +01:00
Remita Amine
3fc10250f2 [kakao] improve info extraction and detect geo restriction(closes #26…
…577)
2021-02-26 18:04:54 +01:00
Remita Amine
221f01621a [xboxclips] fix extraction(closes #27151) 2021-02-26 18:04:46 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
89b41a73aa [ard] Improve formats extraction (closes #28155) 2021-02-26 18:04:40 +01:00
Kevin Velghe
ec2eaef0ca [canvas] Add new extractor for Dagelijkse Kost (#28119) 2021-02-26 18:04:23 +01:00
Remita Amine
87dee740af [ign] fix extraction(closes #24771) 2021-02-26 18:04:15 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
22b2970a2d [xhamster] Extract formats from xplayer settings and extract filesize…
…s (closes #28114)
2021-02-26 18:04:08 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
2df9ac2526 [archiveorg] Fix and improve extraction (closes #21330, closes #23586…
…, closes #25277, closes #26780, closes #27109, closes #27236, closes #28063)
2021-02-26 18:03:59 +01:00
=?UTF-8?q?Adrian=20Heine=20n=C3=A9=20Lang?=
1432a02035 [urplay] Fix extraction (closes #28073) (#28074) 2021-02-26 18:03:49 +01:00
=?UTF-8?q?Adrian=20Heine=20n=C3=A9=20Lang?=
1da3c67651 [azmedien] Fix extraction (#28064) 2021-02-26 18:03:38 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
4d9300cc44 [pornhub] Implement lazy playlist extraction 2021-02-26 18:02:37 +01:00
Sergey M
f21660e963 [pornhub] Add placeholder netrc machine 2021-02-26 18:02:15 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
044b166cda [svtplay] Fix video id extraction (closes #28058) 2021-02-26 18:00:39 +01:00
Sergey M
f2cffa26d4 [pornhub] Add support for authentication (closes #18797, closes #21416, closes #24294) 2021-02-26 18:00:16 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
00fe24846c [pornhub:user] Add support for URLs unavailable via /videos page and …
…improve paging (closes #27853)
2021-02-26 16:28:34 +01:00
Remita Amine
21321d23dc [bravotv] add support for oxygen.com(closes #13357)(closes #22500) 2021-02-26 16:28:28 +01:00
Guillem Vela
6cf6a0cf15 [ccma] improve metadata extraction(closes #27994)
- extract age_limit, alt_title, categories, series and episode_number
- fix timestamp multiple subtitles extraction
2021-02-26 16:28:15 +01:00
Remita Amine
e9b3810524 [egghead] fix typo 2021-02-26 16:26:44 +01:00
Viren Rajput
cd74c846a6 [egghead] update API domain(closes #28038) 2021-02-26 16:26:38 +01:00
Remita Amine
e2095ebc11 [vidzi] remove extractor(closes #12629) 2021-02-26 16:26:30 +01:00
Remita Amine
591d23365c [vidio] improve metadata extraction 2021-02-26 16:26:08 +01:00
=?UTF-8?q?Adrian=20Heine=20n=C3=A9=20Lang?=
aec7e2fbb1 [AENetworks] update AENetworksShowIE test playlist id (#27851) 2021-02-26 16:25:20 +01:00
nixxo
148394b527 [vvvvid] add support for youtube embeds (#27825) 2021-02-26 16:25:08 +01:00
=?UTF-8?q?Adrian=20Heine=20n=C3=A9=20Lang?=
00197b5fa8 [awaan] Extract uploader id (#27963) 2021-02-26 16:24:30 +01:00
Remita Amine
6a18fcbd8a [medialaan] add support DPG Media MyChannels based websites
closes #14871
closes #15597
closes #16106
closes #16489
2021-02-26 16:24:11 +01:00
Remita Amine
8d47c811f1 [abcnews] fix extraction(closes #12394)(closes #27920) 2021-02-26 16:19:08 +01:00
=?UTF-8?q?Adrian=20Heine=20n=C3=A9=20Lang?=
288b2cc25b [AMP] Fix upload_date and timestamp extraction (#27970) 2021-02-26 16:19:03 +01:00
Remita Amine
95fa7a8985 [tv4] relax _VALID_URL(closes #27964) 2021-02-26 16:18:56 +01:00
Remita Amine
743a3f4c00 [tv2] improve MTV Uutiset Article extraction 2021-02-26 16:18:51 +01:00
tpikonen
6e3cdd8515 [tv2] Add support for mtvuutiset.fi (#27744) 2021-02-26 16:18:45 +01:00
Remita Amine
d5cdaae9c8 [adn] improve login warning reporting 2021-02-26 16:18:40 +01:00
Remita Amine
36552561a6 [zype] fix uplynk id extraction(closes #27956) 2021-02-26 16:18:36 +01:00
=?UTF-8?q?Adrian=20Heine=20n=C3=A9=20Lang?=
5c5e031816 [ADN] Implement login (#27937)
closes #17091
closes #27841
2021-02-26 16:18:31 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
b94ec338ad [franceculture] Make thumbnail optional (closes #18807) 2021-02-26 16:18:24 +01:00
=?UTF-8?q?Aur=C3=A9lien=20Grosdidier?=
d2324df444 [franceculture] Fix extraction (closes #27891) (#27903)
Co-authored-by: Sergey M. <dstftw@gmail.com>
2021-02-26 16:18:19 +01:00
aarubui
886d51e368 [njpwworld] fix extraction (#27890) 2021-02-26 16:17:10 +01:00
Remita Amine
48680ac382 [comedycentral] fix extraction(closes #27905) 2021-02-26 16:17:05 +01:00
Remita Amine
8976512791 [wat] remove unused variable 2021-02-26 16:16:59 +01:00
Remita Amine
e5ac4c2a67 [wat] fix format extraction(closes #27901) 2021-02-26 16:16:55 +01:00
Remita Amine
64c8ca8464 [americastestkitchen] improve season extraction 2021-02-26 16:16:44 +01:00
Brian Marks
9b58478829 [americastestkitchen] Add support for downloading entire seasons (#27…
…861)
2021-02-26 16:16:38 +01:00
Remita Amine
d381066e1d [trovo] Add new extractor(closes #26125) 2021-02-26 16:16:18 +01:00
Remita Amine
6e51fd65a8 [aol] add support for yahoo videos(closes #26650) 2021-02-26 16:14:37 +01:00
Remita Amine
6295bb4307 [yahoo] fix single video extraction 2021-02-26 16:14:27 +01:00
Remita Amine
b99e3e93f3 [ninegag] improve extraction 2021-02-26 16:14:21 +01:00
DrWursterich
5a5b791576 [9gag] Fix Extraction (#23022) 2021-02-26 16:14:15 +01:00
Brian Marks
300dfe0df2 [americastestkitchen] Improve metadata extraction for ATK episodes (#…
…27860)
2021-02-26 16:14:08 +01:00
Remita Amine
4d3655d3d9 [aljazeera] fix extraction(closes #20911)(closes #27779) 2021-02-26 16:13:59 +01:00
Remita Amine
6bec24872b [minds] improve extraction 2021-02-26 16:13:55 +01:00
Tatsh
4630d90a5a [Minds] Add new extractor (#17934) 2021-02-26 16:13:47 +01:00
=?UTF-8?q?Adrian=20Heine=20n=C3=A9=20Lang?=
dd74d8e9d0 [ard] Fix title and description extraction and update tests (#27761) 2021-02-26 16:13:38 +01:00
=?UTF-8?q?Adrian=20Heine=20n=C3=A9=20Lang?=
22b81f3cf4 [aenetworks] Fix test (#27847) 2021-02-26 16:13:32 +01:00
Remita Amine
2e2fed69ef [spotify] Add new extractor for Spotify Podcasts(closes #27443) 2021-02-26 16:13:26 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
9167f6a104 [mixcloud:playlist:base] Fix video id extraction in flat playlist mod…
…e (refs #27787)
2021-02-26 16:13:15 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
b55f99df9a [animeondemand] Add support for lazy playlist extraction (closes #27829) 2021-02-26 16:13:09 +01:00
Remita Amine
c613cf5aaa [twitter] Add tests for more cards 2021-02-26 16:12:57 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
43c1032e32 [youporn] Restrict fallback download URL (refs #27822) 2021-02-26 16:12:51 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
7361b972e3 [youporn] Improve height and tbr extraction (refs #23659, refs #20425) 2021-02-26 16:12:46 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
8de14bb3eb [youporn] Fix extraction (closes #27822) 2021-02-26 16:12:41 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
2423972ddc [twitter] Add support for unified cards (closes #27826) 2021-02-26 16:12:36 +01:00
main()
04eccf71c1 [twitch] Set OAuth token for GraphQL requests using auth-token cookie…
… (#27790)

Co-authored-by: remitamine <remitamine@gmail.com>
2021-02-26 16:12:29 +01:00
Aarni Koskela
4737de0eee [Mixcloud] Harmonize ID generation from lists with full ID generation…
… (#27787)

Mixcloud IDs are generated as `username_slug` when the full ID dict has been
downloaded.  When downloading a list (e.g. uploads, favorites, ...), the temporary
ID is just the `slug`.  This made e.g. archive file usage require the download
of stream metadata before the download can be rejected as already downloaded.

This commit attempts to get the uploader username during the GraphQL query, so the
temporary IDs are generated similarly.
2021-02-26 16:12:00 +01:00
Remita Amine
bb8fb80a18 [cspan] improve info extraction(closes #27791) 2021-02-26 16:11:53 +01:00
Remita Amine
8e3ed83758 [adn] improve info extraction 2021-02-26 16:11:47 +01:00
=?UTF-8?q?Adrian=20Heine=20n=C3=A9=20Lang?=
a1c65b0c5f [ADN] Fix extraction (#27732)
Closes #26963.
2021-02-26 16:11:40 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
527cad1c28 [twitch] Improve login error extraction 2021-02-26 16:11:18 +01:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
d695e5396b [twitch] Fix authentication (refs #27743) 2021-02-26 16:11:14 +01:00
Remita Amine
02b371b81e [threeqsdn] Improve extraction(closes #21058) 2021-02-26 16:11:08 +01:00
0l-l0
5e672bbd59 [peertube] Extract files also from streamingPlaylists (#27728)
JSON objects with an empty "files" tag seem to be a valid PeerTube API
response. In those cases the "files" arrays contained in the
"streamingPlaylists" members can be used instead.
closes #26002
closes #27586
2021-02-26 16:10:59 +01:00
Remita Amine
716a12bbe7 [khanacademy] fix extraction(closes #2887)(closes #26803) 2021-02-26 16:10:53 +01:00
Remita Amine
533f1a3d59 [spike] Update Paramount Network feed URL(closes #27715) 2021-02-26 16:10:48 +01:00