Commit graph

668 commits

Author SHA1 Message Date
=?UTF-8?q?Sergey=20M=E2=80=A4?= b8f1f10baa [yandexmusic:album] Simplify 2021-10-23 01:06:53 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 51b98e969c [yandexmusic] Add support for music.yandex.com (closes #27425) 2021-10-23 01:06:53 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 78c346bb86 [yandexmusic] DRY _VALID_URL base 2021-10-23 01:06:53 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 1607edbfe5 [yandexmusic:album] Improve album title extraction (closes #27418) 2021-10-23 01:06:53 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 56a1c8a862 [yandexmusic] Refactor and add support for artist's tracks and albums…
… (closes #11887, closes #22284)
2021-10-23 01:06:53 +02:00
Lauren Liberda bfa15434b6 [peertube] improve thumbnail extraction
Original author: remitamine
2021-10-23 01:06:53 +02:00
Lauren Liberda 7bc8f716ac [PATCH] [vimeo:album] Fix extraction for albums with number of videos multiple to page size
Original author: dstftw
2021-10-23 01:06:53 +02:00
Remita Amine 0d8471c5cd [vvvvid] fix kenc format extraction(closes #28473) 2021-10-23 01:06:53 +02:00
Remita Amine a19efaf4f2 [mlb] fix video extracion(#21241) 2021-10-23 01:06:53 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 2395913191 [svtplay] Improve extraction (closes #28448) 2021-10-23 01:06:53 +02:00
Remita Amine 92838c24a7 [applepodcasts] fix extraction(closes #28445) 2021-10-23 01:06:53 +02:00
Remita Amine 139349577f [rtve] improve extraction
- extract all formats
- fix RTVE Infantil extraction(closes #24851)
- extract is_live and series
2021-10-23 01:06:53 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= fe7f2f4665 [southpark] Fix extraction and add support for southparkstudios.com (…
…closes #26763, closes #28413)
2021-10-23 01:06:53 +02:00
Remita Amine b4565ba80a [sportdeutschland] fix extraction(closes #21856)(closes #28425) 2021-10-23 01:06:53 +02:00
Remita Amine 62e95de9b8 [pinterest] reduce the number of HLS format requests 2021-10-23 01:06:53 +02:00
Remita Amine a14cdc8911 [tver] improve title extraction(closes #28418) 2021-10-23 01:06:53 +02:00
Remita Amine 1ae0b09ce7 [fujitv] fix HLS formats extension(closes #28416) 2021-10-23 01:06:53 +02:00
Remita Amine 5a7b034588 [shahid] fix format extraction(closes #28383) 2021-10-23 01:06:53 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 5302d7deb5 [bandcamp] Extract release_timestamp 2021-10-23 01:06:53 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 7cd709a8d6 Introduce release_timestamp meta field (refs #28386) 2021-10-23 01:06:53 +02:00
Lauren Liberda 184e14106d [pornhub] Detect flagged videos
Original author: dstftw
2021-10-23 01:06:53 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 6342cb9395 [pornhub] Extract formats from get_media end point (#28395) 2021-10-23 01:06:53 +02:00
Remita Amine 0f5a738cb8 [bilibili] fix video info extraction(closes #28341) 2021-10-23 01:06:53 +02:00
Remita Amine c43af05b3f [cbs] add support for Paramount+ (closes #28342) 2021-10-23 01:06:53 +02:00
Remita Amine 3f6c70d7fd [trovo] Add Origin header to VOD formats(closes #28346) 2021-10-23 01:06:53 +02:00
Remita Amine 3f8ceb92d6 [voxmedia] fix volume embed extraction(closes #28338) 2021-10-23 01:06:53 +02:00
Remita Amine c906fbd026 [9c9media] fix extraction for videos with multiple ContentPackages(cl…
…oses #28309)
2021-10-23 01:06:53 +02:00
Remita Amine be01b75623 [bbc] correct catched exception type 2021-10-23 01:06:53 +02:00
dirkf a13d30df60 [bbc] add support for BBC Reel videos(closes #21870, closes #23660, c…
…loses #28268)
2021-10-23 01:06:53 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 9e2d1d79af [zdf] Rework extractors (closes #11606, closes #13473, closes #17354,…
closes #21185, closes #26711, closes #27068, closes #27930, closes #28198, closes #28199, closes #28274)

* Generalize unique video ids for zdf based extractors
* Improve extraction
* Fix 3sat and phoenix
2021-10-23 01:06:53 +02:00
Remita Amine 87d2884a39 [stretchinternet] Fix extraction(closes #28297) 2021-10-23 01:06:53 +02:00
Remita Amine 21755dfd0b [urplay] fix episode data extraction(closes #28292) 2021-10-23 01:06:53 +02:00
Remita Amine f7f18a1f95 [bandaichannel] Add new extractor(closes #21404) 2021-10-23 01:06:53 +02:00
Lauren Liberda 76dd2ae2c6 [tvp:embed] extracting video subtitles 2021-10-23 01:06:53 +02:00
Lauren Liberda 84412f41fa support for vtt subtitles in m3u8 manifests 2021-10-23 01:06:53 +02:00
Lauren Liberda d506825a5c [pulsevideo] unduplicating formats 2021-10-23 01:06:53 +02:00
Lauren Liberda 98a2f0c8fe [polskieradio] radiokierowcow.pl extractor 2021-10-23 01:06:53 +02:00
Lauren Liberda 01e9b4552b [youtube] some formats are now just static 2021-10-23 01:06:53 +02:00
Lauren Liberda 28d1709c91 [youtube] better signature handling for DASH formats 2021-10-23 01:06:53 +02:00
Lauren Liberda e150971ea7 [generic] extracting mpd manifests properly 2021-10-23 01:06:53 +02:00
Lauren Liberda c8a9e64511 + bittorrent magnet extractor 2021-10-23 01:06:53 +02:00
Lauren Liberda b36bfac24e [generic] detecting bittorrent manifest files 2021-10-23 01:06:53 +02:00
Lauren Liberda 21c370bf29 [peertube] bittorrent formats 2021-10-23 01:06:53 +02:00
Lauren Liberda 81f0034a12 initial bittorrent support 2021-10-23 01:06:53 +02:00
Lauren Liberda 503f2b988e [tiktok] hashtag and music extractors 2021-10-23 01:06:53 +02:00
Lauren Liberda 9fb4a5decb [onnetwork] refactor 2021-10-23 01:06:53 +02:00
Lauren Liberda 6856478350 [polskieradio] podcast support 2021-10-23 01:06:53 +02:00
Lauren Liberda 5bb9c5e53e [youtube] more descriptive geo-lock messages (with countries) 2021-10-23 01:06:53 +02:00
Timothy Wynn 79002a5092 Update go.py 2021-10-23 01:06:53 +02:00
Lauren Liberda ec881dd98d [youtube] signature function caching 2021-10-23 01:06:53 +02:00
Lauren Liberda 99ae610f74 fix links to ytdl issues 2021-10-23 01:06:53 +02:00
Lauren Liberda 2930f4f593 videotarget extractor 2021-10-23 01:06:53 +02:00
Lauren Liberda 5c09f8a7db acast player extractor 2021-10-23 01:06:53 +02:00
Lauren Liberda 5f73fa1c26 [peertube] playlist, channel and account extractor 2021-10-23 01:06:53 +02:00
Lauren Liberda d52e39ac13 [cda] logging in with a user account 2021-10-23 01:06:53 +02:00
Laura Liberda 9d7059a4a9 add --use-proxy-sites option 2021-10-23 01:06:53 +02:00
Laura Liberda 12e6f64462 nitter extractor 2021-10-23 01:06:53 +02:00
bopol 521dc1f82c [nitter] Add new extractor 2021-10-23 01:06:53 +02:00
Laura Liberda 7989d4c448 [ipla] reformat code 2021-10-23 01:06:53 +02:00
Dominika Liberda 39fbd9c21b new youtube crypto 2021-10-23 01:06:53 +02:00
Laura Liberda d06a708d58 fix crash in generic extractor 2021-10-23 01:06:53 +02:00
Alexander Seiler 43b1927fe4 [srgssr] improve extraction
- extract subtitle
- fix extraction for new videos
- update srf download domains

closes #14717
closes #14725
closes #27231
closes #28238
2021-10-23 01:06:53 +02:00
Remita Amine aba0fad66e [vvvvid] reduce season request payload size 2021-10-23 01:06:53 +02:00
nixxo 785d9930cb [vvvvid] extract series sublists playlist_title (#27601) (#27618) 2021-10-23 01:06:53 +02:00
Remita Amine fe62eeb47b [dplay] Extract Ad-Free uplynk URLs(#28160) 2021-10-23 01:06:53 +02:00
Remita Amine 9c66db7689 [wat] detect DRM protected videos(closes #27958) 2021-10-23 01:06:53 +02:00
Remita Amine 0ed4a821b8 [tf1] improve extraction(closes #27980)(closes #28040) 2021-10-23 01:06:53 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 4a1a901bd3 [tmz] Fix and improve extraction (closes #24603, closes #24687, close…
…s #28211)
2021-10-23 01:06:53 +02:00
Remita Amine 8b3f0fb289 [gedidigital] improve asset id matching 2021-10-23 01:06:53 +02:00
nixxo 8d3f96a92c [gedidigital] Add new extractor(closes #7347)(closes #26946) 2021-10-23 01:06:53 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= e8c278f355 [apa] Improve extraction (closes #27750) 2021-10-23 01:06:53 +02:00
Adrian Heine f5a691070c [apa] Fix extraction 2021-10-23 01:06:53 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 56a54d1838 [youporn] Skip test 2021-10-23 01:06:53 +02:00
piplongrun 8c0b1ad436 [youporn] Extract duration (#28019)
Co-authored-by: Sergey M <dstftw@gmail.com>
2021-10-23 01:06:53 +02:00
Isaac-the-Man e55149a2fc [samplefocus] Add new extractor(closes #27763) 2021-10-23 01:06:53 +02:00
Remita Amine 3393281f14 [vimeo] add support for unlisted video source format extraction 2021-10-23 01:06:53 +02:00
Remita Amine 129037f139 [viki] improve extraction(closes #26522)(closes #28203)
- extract uploader_url and episode_number
- report login required error
- extract 480p formats
- fix API v4 calls
2021-10-23 01:06:53 +02:00
Remita Amine e391150eaf [ninegag] unscape title(#28201) 2021-10-23 01:06:53 +02:00
Remita Amine af5374fccc [dplay] add support for de.hgtv.com (closes #28182) 2021-10-23 01:06:53 +02:00
Remita Amine 69758c2be1 [dplay] Add support for discoveryplus.com (closes #24698) 2021-10-23 01:06:53 +02:00
dmsummers e5c17a8125 [simplecast] Add new extractor(closes #24107) 2021-10-23 01:06:53 +02:00
Stephen Stair 451ed35cf9 [storyfire] Add new extractor(closes #25628)(closes #26349) 2021-10-23 01:06:53 +02:00
Remita Amine 71097456a0 [zhihu] Add new extractor(closes #28177) 2021-10-23 01:06:53 +02:00
Remita Amine 00a34e93d5 [ccma] fix timestamp parsing in python 2 2021-10-23 01:06:53 +02:00
Remita Amine b90eb0c932 [videopress] add support for video.wordpress.com 2021-10-23 01:06:53 +02:00
Remita Amine 9a7824ce14 [kakao] improve info extraction and detect geo restriction(closes #26…
…577)
2021-10-23 01:06:53 +02:00
Remita Amine 8353016232 [xboxclips] fix extraction(closes #27151) 2021-10-23 01:06:53 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 568e70c287 [ard] Improve formats extraction (closes #28155) 2021-10-23 01:06:53 +02:00
Kevin Velghe bbf256a986 [canvas] Add new extractor for Dagelijkse Kost (#28119) 2021-10-23 01:06:53 +02:00
Remita Amine d1cb2f14ee [ign] fix extraction(closes #24771) 2021-10-23 01:06:53 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 046fbce8fb [xhamster] Extract formats from xplayer settings and extract filesize…
…s (closes #28114)
2021-10-23 01:06:53 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 627d01e28f [archiveorg] Fix and improve extraction (closes #21330, closes #23586…
…, closes #25277, closes #26780, closes #27109, closes #27236, closes #28063)
2021-10-23 01:06:53 +02:00
=?UTF-8?q?Adrian=20Heine=20n=C3=A9=20Lang?= 87d88a3ce1 [urplay] Fix extraction (closes #28073) (#28074) 2021-10-23 01:06:53 +02:00
=?UTF-8?q?Adrian=20Heine=20n=C3=A9=20Lang?= 0b4bded8d8 [azmedien] Fix extraction (#28064) 2021-10-23 01:06:53 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= b37f3b7703 [pornhub] Implement lazy playlist extraction 2021-10-23 01:06:53 +02:00
Sergey M efbbc4fb90 [pornhub] Add placeholder netrc machine 2021-10-23 01:06:53 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= a15fb8f91b [svtplay] Fix video id extraction (closes #28058) 2021-10-23 01:06:53 +02:00
Sergey M 7393b46d28 [pornhub] Add support for authentication (closes #18797, closes #21416, closes #24294) 2021-10-23 01:06:53 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 789d99a4f9 [pornhub:user] Add support for URLs unavailable via /videos page and …
…improve paging (closes #27853)
2021-10-23 01:06:53 +02:00
Remita Amine 3ceec04914 [bravotv] add support for oxygen.com(closes #13357)(closes #22500) 2021-10-23 01:06:53 +02:00
Guillem Vela 77a502d82b [ccma] improve metadata extraction(closes #27994)
- extract age_limit, alt_title, categories, series and episode_number
- fix timestamp multiple subtitles extraction
2021-10-23 01:06:53 +02:00
Remita Amine 41b390b21e [egghead] fix typo 2021-10-23 01:06:53 +02:00
Viren Rajput 97becd9c42 [egghead] update API domain(closes #28038) 2021-10-23 01:06:53 +02:00
Remita Amine db09c2ce61 [vidzi] remove extractor(closes #12629) 2021-10-23 01:06:53 +02:00
Remita Amine 5eab5ac665 [vidio] improve metadata extraction 2021-10-23 01:06:53 +02:00
=?UTF-8?q?Adrian=20Heine=20n=C3=A9=20Lang?= ac7d81f386 [AENetworks] update AENetworksShowIE test playlist id (#27851) 2021-10-23 01:06:52 +02:00
nixxo 4de0c0695a [vvvvid] add support for youtube embeds (#27825) 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Adrian=20Heine=20n=C3=A9=20Lang?= d78a905c93 [awaan] Extract uploader id (#27963) 2021-10-23 01:06:52 +02:00
Remita Amine 90854501c3 [medialaan] add support DPG Media MyChannels based websites
closes #14871
closes #15597
closes #16106
closes #16489
2021-10-23 01:06:52 +02:00
Remita Amine d7156eead8 [abcnews] fix extraction(closes #12394)(closes #27920) 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Adrian=20Heine=20n=C3=A9=20Lang?= 9f1e642faf [AMP] Fix upload_date and timestamp extraction (#27970) 2021-10-23 01:06:52 +02:00
Remita Amine e653b73d7b [tv4] relax _VALID_URL(closes #27964) 2021-10-23 01:06:52 +02:00
Remita Amine 72ccf1ea95 [tv2] improve MTV Uutiset Article extraction 2021-10-23 01:06:52 +02:00
tpikonen 4297f217fd [tv2] Add support for mtvuutiset.fi (#27744) 2021-10-23 01:06:52 +02:00
Remita Amine 21a21fdd12 [adn] improve login warning reporting 2021-10-23 01:06:52 +02:00
Remita Amine 6f32443da8 [zype] fix uplynk id extraction(closes #27956) 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Adrian=20Heine=20n=C3=A9=20Lang?= 10e0bc3eeb [ADN] Implement login (#27937)
closes #17091
closes #27841
2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= e752371a7e [franceculture] Make thumbnail optional (closes #18807) 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Aur=C3=A9lien=20Grosdidier?= b68a24ee06 [franceculture] Fix extraction (closes #27891) (#27903)
Co-authored-by: Sergey M. <dstftw@gmail.com>
2021-10-23 01:06:52 +02:00
aarubui e6f46e50df [njpwworld] fix extraction (#27890) 2021-10-23 01:06:52 +02:00
Remita Amine b6aeee6944 [comedycentral] fix extraction(closes #27905) 2021-10-23 01:06:52 +02:00
Remita Amine 89d8d831ab [wat] remove unused variable 2021-10-23 01:06:52 +02:00
Remita Amine a4afcb7a2f [wat] fix format extraction(closes #27901) 2021-10-23 01:06:52 +02:00
Remita Amine 0ca38e7fb2 [americastestkitchen] improve season extraction 2021-10-23 01:06:52 +02:00
Brian Marks e4d12c6925 [americastestkitchen] Add support for downloading entire seasons (#27…
…861)
2021-10-23 01:06:52 +02:00
Remita Amine 9cd160bcf0 [trovo] Add new extractor(closes #26125) 2021-10-23 01:06:52 +02:00
Remita Amine 78d9c01473 [aol] add support for yahoo videos(closes #26650) 2021-10-23 01:06:52 +02:00
Remita Amine 0aca265418 [yahoo] fix single video extraction 2021-10-23 01:06:52 +02:00
Remita Amine 2287106362 [ninegag] improve extraction 2021-10-23 01:06:52 +02:00
DrWursterich 554ca47216 [9gag] Fix Extraction (#23022) 2021-10-23 01:06:52 +02:00
Brian Marks 23ed695eaa [americastestkitchen] Improve metadata extraction for ATK episodes (#…
…27860)
2021-10-23 01:06:52 +02:00
Remita Amine 6e0744819c [aljazeera] fix extraction(closes #20911)(closes #27779) 2021-10-23 01:06:52 +02:00
Remita Amine 81e163b024 [minds] improve extraction 2021-10-23 01:06:52 +02:00
Tatsh ca4bfa3da3 [Minds] Add new extractor (#17934) 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Adrian=20Heine=20n=C3=A9=20Lang?= 58fa22f684 [ard] Fix title and description extraction and update tests (#27761) 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Adrian=20Heine=20n=C3=A9=20Lang?= f808eef2f3 [aenetworks] Fix test (#27847) 2021-10-23 01:06:52 +02:00
Remita Amine 6b6c8bf1f0 [spotify] Add new extractor for Spotify Podcasts(closes #27443) 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 79a5e77e79 [mixcloud:playlist:base] Fix video id extraction in flat playlist mod…
…e (refs #27787)
2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 6f17f97383 [animeondemand] Add support for lazy playlist extraction (closes #27829) 2021-10-23 01:06:52 +02:00
Remita Amine 2dcad362e8 [twitter] Add tests for more cards 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 720ee011e2 [youporn] Restrict fallback download URL (refs #27822) 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 4b782259f2 [youporn] Improve height and tbr extraction (refs #23659, refs #20425) 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 1855ad87cd [youporn] Fix extraction (closes #27822) 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= cd5366e41d [twitter] Add support for unified cards (closes #27826) 2021-10-23 01:06:52 +02:00
main() 6fdbcc1c59 [twitch] Set OAuth token for GraphQL requests using auth-token cookie…
… (#27790)

Co-authored-by: remitamine <remitamine@gmail.com>
2021-10-23 01:06:52 +02:00
Aarni Koskela 9fb1f50a15 [Mixcloud] Harmonize ID generation from lists with full ID generation…
… (#27787)

Mixcloud IDs are generated as `username_slug` when the full ID dict has been
downloaded.  When downloading a list (e.g. uploads, favorites, ...), the temporary
ID is just the `slug`.  This made e.g. archive file usage require the download
of stream metadata before the download can be rejected as already downloaded.

This commit attempts to get the uploader username during the GraphQL query, so the
temporary IDs are generated similarly.
2021-10-23 01:06:52 +02:00
Remita Amine e5ef69ca71 [cspan] improve info extraction(closes #27791) 2021-10-23 01:06:52 +02:00
Remita Amine ca8ab55941 [adn] improve info extraction 2021-10-23 01:06:52 +02:00
=?UTF-8?q?Adrian=20Heine=20n=C3=A9=20Lang?= 258cd9f44e [ADN] Fix extraction (#27732)
Closes #26963.
2021-10-23 01:06:52 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 12ca40436c [twitch] Improve login error extraction 2021-10-23 01:06:52 +02:00