Commit graph

272 commits

Author SHA1 Message Date
Remita Amine e23e51ca94 [urplay] fix extraction(closes #26828) 2021-10-23 01:06:50 +02:00
Remita Amine 02f491e375 [lrt] fix extraction with empty tags(closes #20264) 2021-10-23 01:06:50 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 71d074ba46 [ndr:embed:base] Extract subtitles (closes #25447, closes #26106) 2021-10-23 01:06:50 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= cb9623206e [servus] Add support for pm-wissen.com (closes #25869) 2021-10-23 01:06:50 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 4b3da7ce47 [servus] Fix extraction (closes #26872, closes #26967, closes #26983,…
closes #27000)
2021-10-23 01:06:50 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 23c968301c [xtube] Fix extraction (closes #26996) 2021-10-23 01:06:50 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 64e706884a [utils] Skip ! prefixed code in js_to_json 2021-10-23 01:06:50 +02:00
Remita Amine 41ba58cea2 [lrt] fix extraction 2021-10-23 01:06:50 +02:00
Remita Amine 099936f4e6 [condenast] fix extraction and extract subtitles 2021-10-23 01:06:50 +02:00
Remita Amine 3ac79c2585 [bandcamp] fix extraction 2021-10-23 01:06:50 +02:00
Remita Amine fc645d1052 [rai] fix RaiPlay extraction 2021-10-23 01:06:50 +02:00
Remita Amine 065a8e40de [usanetwork] fix extraction 2021-10-23 01:06:50 +02:00
Remita Amine 8ff536d5be [nbc] fix NBCNews/Today/MSNBC extraction 2021-10-23 01:06:50 +02:00
Remita Amine d23d09c709 [cnbc] fix extraction 2021-10-23 01:06:50 +02:00
Laura Liberda f42428e8e0 tvn24: next.js frontend extraction without playwright
thanks to @ptrcnull
2021-02-25 15:35:14 +01:00
Laura Liberda 07f5e2ae1c common: next.js data searcher 2021-02-25 15:22:17 +01:00
Laura Liberda 3ac7b35f1b PolskaPress extractor 2021-02-24 17:06:33 +01:00
Laura Liberda f91cd92ea0 [x-news] search for x-link in divs 2021-02-24 14:48:54 +01:00
Laura Liberda 8d30f19740 transistorfm extractors
based on extractor by @asz: https://github.com/ytdl-org/youtube-dl/pull/28022
2021-02-24 12:20:49 +01:00
Dominika eb0891a824 version 2021.02.23 2021-02-23 15:06:34 +01:00
Laura Liberda 84c08079bd [youtube] fix dynamic crypto 2021-02-23 14:01:39 +01:00
Dominika Liberda 5f6c836641 version 2021.02.22 2021-02-22 20:44:54 +01:00
Dominika Liberda 13db87c0a2 + new crypto for YT 2021-02-22 20:31:44 +01:00
Dominika Liberda 85bb796e05 * jwplayer search meaningful error 2021-02-22 20:23:33 +01:00
Laura Liberda e35e90a263 [tvn24] fix age_limit on fakty 2021-02-12 13:16:04 +01:00
Laura Liberda 9bcb5f1b61 [tvn24] fix fakty extraction (closes #37) 2021-02-12 12:59:24 +01:00
Laura Liberda ac9192619a [pulsevideo] support age limit 2021-02-11 14:34:59 +01:00
Laura Liberda 4cfa7883a3 [clip.rs] fix extraction 2021-02-11 14:08:07 +01:00
Laura Liberda b55552ad1a [vod.pl] fix extraction 2021-02-11 13:18:57 +01:00
Laura Liberda 630a86c5e3 refactor from onet mvp to pulsevideo 2021-02-11 01:09:05 +01:00
Laura Liberda f603f36c3f warn about python 2 2021-02-10 22:22:37 +01:00
Laura Liberda 46643f645d [pulsembed] fix 2021-02-10 22:06:47 +01:00
Laura Liberda 62008d3f8b pulsembed extractor 2021-02-10 01:55:47 +01:00
Laura Liberda d980ef4e35 [tvp:embed] fix DeprecationWarning 2021-02-10 01:50:08 +01:00
Laura Liberda bffba35446 [x-link] add iframe support 2021-02-10 01:39:10 +01:00
Laura Liberda 07f326f52d [tvp:embed] fix _extract_urls 2021-02-10 01:05:00 +01:00
Laura Liberda f2038499ef [OnetMVP] url extractor 2021-02-10 00:40:16 +01:00
Laura Liberda a60c736c44 [tvp:embed] new url scheme and url extractor 2021-02-10 00:39:27 +01:00
Laura Liberda edca3b8c96 simplify libsyn extraction 2021-02-10 00:38:40 +01:00
Laura Liberda b98dd103da [tiktok] user profile extractor 2021-02-05 16:37:22 +01:00
Laura Liberda a9cd876cf9 [lurker] domain update 2021-02-05 13:00:36 +01:00
Laura Liberda 87fad4b7eb x-link (x-news.pl embeds) extractor 2021-01-31 01:30:47 +01:00
Laura Liberda a3816f69be [generic] normalizing embeds part 2137 2021-01-31 01:26:39 +01:00
Laura Liberda b1c1d64de0 albicla extractor 2021-01-30 19:47:13 +01:00
Laura Liberda d2e522de09 wp.pl extractor 2021-01-25 15:45:55 +01:00
Laura Liberda 0b1dcd17b3 [tvn24] fix next.js frontend extraction on no cookies 2021-01-24 22:21:55 +01:00
Laura Liberda f39144fa0a [youtube] youtube.com/video/ url scheme 2021-01-24 20:14:01 +01:00
Laura Liberda d14745983d [peertube] reduce request amount if webpage downloaded 2021-01-24 06:13:30 +01:00
Dominika e65850dfd5 version 2021.01.24 2021-01-24 05:17:04 +01:00
Laura Liberda d08ac18c25 [tvn24] remove tvn24bis.pl references, remove GDPR consent cookies before opening page in browser 2021-01-24 04:56:39 +01:00
Laura Liberda 85e45ed607 remove phantomjs wrapper (closes #28) 2021-01-23 20:18:54 +01:00
Laura Liberda 95b061297c [pornhub] refactor scraping protection workaround from phantomjs to playwright 2021-01-23 20:15:27 +01:00
Laura Liberda 88f5839a37 [playwright] cookie sync, non-headless option, global playwright instance 2021-01-23 20:14:31 +01:00
Laura Liberda 1285da6e17 [youtube] match /shorts/ urls 2021-01-23 15:42:50 +01:00
Laura Liberda 570cf794a9 [agora] wyborcza/wysokieobcasy/tokfm podcast fixes 2021-01-23 00:31:40 +01:00
Laura Liberda 3bb3d99229 simplify checking package version for some people 2021-01-22 23:17:58 +01:00
Laura Liberda 4f112c3592 revert my stupidity 2021-01-22 23:05:04 +01:00
Laura Liberda bed7b7f44c [crunchyroll] connect to https by default 2021-01-22 20:00:06 +01:00
Laura Liberda 339db8d1d2 [tvn24] support nextjs frontend (playwright required) and magazine 2021-01-22 19:59:00 +01:00
Laura Liberda 1804387116 playwright helper improvements 2021-01-22 19:58:03 +01:00
Laura Liberda 1cbbae3868 playwright version printing on --verbose 2021-01-22 19:57:28 +01:00
Laura Liberda 0ec8c8e8f1 is_outdated_version: allow exact same version 2021-01-22 19:56:26 +01:00
Laura Liberda 54ea13966e [youtube] minor playlist improvements 2021-01-19 18:45:18 +01:00
Laura Liberda 6807c8869a [playwright] fix tests again 2021-01-18 22:59:11 +01:00
Laura Liberda 9224bfe84f [playwright] fix tests 2021-01-18 22:57:17 +01:00
Laura Liberda c53f744097 playwright wrapper (#28) 2021-01-18 22:39:18 +01:00
Laura Liberda 365daad4f5 oko.press extractor 2021-01-18 03:52:28 +01:00
Laura Liberda abfbb7d014 _json_ld: podcasts objects 2021-01-18 03:52:19 +01:00
Laura Liberda 254f95b75f wyborcza extractors, merge agora extractors files 2021-01-17 08:41:00 +01:00
Laura Liberda d959fff39f lurker extractor 2021-01-17 06:08:30 +01:00
Dominika 2c354d15a0 version 2021.01.16 2021-01-16 02:38:11 +01:00
Laura Liberda 097c7bd4ba linkedin:post extractor 2021-01-11 17:58:24 +01:00
Laura Liberda 05620dab04 [weibo] dash formats 2021-01-10 23:36:29 +01:00
Laura Liberda eb1333e65b [vimeo:review] fix videos with video password
https://github.com/ytdl-org/youtube-dl/issues/27591
2021-01-10 10:42:15 +01:00
Laura Liberda 90291aa422 gtv.org extractor, I guess 2021-01-10 09:56:59 +01:00
Laura Liberda fe0f39da07 fix for youtube topic channels 2021-01-10 01:27:39 +01:00
Laura Liberda 90f556c478 [youtube] fix regular channels and playlists 2021-01-10 00:11:36 +01:00
Laura Liberda d51d7e3865 youtube music album extractor 2021-01-10 00:06:08 +01:00
Laura Liberda b044df8d86 LBRY extractor
why did I do this?
2021-01-09 04:31:11 +01:00
Laura Liberda 2acc7755fc [generic] embetty embeds 2021-01-09 02:11:47 +01:00
Laura Liberda 0abf03dbaf [heise] extract embetty embeds 2021-01-09 02:11:33 +01:00
Laura Liberda d72d60bf5e embetty extractor 2021-01-09 02:11:12 +01:00
Laura Liberda 2a772c54bb the guardian extractors 2021-01-08 21:01:36 +01:00
Laura Liberda cf9d87b0e6 [tvp:series] refactor to API 2021-01-08 12:41:55 +01:00
Laura Liberda 6e4b1019e4 basic tuba.fm support 2021-01-08 11:19:15 +01:00
Laura Liberda c758741d55 rmf extractors 2021-01-07 00:51:08 +01:00
Laura Liberda 0aa7cb240c _json_ld: handle multiple thumbnails 2021-01-07 00:49:10 +01:00
Laura Liberda 78d9e9046c [cda] refactor to mobile JSON API 2021-01-06 01:28:32 +01:00
Laura Liberda 1d601522cc a bit more embed searching normalization 2021-01-05 20:06:22 +01:00
Dominika Liberda 8f86520b7a version 2021.01.03 2021-01-03 23:30:31 +01:00
Dominika Liberda 5049bf7bea + Ipla Extractor (reverse engineered by @ptrcnull) 2021-01-03 23:16:16 +01:00
Laura Liberda 33c63089d9 tvnplayer:series extractor 2021-01-03 21:13:16 +01:00
Laura Liberda 837924dd1b fix tvnplayer on py2.7 2021-01-03 05:14:37 +01:00
Dominika Liberda 9bba7c1c5f + TVNPlayer Extractor (reverse engineered by @ptrcnull) 2021-01-03 03:52:08 +01:00
Laura Liberda 7ed8e0c502 tokfm podcast and audition extractor 2021-01-03 02:42:43 +01:00
Laura Liberda d915fe0b0c [generic] embed searching normalization 2/n 2021-01-01 07:05:16 +01:00
Laura Liberda c73049bc5b [youtube] alt_title w/ eng title, if it differs from the original one 2020-12-14 18:52:31 +01:00
Laura Liberda 49bf656179 [generic] simplify the embed searching a lot 2020-12-14 17:12:34 +01:00
Laura Liberda c9accf707d [funkwhale] fix TypeError on null album release date 2020-12-13 22:19:20 +01:00
Laura Liberda 048bac7c49 [funkwhale:channel] fix tests 2020-12-13 22:13:54 +01:00
Laura Liberda c3e1d87fcd [funkwhale] add webpage_url 2020-12-13 22:12:46 +01:00
Laura Liberda c40130632c [funkwhale] radio extractor 2020-12-13 21:57:22 +01:00
Laura Liberda 5592cda782 [tvp] abc.tvp.pl and general fixes 2020-12-13 03:12:31 +01:00
Laura Liberda 2d2abe34c8 [youtube] fix (dis)like count when it's 0 (#14) 2020-12-12 23:53:50 +01:00
Laura Liberda 572b04b7f1 [funkwhale] fix track duration 2020-12-12 23:11:58 +01:00
Laura Liberda bc1164719f [funkwhale] improve album data extraction 2020-12-12 23:05:16 +01:00
Laura Liberda e59434e242 [onet] remove extractors for dead services 2020-12-12 17:15:06 +01:00
Laura Liberda f646087983 [funkwhale] improve detection 2020-12-12 17:01:59 +01:00
Laura Liberda 4221c2ee68 funkwhale extractors 2020-12-12 06:12:40 +01:00
Dominika b2e1200c40 version 2020.12.11 2020-12-11 23:55:40 +01:00
Laura Liberda 32617e06b3 youtube:channel hotfix 2020-12-11 23:35:25 +01:00
Laura Liberda a12318ed7e shie: _match_id_and_host helper 2020-12-10 23:39:39 +01:00
Laura Liberda adea7807af mastodon extractor (#11) 2020-12-10 03:23:28 +01:00
Laura Liberda 0d8a0cefc1 fix suitable_selfhosted() on extractors with no regexes 2020-12-10 03:23:01 +01:00
Laura Liberda e33e398767 [generic] fix peertube embed tests 2020-12-10 01:46:57 +01:00
Laura Liberda b3c8623e4c [tvp:embed] refactored to TVPlayer2 API 2020-12-10 01:33:20 +01:00
Laura Liberda 6530f90d24 fixed try_get util 2020-12-10 01:32:45 +01:00
Laura Liberda 889005bab3 selfhosted extractors, peertube extractor reworked (#10) 2020-12-09 21:52:30 +01:00
Laura Liberda 005b3fbedd eskago extractor (#20) 2020-12-08 00:16:49 +01:00
Laura Liberda dab3e41041 [atttechchannel] fix working, drop flash references 2020-12-07 04:37:02 +01:00
Laura Liberda a6102b5483 eurozet player extractors (#16) 2020-12-07 03:48:12 +01:00
Laura Liberda 24a54d5d52 eurozet article video extractor (#16) 2020-12-06 20:52:26 +01:00
Laura Liberda 4453792f0a [onet] amp urls 2020-12-06 04:07:00 +01:00
Laura Liberda 86629d8574 [onet] libsyn podcasts support, fixed tests 2020-12-06 03:51:23 +01:00
Laura Liberda 9b6ec60622 [onnetwork:frame] simplify code a lot 2020-12-06 01:17:44 +01:00
Laura Liberda 91d6c6dbd4 [polskieradio] livestream player extractor 2020-12-06 01:14:27 +01:00
Laura Liberda 6a4da9addf [polskieradio] new player_data thing 2020-12-05 20:01:55 +01:00
Laura Liberda ef114c2560 [polskieradio] support for polskieradio24.pl 2020-12-05 17:58:31 +01:00
Laura Liberda 3a38277a95 [cda] more fail-safe url replaces 2020-12-05 17:29:03 +01:00
Laura Liberda 33c19049af [cda] fix adult pages 2020-12-05 17:14:08 +01:00
Laura Liberda a11b8a8e5f [tvp] regional (client-side rendered) pages 2020-12-05 05:18:19 +01:00
Laura Liberda 07fa0508f9 [youtube] remove more useless tests 2020-12-05 01:09:29 +01:00
Laura Liberda 043bec4c9b [tvp] tvp stream support 2020-12-05 01:09:06 +01:00
Laura Liberda 0eea826b48 fix the license declaration in __init__ 2020-12-04 23:37:41 +01:00
Laura Liberda 10bb46f940 [tvp] polandin.com support 2020-12-04 19:37:08 +01:00
Dominika b3383de0a5 version 2020.11.27 2020-11-27 14:28:08 +01:00
Laura Liberda 40638606b9 [youtube] history, subscriptions 2020-11-24 21:48:21 +01:00
Laura Liberda 75c1755cc1 [youtube] liked, watch later support (#2) 2020-11-24 16:58:50 +01:00
Laura Liberda a3cba131b3 openfm extractor (closes #8) 2020-11-22 05:44:40 +01:00
Laura Liberda abdc94a6a5 ninateka extractor (closes #7) 2020-11-22 05:05:51 +01:00
Laura Liberda 7671ce8f00 [youtube] fix yet another UnboundLocalError 2020-11-21 00:56:20 +01:00
Dominika 486463ba53 version 2020.11.20 2020-11-20 13:36:08 +01:00
Laura Liberda c08b658033 [wykop] remove debug logs 😳 2020-11-18 17:51:46 +01:00
Laura Liberda 4eaf67ad2e [youtube] fix UnboundLocalError 2020-11-17 17:03:15 +01:00
Dominika a661491bcf removed more SWF references from youtube extractor 2020-11-17 13:56:32 +01:00
Laura c55393ce44 [youtube] fix channel/search on videos with no views 2020-11-16 02:31:20 +01:00
selfisekai 80a5d8d55e [youtube] fix channels with hyphen inside id 2020-11-16 02:31:20 +01:00
Dominika 98e6a95bd5 version 2020.11.16 2020-11-16 01:31:37 +01:00
selfisekai 6f876fba51 [youtube] fixed some download tests 2020-11-15 23:08:28 +01:00
selfisekai 158d4e9088 [youtube] search info extractor 2020-11-15 20:31:40 +01:00