Commit graph

706 commits

Author SHA1 Message Date
=?UTF-8?q?Sergey=20M=E2=80=A4?=
71d074ba46 [ndr:embed:base] Extract subtitles (closes #25447, closes #26106) 2021-10-23 01:06:50 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
cb9623206e [servus] Add support for pm-wissen.com (closes #25869) 2021-10-23 01:06:50 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
4b3da7ce47 [servus] Fix extraction (closes #26872, closes #26967, closes #26983,…
closes #27000)
2021-10-23 01:06:50 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
23c968301c [xtube] Fix extraction (closes #26996) 2021-10-23 01:06:50 +02:00
Remita Amine
41ba58cea2 [lrt] fix extraction 2021-10-23 01:06:50 +02:00
Remita Amine
099936f4e6 [condenast] fix extraction and extract subtitles 2021-10-23 01:06:50 +02:00
Remita Amine
3ac79c2585 [bandcamp] fix extraction 2021-10-23 01:06:50 +02:00
Remita Amine
fc645d1052 [rai] fix RaiPlay extraction 2021-10-23 01:06:50 +02:00
Remita Amine
065a8e40de [usanetwork] fix extraction 2021-10-23 01:06:50 +02:00
Remita Amine
8ff536d5be [nbc] fix NBCNews/Today/MSNBC extraction 2021-10-23 01:06:50 +02:00
Remita Amine
d23d09c709 [cnbc] fix extraction 2021-10-23 01:06:50 +02:00
Laura Liberda
f42428e8e0 tvn24: next.js frontend extraction without playwright
thanks to @ptrcnull
2021-02-25 15:35:14 +01:00
Laura Liberda
07f5e2ae1c common: next.js data searcher 2021-02-25 15:22:17 +01:00
Laura Liberda
3ac7b35f1b PolskaPress extractor 2021-02-24 17:06:33 +01:00
Laura Liberda
f91cd92ea0 [x-news] search for x-link in divs 2021-02-24 14:48:54 +01:00
Laura Liberda
8d30f19740 transistorfm extractors
based on extractor by @asz: https://github.com/ytdl-org/youtube-dl/pull/28022
2021-02-24 12:20:49 +01:00
eb0891a824 version 2021.02.23 2021-02-23 15:06:34 +01:00
Laura Liberda
84c08079bd [youtube] fix dynamic crypto 2021-02-23 14:01:39 +01:00
13db87c0a2 + new crypto for YT 2021-02-22 20:31:44 +01:00
85bb796e05 * jwplayer search meaningful error 2021-02-22 20:23:33 +01:00
Laura Liberda
e35e90a263 [tvn24] fix age_limit on fakty 2021-02-12 13:16:04 +01:00
Laura Liberda
9bcb5f1b61 [tvn24] fix fakty extraction (closes #37) 2021-02-12 12:59:24 +01:00
Laura Liberda
ac9192619a [pulsevideo] support age limit 2021-02-11 14:34:59 +01:00
Laura Liberda
4cfa7883a3 [clip.rs] fix extraction 2021-02-11 14:08:07 +01:00
Laura Liberda
b55552ad1a [vod.pl] fix extraction 2021-02-11 13:18:57 +01:00
Laura Liberda
630a86c5e3 refactor from onet mvp to pulsevideo 2021-02-11 01:09:05 +01:00
Laura Liberda
46643f645d [pulsembed] fix 2021-02-10 22:06:47 +01:00
Laura Liberda
62008d3f8b pulsembed extractor 2021-02-10 01:55:47 +01:00
Laura Liberda
d980ef4e35 [tvp:embed] fix DeprecationWarning 2021-02-10 01:50:08 +01:00
Laura Liberda
bffba35446 [x-link] add iframe support 2021-02-10 01:39:10 +01:00
Laura Liberda
07f326f52d [tvp:embed] fix _extract_urls 2021-02-10 01:05:00 +01:00
Laura Liberda
f2038499ef [OnetMVP] url extractor 2021-02-10 00:40:16 +01:00
Laura Liberda
a60c736c44 [tvp:embed] new url scheme and url extractor 2021-02-10 00:39:27 +01:00
Laura Liberda
edca3b8c96 simplify libsyn extraction 2021-02-10 00:38:40 +01:00
Laura Liberda
b98dd103da [tiktok] user profile extractor 2021-02-05 16:37:22 +01:00
Laura Liberda
a9cd876cf9 [lurker] domain update 2021-02-05 13:00:36 +01:00
Laura Liberda
87fad4b7eb x-link (x-news.pl embeds) extractor 2021-01-31 01:30:47 +01:00
Laura Liberda
a3816f69be [generic] normalizing embeds part 2137 2021-01-31 01:26:39 +01:00
Laura Liberda
b1c1d64de0 albicla extractor 2021-01-30 19:47:13 +01:00
Laura Liberda
d2e522de09 wp.pl extractor 2021-01-25 15:45:55 +01:00
Laura Liberda
0b1dcd17b3 [tvn24] fix next.js frontend extraction on no cookies 2021-01-24 22:21:55 +01:00
Laura Liberda
f39144fa0a [youtube] youtube.com/video/ url scheme 2021-01-24 20:14:01 +01:00
Laura Liberda
d14745983d [peertube] reduce request amount if webpage downloaded 2021-01-24 06:13:30 +01:00
e65850dfd5 version 2021.01.24 2021-01-24 05:17:04 +01:00
Laura Liberda
d08ac18c25 [tvn24] remove tvn24bis.pl references, remove GDPR consent cookies before opening page in browser 2021-01-24 04:56:39 +01:00
Laura Liberda
85e45ed607 remove phantomjs wrapper (closes #28) 2021-01-23 20:18:54 +01:00
Laura Liberda
95b061297c [pornhub] refactor scraping protection workaround from phantomjs to playwright 2021-01-23 20:15:27 +01:00
Laura Liberda
1285da6e17 [youtube] match /shorts/ urls 2021-01-23 15:42:50 +01:00
Laura Liberda
570cf794a9 [agora] wyborcza/wysokieobcasy/tokfm podcast fixes 2021-01-23 00:31:40 +01:00
Laura Liberda
bed7b7f44c [crunchyroll] connect to https by default 2021-01-22 20:00:06 +01:00
Laura Liberda
339db8d1d2 [tvn24] support nextjs frontend (playwright required) and magazine 2021-01-22 19:59:00 +01:00
Laura Liberda
54ea13966e [youtube] minor playlist improvements 2021-01-19 18:45:18 +01:00
Laura Liberda
c53f744097 playwright wrapper (#28) 2021-01-18 22:39:18 +01:00
Laura Liberda
365daad4f5 oko.press extractor 2021-01-18 03:52:28 +01:00
Laura Liberda
abfbb7d014 _json_ld: podcasts objects 2021-01-18 03:52:19 +01:00
Laura Liberda
254f95b75f wyborcza extractors, merge agora extractors files 2021-01-17 08:41:00 +01:00
Laura Liberda
d959fff39f lurker extractor 2021-01-17 06:08:30 +01:00
2c354d15a0 version 2021.01.16 2021-01-16 02:38:11 +01:00
Laura Liberda
097c7bd4ba linkedin:post extractor 2021-01-11 17:58:24 +01:00
Laura Liberda
05620dab04 [weibo] dash formats 2021-01-10 23:36:29 +01:00
Laura Liberda
eb1333e65b [vimeo:review] fix videos with video password
https://github.com/ytdl-org/youtube-dl/issues/27591
2021-01-10 10:42:15 +01:00
Laura Liberda
90291aa422 gtv.org extractor, I guess 2021-01-10 09:56:59 +01:00
Laura Liberda
fe0f39da07 fix for youtube topic channels 2021-01-10 01:27:39 +01:00
Laura Liberda
90f556c478 [youtube] fix regular channels and playlists 2021-01-10 00:11:36 +01:00
Laura Liberda
d51d7e3865 youtube music album extractor 2021-01-10 00:06:08 +01:00
Laura Liberda
b044df8d86 LBRY extractor
why did I do this?
2021-01-09 04:31:11 +01:00
Laura Liberda
2acc7755fc [generic] embetty embeds 2021-01-09 02:11:47 +01:00
Laura Liberda
0abf03dbaf [heise] extract embetty embeds 2021-01-09 02:11:33 +01:00
Laura Liberda
d72d60bf5e embetty extractor 2021-01-09 02:11:12 +01:00
Laura Liberda
2a772c54bb the guardian extractors 2021-01-08 21:01:36 +01:00
Laura Liberda
cf9d87b0e6 [tvp:series] refactor to API 2021-01-08 12:41:55 +01:00
Laura Liberda
6e4b1019e4 basic tuba.fm support 2021-01-08 11:19:15 +01:00
Laura Liberda
c758741d55 rmf extractors 2021-01-07 00:51:08 +01:00
Laura Liberda
0aa7cb240c _json_ld: handle multiple thumbnails 2021-01-07 00:49:10 +01:00
Laura Liberda
78d9e9046c [cda] refactor to mobile JSON API 2021-01-06 01:28:32 +01:00
Laura Liberda
1d601522cc a bit more embed searching normalization 2021-01-05 20:06:22 +01:00
8f86520b7a version 2021.01.03 2021-01-03 23:30:31 +01:00
5049bf7bea + Ipla Extractor (reverse engineered by @ptrcnull) 2021-01-03 23:16:16 +01:00
Laura Liberda
33c63089d9 tvnplayer:series extractor 2021-01-03 21:13:16 +01:00
Laura Liberda
837924dd1b fix tvnplayer on py2.7 2021-01-03 05:14:37 +01:00
9bba7c1c5f + TVNPlayer Extractor (reverse engineered by @ptrcnull) 2021-01-03 03:52:08 +01:00
Laura Liberda
7ed8e0c502 tokfm podcast and audition extractor 2021-01-03 02:42:43 +01:00
Laura Liberda
d915fe0b0c [generic] embed searching normalization 2/n 2021-01-01 07:05:16 +01:00
Laura Liberda
c73049bc5b [youtube] alt_title w/ eng title, if it differs from the original one 2020-12-14 18:52:31 +01:00
Laura Liberda
49bf656179 [generic] simplify the embed searching a lot 2020-12-14 17:12:34 +01:00
Laura Liberda
c9accf707d [funkwhale] fix TypeError on null album release date 2020-12-13 22:19:20 +01:00
Laura Liberda
048bac7c49 [funkwhale:channel] fix tests 2020-12-13 22:13:54 +01:00
Laura Liberda
c3e1d87fcd [funkwhale] add webpage_url 2020-12-13 22:12:46 +01:00
Laura Liberda
c40130632c [funkwhale] radio extractor 2020-12-13 21:57:22 +01:00
Laura Liberda
5592cda782 [tvp] abc.tvp.pl and general fixes 2020-12-13 03:12:31 +01:00
Laura Liberda
2d2abe34c8 [youtube] fix (dis)like count when it's 0 (#14) 2020-12-12 23:53:50 +01:00
Laura Liberda
572b04b7f1 [funkwhale] fix track duration 2020-12-12 23:11:58 +01:00
Laura Liberda
bc1164719f [funkwhale] improve album data extraction 2020-12-12 23:05:16 +01:00
Laura Liberda
e59434e242 [onet] remove extractors for dead services 2020-12-12 17:15:06 +01:00
Laura Liberda
f646087983 [funkwhale] improve detection 2020-12-12 17:01:59 +01:00
Laura Liberda
4221c2ee68 funkwhale extractors 2020-12-12 06:12:40 +01:00
b2e1200c40 version 2020.12.11 2020-12-11 23:55:40 +01:00
Laura Liberda
32617e06b3 youtube:channel hotfix 2020-12-11 23:35:25 +01:00
Laura Liberda
a12318ed7e shie: _match_id_and_host helper 2020-12-10 23:39:39 +01:00
Laura Liberda
adea7807af mastodon extractor (#11) 2020-12-10 03:23:28 +01:00
Laura Liberda
0d8a0cefc1 fix suitable_selfhosted() on extractors with no regexes 2020-12-10 03:23:01 +01:00
Laura Liberda
e33e398767 [generic] fix peertube embed tests 2020-12-10 01:46:57 +01:00
Laura Liberda
b3c8623e4c [tvp:embed] refactored to TVPlayer2 API 2020-12-10 01:33:20 +01:00
Laura Liberda
889005bab3 selfhosted extractors, peertube extractor reworked (#10) 2020-12-09 21:52:30 +01:00
Laura Liberda
005b3fbedd eskago extractor (#20) 2020-12-08 00:16:49 +01:00
Laura Liberda
dab3e41041 [atttechchannel] fix working, drop flash references 2020-12-07 04:37:02 +01:00
Laura Liberda
a6102b5483 eurozet player extractors (#16) 2020-12-07 03:48:12 +01:00
Laura Liberda
24a54d5d52 eurozet article video extractor (#16) 2020-12-06 20:52:26 +01:00
Laura Liberda
4453792f0a [onet] amp urls 2020-12-06 04:07:00 +01:00
Laura Liberda
86629d8574 [onet] libsyn podcasts support, fixed tests 2020-12-06 03:51:23 +01:00
Laura Liberda
9b6ec60622 [onnetwork:frame] simplify code a lot 2020-12-06 01:17:44 +01:00
Laura Liberda
91d6c6dbd4 [polskieradio] livestream player extractor 2020-12-06 01:14:27 +01:00
Laura Liberda
6a4da9addf [polskieradio] new player_data thing 2020-12-05 20:01:55 +01:00
Laura Liberda
ef114c2560 [polskieradio] support for polskieradio24.pl 2020-12-05 17:58:31 +01:00
Laura Liberda
3a38277a95 [cda] more fail-safe url replaces 2020-12-05 17:29:03 +01:00
Laura Liberda
33c19049af [cda] fix adult pages 2020-12-05 17:14:08 +01:00
Laura Liberda
a11b8a8e5f [tvp] regional (client-side rendered) pages 2020-12-05 05:18:19 +01:00
Laura Liberda
07fa0508f9 [youtube] remove more useless tests 2020-12-05 01:09:29 +01:00
Laura Liberda
043bec4c9b [tvp] tvp stream support 2020-12-05 01:09:06 +01:00
Laura Liberda
10bb46f940 [tvp] polandin.com support 2020-12-04 19:37:08 +01:00
b3383de0a5 version 2020.11.27 2020-11-27 14:28:08 +01:00
Laura Liberda
40638606b9 [youtube] history, subscriptions 2020-11-24 21:48:21 +01:00
Laura Liberda
75c1755cc1 [youtube] liked, watch later support (#2) 2020-11-24 16:58:50 +01:00
Laura Liberda
a3cba131b3 openfm extractor (closes #8) 2020-11-22 05:44:40 +01:00
Laura Liberda
abdc94a6a5 ninateka extractor (closes #7) 2020-11-22 05:05:51 +01:00
Laura Liberda
7671ce8f00 [youtube] fix yet another UnboundLocalError 2020-11-21 00:56:20 +01:00
486463ba53 version 2020.11.20 2020-11-20 13:36:08 +01:00
Laura Liberda
c08b658033 [wykop] remove debug logs 😳 2020-11-18 17:51:46 +01:00
Laura Liberda
4eaf67ad2e [youtube] fix UnboundLocalError 2020-11-17 17:03:15 +01:00
a661491bcf removed more SWF references from youtube extractor 2020-11-17 13:56:32 +01:00
Laura
c55393ce44 [youtube] fix channel/search on videos with no views 2020-11-16 02:31:20 +01:00
selfisekai
80a5d8d55e [youtube] fix channels with hyphen inside id 2020-11-16 02:31:20 +01:00
98e6a95bd5 version 2020.11.16 2020-11-16 01:31:37 +01:00
selfisekai
6f876fba51 [youtube] fixed some download tests 2020-11-15 23:08:28 +01:00
selfisekai
158d4e9088 [youtube] search info extractor 2020-11-15 20:31:40 +01:00
selfisekai
ede99f9f13 remove youtube:live, fix tests 2020-11-15 16:41:15 +01:00
selfisekai
92d1bd1b90 [youtube] brand new channel/playlist extractors 2020-11-15 15:44:07 +01:00
selfisekai
85d8ce7a3d Merge branch 'master' of ssh://git.sakamoto.pl:2137/laudom/haruhi-dl into youtube-sig-crypto-proposal 2020-11-12 11:04:15 +01:00
selfisekai
0259a32b73 [youtube] fix reworked sig decrypting 2020-11-12 11:02:07 +01:00
selfisekai
8c0ff392ea [youtube] dynamic sig improvements 2020-11-12 06:31:11 +01:00
8c506dae76 version 2020.11.12 2020-11-12 02:53:28 +01:00
selfisekai
e31c0d2576 [youtube] dynamic sig crypto fallback 2020-11-09 16:02:49 +01:00
selfisekai
835917442e [tiktok:user] only match user profiles 2020-11-08 21:52:02 +01:00
selfisekai
0958b54441 [wykop] add new extractor 2020-11-08 21:41:50 +01:00
selfisekai
5c6bcbf172 fixed tiktok video extractor 2020-11-08 05:37:01 +01:00
Dominika
7e9e7a3c91 version 2020.11.08 2020-11-08 00:40:17 +01:00
selfisekai
ca3abff9ea aliexpress product video extractor 2020-11-07 04:13:19 +01:00
Dominika
84ea897ae8 version 2020.11.06 2020-11-06 23:30:05 +01:00
selfisekai
20d6ad3c33 [onnetwork] added extractor 2020-11-04 23:55:41 +01:00
Dominika
60ba8b14d6 I have no idea what I'm doing 2020-11-04 01:18:17 +01:00
selfisekai
6f623e3cd0 [cda] major fixes 2020-11-01 22:52:39 +01:00
Dominika
7fb9bc8b62 removed useless code, fixed URLs, fixed like/dislike count in youtube extractor 2020-11-01 22:24:53 +01:00
Dominika
5be3f4bd7f Merge branch 'master' of ssh://git.sakamoto.pl:2137/laudom/youtube-dl into master 2020-11-01 05:17:30 +01:00
Dominika
1c397d1dd3 version 2020.11.01 2020-11-01 05:17:15 +01:00
selfisekai
a741425af8 [tvp] quick fixes 2020-11-01 05:03:15 +01:00
Dominika
eacab4c6a3 bulk project name change, expect bugssssss 2020-11-01 04:39:17 +01:00