laudom/haruhi-dl
2
0
Fork 0
Code Issues 13 Pull requests Projects Releases Packages Wiki Activity
18366 commits 2 branches 27 tags 47 MiB
Commit graph

518 commits

Author SHA1 Message Date
Remita Amine
1d866fe2b3 [theweatherchannel] fix extraction (closes #25930)(closes #26051) 2021-10-23 01:06:51 +02:00
Remita Amine
ac0b651c35 [sprout] correct typo 2021-10-23 01:06:51 +02:00
Remita Amine
7246d188ec [sprout] Add support for Universal Kids (closes #22518) 2021-10-23 01:06:51 +02:00
Remita Amine
866f1a801d [theplatform] allow passing geo bypass countries from other extractors 2021-10-23 01:06:51 +02:00
Remita Amine
93e7f9943c [ctv] Add new extractor (closes #27525) 2021-10-23 01:06:51 +02:00
Remita Amine
a8abf2770e [9c9media] improve info extraction 2021-10-23 01:06:51 +02:00
Remita Amine
522b9ee05b [sonyliv] fix title for movies 2021-10-23 01:06:51 +02:00
Remita Amine
6baf86c39d [sonyliv] fix extraction(closes #25667) 2021-10-23 01:06:51 +02:00
Remita Amine
14a2647111 [streetvoice] fix extraction(closes #27455)(closes #27492) 2021-10-23 01:06:51 +02:00
Remita Amine
97e449e183 [facebook] add support for watchparty pages(closes #27507) 2021-10-23 01:06:51 +02:00
Remita Amine
ff3bc594e7 [cbslocal] fix video extraction 2021-10-23 01:06:51 +02:00
Remita Amine
50377f35a0 [brightcove] add another method to extract policyKey 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
15058fcdea [mewatch] Relax _VALID_URL (closes #27506) 2021-10-23 01:06:51 +02:00
Remita Amine
25f997a417 [anvato] remove NFLTokenGenerator 
until a better solution is introduced that:
- works with lazy_extractors
- allows for 3rd party token generators
 2021-10-23 01:06:51 +02:00
Remita Amine
23a5bcc4df [tastytrade] Remove Extractor(closes #25716) 
covered by GenericIE via BrighcoveNewIE
 2021-10-23 01:06:51 +02:00
Remita Amine
3e93d39835 [niconico] fix playlist extraction(closes #27428) 2021-10-23 01:06:51 +02:00
Remita Amine
bfd375ccb7 [everyonesmixtape] Remove Extractor 2021-10-23 01:06:51 +02:00
Remita Amine
4dd69eb6fd [kanalplay] Remove Extractor 2021-10-23 01:06:51 +02:00
Remita Amine
8f1118f75d [nba] rewrite extractor 2021-10-23 01:06:51 +02:00
Remita Amine
adbb3cdd89 [turner] improve info extraction 2021-10-23 01:06:51 +02:00
Remita Amine
4969a2783c [common] remove unwanted query params from unsigned akamai manifest URLs 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
86cf5a2aa7 [generic] Improve RSS age limit extraction 2021-10-23 01:06:51 +02:00
renalid
e1b808fa40 [generic] Fix RSS itunes thumbnail extraction (#27405) 2021-10-23 01:06:51 +02:00
Trevor Nelson
1da4c42b9f [redditr] Extract duration (#27426) 2021-10-23 01:06:51 +02:00
Remita Amine
aaabef0220 [anvato] Disable NFLTokenGenerator(closes #27449) 2021-10-23 01:06:51 +02:00
Remita Amine
4eab6d5637 [zaq1] Remove extractor 2021-10-23 01:06:51 +02:00
Remita Amine
76995ec854 [asiancrush] fix extraction and add support for retrocrush.tv 
closes #25577
closes #25829
 2021-10-23 01:06:51 +02:00
Remita Amine
7b2415f4f9 [nfl] fix extraction(closes #22245) 2021-10-23 01:06:51 +02:00
Remita Amine
c2c2b20b39 [anvato] update ANVACK table and add experimental token generator for… 
… NFL
 2021-10-23 01:06:51 +02:00
Remita Amine
a1952d3a0b [sky] relax SkySports URL regex (closes #27435) 2021-10-23 01:06:51 +02:00
Remita Amine
4bc794225a [tv5unis] Add new extractor(closes #22399)(closes #24890) 2021-10-23 01:06:51 +02:00
Remita Amine
a78d792adb [videomore] add support more.tv (closes #27088) 2021-10-23 01:06:51 +02:00
Remita Amine
b2d4c847ed [nhk:program] Add support for audio programs and program clips 2021-10-23 01:06:51 +02:00
Matthew Rayermann
7e6e4c9a29 [nhk] Add support for NHK video programs (#27230) 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
f0db042d42 [mdr] Bypass geo restriction 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
b331a819bc [mdr] Improve extraction (closes #24346, closes #26873) 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
c700190a05 [eporner] Fix view count extraction and make optional (closes #23306) 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
1060552241 [extractor/common] Improve JSON-LD interaction statistic extraction (… 
…refs #23306)
 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
c7e6e03982 [eporner] Fix embed test URL 2021-10-23 01:06:51 +02:00
spvkgn
aa655226dd [eporner] Fix hash extraction and extend _VALID_URL (#27396) 
Co-authored-by: Sergey M <dstftw@gmail.com>
 2021-10-23 01:06:51 +02:00
Remita Amine
948c21b310 [slideslive] use m3u8 entry protocol for m3u8 formats(closes #27400) 2021-10-23 01:06:51 +02:00
Remita Amine
2257ec4792 [twitcasting] fix format extraction and improve info extraction(close… 
…s #24868)
 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
09824dd983 [extractor/common] Document duration meta field for playlists 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
d5b9b7ffc1 [linuxacademy] Fix authentication and extraction (closes #21129, clos… 
…es #26223, closes #27402)
 2021-10-23 01:06:51 +02:00
Remita Amine
096b76fb8f [itv] clean description from HTML tags (closes #27399) 2021-10-23 01:06:51 +02:00
Remita Amine
26a7c4416c [hotstart] fix and improve extraction 
- fix format extraction (closes #26690)
- extract thumbnail URL (closes #16079, closes #20412)
- support country specific playlist URLs (closes #23496)
- select the last id in video URL (closes #26412)
 2021-10-23 01:06:51 +02:00
toniz4
a16737d123 [youtube] Add some invidious instances (#27373) 
Co-authored-by: Cássio <heyitscassio@cock.li>
 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
940c972e32 [ruutu] Extract more metadata and detect non-free videos (closes #21154) 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
9551a110d5 [ruutu] Authenticate format URLs (closes #21031, closes #26782) 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
ee2b2e978d [ruutu] Add support for static.nelonenmedia.fi (closes #25412) 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
0f76bf3b16 [ruutu] Extend _VALID_URL (closes #24839) 2021-10-23 01:06:51 +02:00
Remita Amine
1f42f0d662 [facebook] Add support archived live video URLs(closes #15859) 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
85b2a459dd [wdr] Extent subtitles extraction and improve overall extraction (clo… 
…ses #22672, closes #22723)
 2021-10-23 01:06:51 +02:00
Remita Amine
ce1265ba8b [facebook] add support for videos attached to Relay based story pages… 
…(#10795)
 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
271de5e36b [wdr:page] Add support for kinder.wdr.de (closes #27350) 2021-10-23 01:06:51 +02:00
Remita Amine
7178c3e070 [facebook] Add another regex for handleServerJS 2021-10-23 01:06:51 +02:00
Remita Amine
80e135e246 [facebook] fix embed page extraction 2021-10-23 01:06:51 +02:00
Remita Amine
a494221ffa [PATCH] [facebook] add support for Relay post pages(closes #26935) 2021-10-23 01:06:51 +02:00
Remita Amine
3a0bdc1456 [facebook] proper support for watch videos(closes #22795)(#27062) 2021-10-23 01:06:51 +02:00
Remita Amine
6970a136ec Revert "[facebook] add support for watch videos(closes #22795)" 
This reverts commit dc65041c224497f46b2984df02c234ce54bdedfd.
 2021-10-23 01:06:51 +02:00
Remita Amine
ab0118de82 [facebook] add support for watch videos(closes #22795) 2021-10-23 01:06:51 +02:00
Remita Amine
cfa38c154d [facebook] add support for group posts with multiple videos(closes #1… 
…9131)
 2021-10-23 01:06:51 +02:00
Remita Amine
885a3a9383 [itv] remove old extractio method and fix series metadata extraction 
closes #23177
closes #26897
 2021-10-23 01:06:51 +02:00
Remita Amine
131b5bbf6e [facebook] redirect Mobile URLs to Desktop URLs 
closes #24831
closes #25624
 2021-10-23 01:06:51 +02:00
Remita Amine
7d43250e35 [facebook] Add support for Relay based pages(closes #26823) 2021-10-23 01:06:51 +02:00
Remita Amine
9ba5d1f2c4 [facebook] try to reduce unessessary tahoe requests 2021-10-23 01:06:51 +02:00
Remita Amine
61022d86b9 [facebook] remove hardcoded chrome user-agent 
closes #18974
closes #25411
closes #26958
closes #27329
 2021-10-23 01:06:51 +02:00
Andrey Smirnoff
b0635eb9af [smotri] Remove extractor (#27358) 2021-10-23 01:06:51 +02:00
Remita Amine
d64b39da56 [beampro] Remove Extractor 
closes #17290
closes #22871
closes #23020
closes #23061
closes #26099
 2021-10-23 01:06:51 +02:00
EntranceJew
45ee5c8ba2 [tubitv] Extract release year (#27317) 2021-10-23 01:06:51 +02:00
Remita Amine
51433a1efa [amcnetworks] Fix free content extraction(closes #20354) 2021-10-23 01:06:51 +02:00
Remita Amine
8a311118c5 [telequebec] Fix Extraction and Add Support for video.telequebec.tv 
closes #25733
closes #26883
closes #27339
 2021-10-23 01:06:51 +02:00
Remita Amine
d2f6235840 [generic] comment a test covered now by AmericasTestKitchenIE 2021-10-23 01:06:51 +02:00
Remita Amine
03f1dda5da [tvplay:home] Fix extraction(closes #21153) 2021-10-23 01:06:51 +02:00
Remita Amine
aad69ec1b5 [americastestkitchen] Fix Extraction and add support for Cook's Count… 
…ry and Cook's Illustrated

closes #17234
closes #27322
 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
695d097a1b [slideslive] Add support for yoda service videos and extract subtitle… 
…s (closes #27323)
 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
e895ca0d9f [extractor/generic] Remove unused import 2021-10-23 01:06:51 +02:00
Remita Amine
b89074356b [aenetworks] Fix extraction 
- Fix Fastly format extraction
- Add support for play and watch subdomains
- Extract series metadata

closes #23363
closes #23390
closes #26795
closes #26985
 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
a0b9b17798 [extractor/common] Extract timestamp from Last-Modified header 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
10b7025196 [generic] Extract RSS video itunes metadata 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
021738dfa7 [generic] Extract RSS video timestamp 2021-10-23 01:06:51 +02:00
renalid
d3f521bbdc [generic] Extract RSS video description (#27177) 2021-10-23 01:06:51 +02:00
Remita Amine
d6457b9613 [nrk] reduce requests for Radio series 2021-10-23 01:06:51 +02:00
Remita Amine
2120179b61 [nrk] reduce the number of instalments requests 2021-10-23 01:06:51 +02:00
Remita Amine
392743d1e4 [nrk] improve format extraction 2021-10-23 01:06:51 +02:00
Remita Amine
917f2ec68d [nrk] improve extraction 
- improve format extraction for old akamai formats
- update some of the tests
- add is_live value to entry info dict
- request instalments only when their available
- fix skole extraction
 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
9c92a54488 [peertube] Extract fps 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
c23e70b2e7 [peertube] Recognize audio-only formats (closes #27295) 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
c11211efce [teachable:course] Improve extraction (closes #24507, closes #27286) 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
427dfe7ca9 [nrk] Improve error extraction 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
24342b07db [nrktv] Relax _VALID_URL 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
3d5bbf574b [nrktv:series] Improve extraction (closes #21926) 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
8b78e040c0 [nrktv:series] Improve extraction 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
d98d4ea999 [nrktv:season] Improve extraction 2021-10-23 01:06:51 +02:00
Remita Amine
3935b7503d [nrk] fix call to moved method 2021-10-23 01:06:51 +02:00
Remita Amine
c3f178555c [nrk] fix typo 2021-10-23 01:06:51 +02:00
Remita Amine
9cd7a23c87 [nrk] improve format extraction and geo-restriction detection (closes… 
… #24221)
 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
3012eb0bee [pornhub] Handle HTTP errors gracefully (closes #26414) 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
9647acd865 [nrktv] Relax _VALID_URL (closes #27299, closes #26185) 2021-10-23 01:06:51 +02:00
Remita Amine
5657492d8b [zdf] extract webm formats(closes #26659) 2021-10-23 01:06:51 +02:00
Matthew Rayermann
a2c136b114 [nhk] Add audio clip test to NHK extractor (#27269) 2021-10-23 01:06:51 +02:00
Remita Amine
aae5e2a9ae [gamespot] Extract DASH and HTTP formats 2021-10-23 01:06:51 +02:00
Remita Amine
f1544fba1b [extractor/commons] improve Akamai HTTP formats extraction 2021-10-23 01:06:51 +02:00
Remita Amine
3e720fb782 [tver] correct episode_number key 2021-10-23 01:06:51 +02:00
Remita Amine
b4790d23c3 [extractor/common] improve Akamai HTTP format extraction 
- Allow m3u8 manifest without an additional audio format
- Fix extraction for qualities starting with a number
Solution provided by @nixxo based on: https://stackoverflow.com/a/5984688
 2021-10-23 01:06:51 +02:00
Remita Amine
7eaf5dfb74 [tver] Add new extractor (closes #26662)(closes #27284) 2021-10-23 01:06:51 +02:00
Remita Amine
a542d171f2 [extractors] Add QubIE import 2021-10-23 01:06:51 +02:00
Remita Amine
25b8a45235 [tva] Add support for qub.ca (closes #27235) 2021-10-23 01:06:51 +02:00
Remita Amine
cb2a719249 [toggle] Detect DRM protected videos (closes #16479)(closes #20805) 2021-10-23 01:06:51 +02:00
Remita Amine
1016c56cd3 [toggle] Add support for new MeWatch URLs (closes #27256) 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
00fc0dea8c [cspan] Extract info from jwplayer data (closes #3672, closes #3734, … 
…closes #10638, closes #13030, closes #18806, closes #23148, closes #24461, closes #26171, closes #26800, closes #27263)
 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Roman=20Ber=C3=A1nek?=
db8e1543b1 [cspan] Pass Referer header with format's video URL (#26032) (closes … 
…#25729)
 2021-10-23 01:06:51 +02:00
Remita Amine
cf0fbf895a [mediaset] add support for movie URLs(closes #27240) 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
c7c2b1d972 [yandexmusic:track] Fix extraction (closes #26449, closes #26669, clo… 
…ses #26747, closes #26748, closes #26762)
 2021-10-23 01:06:51 +02:00
Michael Munch
176b13bab2 [drtv] Extend _VALID_URL (#27243) 2021-10-23 01:06:51 +02:00
bopol
af3b23c63d [ina] Add support for mobile URLs (#27229) 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Adrian=20Heine=20n=C3=A9=20Lang?=
c968fd04de [videa] Adapt to updates (#26301) 
closes #25973, closes #25650.
 2021-10-23 01:06:51 +02:00
Remita Amine
c3d9771ac6 [spreaker] fix SpreakerShowIE test URL 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
0f12f211cf [spreaker] Add extractor (closes #13480, closes #13877) 2021-10-23 01:06:51 +02:00
Remita Amine
fd0c0b9663 [viki] fix video API request(closes #27184) 2021-10-23 01:06:51 +02:00
Remita Amine
8ebadf3f79 [bbc] fix BBC Three clip extraction 2021-10-23 01:06:51 +02:00
Remita Amine
67f2b570ef [bbc] fix BBC News videos extraction 2021-10-23 01:06:51 +02:00
Remita Amine
c7e8522059 [medaltv] improve extraction 2021-10-23 01:06:51 +02:00
Joshua Lochner
7fff37c758 [medaltv] Add new extractor (#27149) 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
8315bccf62 [nrk] Fix extraction 2021-10-23 01:06:51 +02:00
Remita Amine
84e0c2cca9 [pinterest] Add support for large collections(more than 25 pins) 2021-10-23 01:06:51 +02:00
Remita Amine
2aa4d9aab1 [franceinter] flake8 2021-10-23 01:06:51 +02:00
renalid
aa8cbb45e3 [franceinter] add thumbnail url (#27153) 
Co-authored-by: remitamine <remitamine@gmail.com>
 2021-10-23 01:06:51 +02:00
Remita Amine
6908e58791 [box] Add new extractor(#5949) 2021-10-23 01:06:51 +02:00
Jia Rong Yee
711ef6c996 [nytimes] Add new cooking.nytimes.com extractor (#27143) 
* [nytimes] support cooking.nytimes.com, resolves #27112

Co-authored-by: remitamine <remitamine@gmail.com>
 2021-10-23 01:06:51 +02:00
Remita Amine
f20b6d8dd4 [rumble] add support for embed pages(#10785) 2021-10-23 01:06:51 +02:00
Remita Amine
2fdf3447c1 [skyit] add support for multiple Sky Italia websites(closes #26629) 2021-10-23 01:06:51 +02:00
Remita Amine
1dd494ee31 [extractor/common] add generic support for akamai http format extraction 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
0ffe0d8bbd [pinterest] Add extractor (closes #25747) 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
63d1574bc8 [svtplay] Fix test title 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
c315d7caf0 [svtplay] Add support for svt.se/barnkanalen (closes #24817) 2021-10-23 01:06:51 +02:00
Mattias Wadman
b6c66dbc79 [svt] Extract timestamp and thumbnail in more cases (#27130) 
Add timestamp, set to "valid from" which i think could been seen as publish time.
Add thumbnail in more cases, seems to was only done in the embedded data case for some reason.
Switch svtplay test url to an existing video and also one with no expire date.
Also add an additional thumbnail url test regex.
 2021-10-23 01:06:51 +02:00
Remita Amine
4e68d816b3 [infoq] fix format extraction(closes #25984) 2021-10-23 01:06:51 +02:00
renalid
eb38071416 [francetv] Update to fix thumbnail URL issue (#27120) 
Fix the thumbnail URL. The issue was here for many years, never fixed. It's done ! :-)

Example : https://www.france.tv/france-2/de-gaulle-l-eclat-et-le-secret/de-gaulle-l-eclat-et-le-secret-saison-1/2035247-solitude.html

failed thumbnail url generated : http://pluzz.francetv.fr/staticftv/ref_emissions/2020-11-02/EMI_1104da66f533cc7dc5d0d07a181a18c2e2fe1d81_20201014122553940.jpg

right thumbnail url fixed : https://sivideo.webservices.francetelevisions.fr/staticftv/ref_emissions/2020-11-02/EMI_1104da66f533cc7dc5d0d07a181a18c2e2fe1d81_20201014122553940.jpg
 2021-10-23 01:06:51 +02:00
Remita Amine
bf3df2dd79 [discoverynetworks] add support new TLC/DMAX URLs(closes #27100) 2021-10-23 01:06:50 +02:00
Remita Amine
1b9cc0baff [rai] fix protocol relative relinker URLs(closes #22766) 2021-10-23 01:06:50 +02:00
Remita Amine
9c2afc03ee [rai] fix unavailable video format detection 2021-10-23 01:06:50 +02:00
Remita Amine
081b5611f1 [rai] improve extraction 2021-10-23 01:06:50 +02:00
Leonardo Taccari
1f784e32ec [rai] Fix extraction for recent raiplay.it updates (#27077) 
- Remove first test of RaiPlayIE: it is no longer available
- Make RaiPlayIE extension-agnostic (passing possible `.json' URLs is now
  supported too)
- Adjust RaiPlayLiveIE to recent raiplay.it updates.  Passing it as
  `url_transparent' is no longer supported (there is no longer an accessible
  ContentItem)
- Adjust RaiPlayPlaylistIE to recent raiplay.it updates and instruct it about
  ContentSet-s.
- Update a RaiIE test and remove two tests that are no longer availables

Thanks to @remitamine for the review!
 2021-10-23 01:06:50 +02:00
Remita Amine
ab19e26c5d [viki] improve format extraction 2021-10-23 01:06:50 +02:00
beefchop
7f6aa287d7 [viki] fix stream extraction from mpd (#27092) 
Co-authored-by: beefchop <beefchop@users.noreply.github.com>
 2021-10-23 01:06:50 +02:00
Remita Amine
0a76a87779 [amara] improve extraction 2021-10-23 01:06:50 +02:00
Joost Verdoorn
3182075ad6 [Amara] Add new extractor (#20618) 
* [Amara] Add new extractor
 2021-10-23 01:06:50 +02:00
Remita Amine
a9fd199643 [vimeo:album] fix extraction(closes #27079) 2021-10-23 01:06:50 +02:00
Remita Amine
dc9feaf10e [mtv] fix mgid extraction(closes #26841) 2021-10-23 01:06:50 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
4f7945880e [youporn] Fix upload date extraction and make comment count optional … 
…(closes #26986)
 2021-10-23 01:06:50 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
7910bb7586 [arte] Rework extractors 
* Reimplement embed and playlist extractors to delegate to the single entrypoint artetv extractor
  Beware reluctant download archive extractor keys breakage.
* Improve embeds detection (closes #27057)
- Remove obsolete code
 2021-10-23 01:06:50 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
60ee706bbd [arte] Extract m3u8 formats (closes #27061) 2021-10-23 01:06:50 +02:00
Remita Amine
fe97445dc3 [mgtv] fix format extraction(closes #26415) 2021-10-23 01:06:50 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
00a35be6f7 [extractor/common] Output error for invalid URLs in _is_valid_url (re… 
…fs #21400, refs #24151, refs #25617, refs #25618, refs #25586, refs #26068, refs #27072)
 2021-10-23 01:06:50 +02:00
Remita Amine
276aef5dde [francetv] improve info extraction 2021-10-23 01:06:50 +02:00
gdzx
c8a6cd5640 [francetv] Add fallback video url extraction (#27047) 
Fallback on another API endpoint when no video formats are found.

Closes ytdl-org#22561
 2021-10-23 01:06:50 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
d445ef16e7 [spiegel] Fix extraction (closes #24206, closes #24767) 
Code picked from PR #24767 since original repo is not available due to takedown.
 2021-10-23 01:06:50 +02:00
Remita Amine
f91186eb70 [malltv] fix extraction(closes #27035) 2021-10-23 01:06:50 +02:00
Remita Amine
d420d23ad2 [bandcamp] extract playlist_description(closes #22684) 2021-10-23 01:06:50 +02:00
Remita Amine
e23e51ca94 [urplay] fix extraction(closes #26828) 2021-10-23 01:06:50 +02:00
Remita Amine
02f491e375 [lrt] fix extraction with empty tags(closes #20264) 2021-10-23 01:06:50 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
71d074ba46 [ndr:embed:base] Extract subtitles (closes #25447, closes #26106) 2021-10-23 01:06:50 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
cb9623206e [servus] Add support for pm-wissen.com (closes #25869) 2021-10-23 01:06:50 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
4b3da7ce47 [servus] Fix extraction (closes #26872, closes #26967, closes #26983,… 
… closes #27000)
 2021-10-23 01:06:50 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?=
23c968301c [xtube] Fix extraction (closes #26996) 2021-10-23 01:06:50 +02:00
Remita Amine
41ba58cea2 [lrt] fix extraction 2021-10-23 01:06:50 +02:00
Remita Amine
099936f4e6 [condenast] fix extraction and extract subtitles 2021-10-23 01:06:50 +02:00
Remita Amine
3ac79c2585 [bandcamp] fix extraction 2021-10-23 01:06:50 +02:00
Remita Amine
fc645d1052 [rai] fix RaiPlay extraction 2021-10-23 01:06:50 +02:00
Remita Amine
065a8e40de [usanetwork] fix extraction 2021-10-23 01:06:50 +02:00
Remita Amine
8ff536d5be [nbc] fix NBCNews/Today/MSNBC extraction 2021-10-23 01:06:50 +02:00
Remita Amine
d23d09c709 [cnbc] fix extraction 2021-10-23 01:06:50 +02:00
Laura Liberda
f42428e8e0 tvn24: next.js frontend extraction without playwright 
thanks to @ptrcnull
 2021-02-25 15:35:14 +01:00
Laura Liberda
07f5e2ae1c common: next.js data searcher 2021-02-25 15:22:17 +01:00
Laura Liberda
3ac7b35f1b PolskaPress extractor 2021-02-24 17:06:33 +01:00
Laura Liberda
f91cd92ea0 [x-news] search for x-link in divs 2021-02-24 14:48:54 +01:00
Laura Liberda
8d30f19740 transistorfm extractors 
based on extractor by @asz: https://github.com/ytdl-org/youtube-dl/pull/28022
 2021-02-24 12:20:49 +01:00
Dominika
eb0891a824 version 2021.02.23 2021-02-23 15:06:34 +01:00
Laura Liberda
84c08079bd [youtube] fix dynamic crypto 2021-02-23 14:01:39 +01:00
Dominika Liberda
13db87c0a2 + new crypto for YT 2021-02-22 20:31:44 +01:00
Dominika Liberda
85bb796e05 * jwplayer search meaningful error 2021-02-22 20:23:33 +01:00
Laura Liberda
e35e90a263 [tvn24] fix age_limit on fakty 2021-02-12 13:16:04 +01:00
Laura Liberda
9bcb5f1b61 [tvn24] fix fakty extraction (closes #37) 2021-02-12 12:59:24 +01:00
Laura Liberda
ac9192619a [pulsevideo] support age limit 2021-02-11 14:34:59 +01:00
Laura Liberda
4cfa7883a3 [clip.rs] fix extraction 2021-02-11 14:08:07 +01:00
Laura Liberda
b55552ad1a [vod.pl] fix extraction 2021-02-11 13:18:57 +01:00
Laura Liberda
630a86c5e3 refactor from onet mvp to pulsevideo 2021-02-11 01:09:05 +01:00
Laura Liberda
46643f645d [pulsembed] fix 2021-02-10 22:06:47 +01:00
Laura Liberda
62008d3f8b pulsembed extractor 2021-02-10 01:55:47 +01:00
Laura Liberda
d980ef4e35 [tvp:embed] fix DeprecationWarning 2021-02-10 01:50:08 +01:00
Laura Liberda
bffba35446 [x-link] add iframe support 2021-02-10 01:39:10 +01:00
Laura Liberda
07f326f52d [tvp:embed] fix _extract_urls 2021-02-10 01:05:00 +01:00
Laura Liberda
f2038499ef [OnetMVP] url extractor 2021-02-10 00:40:16 +01:00
Laura Liberda
a60c736c44 [tvp:embed] new url scheme and url extractor 2021-02-10 00:39:27 +01:00
Laura Liberda
edca3b8c96 simplify libsyn extraction 2021-02-10 00:38:40 +01:00
Laura Liberda
b98dd103da [tiktok] user profile extractor 2021-02-05 16:37:22 +01:00
Laura Liberda
a9cd876cf9 [lurker] domain update 2021-02-05 13:00:36 +01:00
Laura Liberda
87fad4b7eb x-link (x-news.pl embeds) extractor 2021-01-31 01:30:47 +01:00
Laura Liberda
a3816f69be [generic] normalizing embeds part 2137 2021-01-31 01:26:39 +01:00
Laura Liberda
b1c1d64de0 albicla extractor 2021-01-30 19:47:13 +01:00
Laura Liberda
d2e522de09 wp.pl extractor 2021-01-25 15:45:55 +01:00
Laura Liberda
0b1dcd17b3 [tvn24] fix next.js frontend extraction on no cookies 2021-01-24 22:21:55 +01:00
Laura Liberda
f39144fa0a [youtube] youtube.com/video/ url scheme 2021-01-24 20:14:01 +01:00
Laura Liberda
d14745983d [peertube] reduce request amount if webpage downloaded 2021-01-24 06:13:30 +01:00
Dominika
e65850dfd5 version 2021.01.24 2021-01-24 05:17:04 +01:00
Laura Liberda
d08ac18c25 [tvn24] remove tvn24bis.pl references, remove GDPR consent cookies before opening page in browser 2021-01-24 04:56:39 +01:00
Laura Liberda
85e45ed607 remove phantomjs wrapper (closes #28) 2021-01-23 20:18:54 +01:00
Laura Liberda
95b061297c [pornhub] refactor scraping protection workaround from phantomjs to playwright 2021-01-23 20:15:27 +01:00
Laura Liberda
1285da6e17 [youtube] match /shorts/ urls 2021-01-23 15:42:50 +01:00
Laura Liberda
570cf794a9 [agora] wyborcza/wysokieobcasy/tokfm podcast fixes 2021-01-23 00:31:40 +01:00
Laura Liberda
bed7b7f44c [crunchyroll] connect to https by default 2021-01-22 20:00:06 +01:00
Laura Liberda
339db8d1d2 [tvn24] support nextjs frontend (playwright required) and magazine 2021-01-22 19:59:00 +01:00
Laura Liberda
54ea13966e [youtube] minor playlist improvements 2021-01-19 18:45:18 +01:00
Laura Liberda
c53f744097 playwright wrapper (#28) 2021-01-18 22:39:18 +01:00
Laura Liberda
365daad4f5 oko.press extractor 2021-01-18 03:52:28 +01:00
Laura Liberda
abfbb7d014 _json_ld: podcasts objects 2021-01-18 03:52:19 +01:00
Laura Liberda
254f95b75f wyborcza extractors, merge agora extractors files 2021-01-17 08:41:00 +01:00
Laura Liberda
d959fff39f lurker extractor 2021-01-17 06:08:30 +01:00
Dominika
2c354d15a0 version 2021.01.16 2021-01-16 02:38:11 +01:00
Laura Liberda
097c7bd4ba linkedin:post extractor 2021-01-11 17:58:24 +01:00
Laura Liberda
05620dab04 [weibo] dash formats 2021-01-10 23:36:29 +01:00
Laura Liberda
eb1333e65b [vimeo:review] fix videos with video password 
https://github.com/ytdl-org/youtube-dl/issues/27591
 2021-01-10 10:42:15 +01:00
Laura Liberda
90291aa422 gtv.org extractor, I guess 2021-01-10 09:56:59 +01:00
Laura Liberda
fe0f39da07 fix for youtube topic channels 2021-01-10 01:27:39 +01:00
Laura Liberda
90f556c478 [youtube] fix regular channels and playlists 2021-01-10 00:11:36 +01:00
Laura Liberda
d51d7e3865 youtube music album extractor 2021-01-10 00:06:08 +01:00
Laura Liberda
b044df8d86 LBRY extractor 
why did I do this?
 2021-01-09 04:31:11 +01:00
Laura Liberda
2acc7755fc [generic] embetty embeds 2021-01-09 02:11:47 +01:00
Laura Liberda
0abf03dbaf [heise] extract embetty embeds 2021-01-09 02:11:33 +01:00
Laura Liberda
d72d60bf5e embetty extractor 2021-01-09 02:11:12 +01:00
Laura Liberda
2a772c54bb the guardian extractors 2021-01-08 21:01:36 +01:00
Laura Liberda
cf9d87b0e6 [tvp:series] refactor to API 2021-01-08 12:41:55 +01:00
Laura Liberda
6e4b1019e4 basic tuba.fm support 2021-01-08 11:19:15 +01:00
Laura Liberda
c758741d55 rmf extractors 2021-01-07 00:51:08 +01:00
Laura Liberda
0aa7cb240c _json_ld: handle multiple thumbnails 2021-01-07 00:49:10 +01:00
Laura Liberda
78d9e9046c [cda] refactor to mobile JSON API 2021-01-06 01:28:32 +01:00
Laura Liberda
1d601522cc a bit more embed searching normalization 2021-01-05 20:06:22 +01:00
Dominika Liberda
8f86520b7a version 2021.01.03 2021-01-03 23:30:31 +01:00
Dominika Liberda
5049bf7bea + Ipla Extractor (reverse engineered by @ptrcnull) 2021-01-03 23:16:16 +01:00
Laura Liberda
33c63089d9 tvnplayer:series extractor 2021-01-03 21:13:16 +01:00
Laura Liberda
837924dd1b fix tvnplayer on py2.7 2021-01-03 05:14:37 +01:00
Dominika Liberda
9bba7c1c5f + TVNPlayer Extractor (reverse engineered by @ptrcnull) 2021-01-03 03:52:08 +01:00
Laura Liberda
7ed8e0c502 tokfm podcast and audition extractor 2021-01-03 02:42:43 +01:00
Laura Liberda
d915fe0b0c [generic] embed searching normalization 2/n 2021-01-01 07:05:16 +01:00
Laura Liberda
c73049bc5b [youtube] alt_title w/ eng title, if it differs from the original one 2020-12-14 18:52:31 +01:00
Laura Liberda
49bf656179 [generic] simplify the embed searching a lot 2020-12-14 17:12:34 +01:00
Laura Liberda
c9accf707d [funkwhale] fix TypeError on null album release date 2020-12-13 22:19:20 +01:00
Laura Liberda
048bac7c49 [funkwhale:channel] fix tests 2020-12-13 22:13:54 +01:00
Laura Liberda
c3e1d87fcd [funkwhale] add webpage_url 2020-12-13 22:12:46 +01:00