laudom/haruhi-dl
2
0
Fork 0
Code Issues 13 Pull requests Packages Projects Releases Wiki Activity
18079 commits 2 branches 27 tags 47 MiB
Commit graph

272 commits

Author SHA1 Message Date
Michael Munch 176b13bab2 [drtv] Extend _VALID_URL (#27243) 2021-10-23 01:06:51 +02:00
bopol af3b23c63d [ina] Add support for mobile URLs (#27229) 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 06cf4cef12 [YoutubeDL] Write static debug to stderr and respect quiet for dynami… 
…c debug (closes #14579, closes #22593)

TODO: logging and verbosity needs major refactoring (refs #10894)
 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Adrian=20Heine=20n=C3=A9=20Lang?= c968fd04de [videa] Adapt to updates (#26301) 
closes #25973, closes #25650.
 2021-10-23 01:06:51 +02:00
Remita Amine c3d9771ac6 [spreaker] fix SpreakerShowIE test URL 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 0f12f211cf [spreaker] Add extractor (closes #13480, closes #13877) 2021-10-23 01:06:51 +02:00
Remita Amine fd0c0b9663 [viki] fix video API request(closes #27184) 2021-10-23 01:06:51 +02:00
Remita Amine 8ebadf3f79 [bbc] fix BBC Three clip extraction 2021-10-23 01:06:51 +02:00
Remita Amine 67f2b570ef [bbc] fix BBC News videos extraction 2021-10-23 01:06:51 +02:00
Remita Amine c7e8522059 [medaltv] improve extraction 2021-10-23 01:06:51 +02:00
Joshua Lochner 7fff37c758 [medaltv] Add new extractor (#27149) 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 42acea347e [downloader/fragment] Set final file's mtime according to last fragme… 
…nt's Last-Modified header (closes #11718, closes #18384, closes #27138)
 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 8315bccf62 [nrk] Fix extraction 2021-10-23 01:06:51 +02:00
Remita Amine 84e0c2cca9 [pinterest] Add support for large collections(more than 25 pins) 2021-10-23 01:06:51 +02:00
Remita Amine 2aa4d9aab1 [franceinter] flake8 2021-10-23 01:06:51 +02:00
renalid aa8cbb45e3 [franceinter] add thumbnail url (#27153) 
Co-authored-by: remitamine <remitamine@gmail.com>
 2021-10-23 01:06:51 +02:00
Remita Amine 6908e58791 [box] Add new extractor(#5949) 2021-10-23 01:06:51 +02:00
Jia Rong Yee 711ef6c996 [nytimes] Add new cooking.nytimes.com extractor (#27143) 
* [nytimes] support cooking.nytimes.com, resolves #27112

Co-authored-by: remitamine <remitamine@gmail.com>
 2021-10-23 01:06:51 +02:00
Remita Amine f20b6d8dd4 [rumble] add support for embed pages(#10785) 2021-10-23 01:06:51 +02:00
Remita Amine 2fdf3447c1 [skyit] add support for multiple Sky Italia websites(closes #26629) 2021-10-23 01:06:51 +02:00
Remita Amine 1dd494ee31 [extractor/common] add generic support for akamai http format extraction 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 0ffe0d8bbd [pinterest] Add extractor (closes #25747) 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 63d1574bc8 [svtplay] Fix test title 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= c315d7caf0 [svtplay] Add support for svt.se/barnkanalen (closes #24817) 2021-10-23 01:06:51 +02:00
Mattias Wadman b6c66dbc79 [svt] Extract timestamp and thumbnail in more cases (#27130) 
Add timestamp, set to "valid from" which i think could been seen as publish time.
Add thumbnail in more cases, seems to was only done in the embedded data case for some reason.
Switch svtplay test url to an existing video and also one with no expire date.
Also add an additional thumbnail url test regex.
 2021-10-23 01:06:51 +02:00
Remita Amine 4e68d816b3 [infoq] fix format extraction(closes #25984) 2021-10-23 01:06:51 +02:00
renalid eb38071416 [francetv] Update to fix thumbnail URL issue (#27120) 
Fix the thumbnail URL. The issue was here for many years, never fixed. It's done ! :-)

Example : https://www.france.tv/france-2/de-gaulle-l-eclat-et-le-secret/de-gaulle-l-eclat-et-le-secret-saison-1/2035247-solitude.html

failed thumbnail url generated : http://pluzz.francetv.fr/staticftv/ref_emissions/2020-11-02/EMI_1104da66f533cc7dc5d0d07a181a18c2e2fe1d81_20201014122553940.jpg

right thumbnail url fixed : https://sivideo.webservices.francetelevisions.fr/staticftv/ref_emissions/2020-11-02/EMI_1104da66f533cc7dc5d0d07a181a18c2e2fe1d81_20201014122553940.jpg
 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 21c9c8293f [downloader/http] Fix crash during urlopen caused by missing reason o… 
…f URLError
 2021-10-23 01:06:51 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 0b84ab95e5 [YoutubeDL] Fix --ignore-errors for playlists with generator-based en… 
…tries of url_transparent (closes #27064)
 2021-10-23 01:06:50 +02:00
Remita Amine bf3df2dd79 [discoverynetworks] add support new TLC/DMAX URLs(closes #27100) 2021-10-23 01:06:50 +02:00
Remita Amine 1b9cc0baff [rai] fix protocol relative relinker URLs(closes #22766) 2021-10-23 01:06:50 +02:00
Remita Amine 9c2afc03ee [rai] fix unavailable video format detection 2021-10-23 01:06:50 +02:00
Remita Amine 081b5611f1 [rai] improve extraction 2021-10-23 01:06:50 +02:00
Leonardo Taccari 1f784e32ec [rai] Fix extraction for recent raiplay.it updates (#27077) 
- Remove first test of RaiPlayIE: it is no longer available
- Make RaiPlayIE extension-agnostic (passing possible `.json' URLs is now
  supported too)
- Adjust RaiPlayLiveIE to recent raiplay.it updates.  Passing it as
  `url_transparent' is no longer supported (there is no longer an accessible
  ContentItem)
- Adjust RaiPlayPlaylistIE to recent raiplay.it updates and instruct it about
  ContentSet-s.
- Update a RaiIE test and remove two tests that are no longer availables

Thanks to @remitamine for the review!
 2021-10-23 01:06:50 +02:00
Remita Amine ab19e26c5d [viki] improve format extraction 2021-10-23 01:06:50 +02:00
beefchop 7f6aa287d7 [viki] fix stream extraction from mpd (#27092) 
Co-authored-by: beefchop <beefchop@users.noreply.github.com>
 2021-10-23 01:06:50 +02:00
Remita Amine 0a76a87779 [amara] improve extraction 2021-10-23 01:06:50 +02:00
Joost Verdoorn 3182075ad6 [Amara] Add new extractor (#20618) 
* [Amara] Add new extractor
 2021-10-23 01:06:50 +02:00
Remita Amine a9fd199643 [vimeo:album] fix extraction(closes #27079) 2021-10-23 01:06:50 +02:00
Remita Amine dc9feaf10e [mtv] fix mgid extraction(closes #26841) 2021-10-23 01:06:50 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 4f7945880e [youporn] Fix upload date extraction and make comment count optional … 
…(closes #26986)
 2021-10-23 01:06:50 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 7910bb7586 [arte] Rework extractors 
* Reimplement embed and playlist extractors to delegate to the single entrypoint artetv extractor
  Beware reluctant download archive extractor keys breakage.
* Improve embeds detection (closes #27057)
- Remove obsolete code
 2021-10-23 01:06:50 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 60ee706bbd [arte] Extract m3u8 formats (closes #27061) 2021-10-23 01:06:50 +02:00
Remita Amine fe97445dc3 [mgtv] fix format extraction(closes #26415) 2021-10-23 01:06:50 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 00a35be6f7 [extractor/common] Output error for invalid URLs in _is_valid_url (re… 
…fs #21400, refs #24151, refs #25617, refs #25618, refs #25586, refs #26068, refs #27072)
 2021-10-23 01:06:50 +02:00
Remita Amine 276aef5dde [francetv] improve info extraction 2021-10-23 01:06:50 +02:00
gdzx c8a6cd5640 [francetv] Add fallback video url extraction (#27047) 
Fallback on another API endpoint when no video formats are found.

Closes ytdl-org#22561
 2021-10-23 01:06:50 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= d445ef16e7 [spiegel] Fix extraction (closes #24206, closes #24767) 
Code picked from PR #24767 since original repo is not available due to takedown.
 2021-10-23 01:06:50 +02:00
Remita Amine f91186eb70 [malltv] fix extraction(closes #27035) 2021-10-23 01:06:50 +02:00
Remita Amine d420d23ad2 [bandcamp] extract playlist_description(closes #22684) 2021-10-23 01:06:50 +02:00
Remita Amine e23e51ca94 [urplay] fix extraction(closes #26828) 2021-10-23 01:06:50 +02:00
Remita Amine 02f491e375 [lrt] fix extraction with empty tags(closes #20264) 2021-10-23 01:06:50 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 71d074ba46 [ndr:embed:base] Extract subtitles (closes #25447, closes #26106) 2021-10-23 01:06:50 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= cb9623206e [servus] Add support for pm-wissen.com (closes #25869) 2021-10-23 01:06:50 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 4b3da7ce47 [servus] Fix extraction (closes #26872, closes #26967, closes #26983,… 
… closes #27000)
 2021-10-23 01:06:50 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 23c968301c [xtube] Fix extraction (closes #26996) 2021-10-23 01:06:50 +02:00
=?UTF-8?q?Sergey=20M=E2=80=A4?= 64e706884a [utils] Skip ! prefixed code in js_to_json 2021-10-23 01:06:50 +02:00
Remita Amine 41ba58cea2 [lrt] fix extraction 2021-10-23 01:06:50 +02:00
Remita Amine 099936f4e6 [condenast] fix extraction and extract subtitles 2021-10-23 01:06:50 +02:00
Remita Amine 3ac79c2585 [bandcamp] fix extraction 2021-10-23 01:06:50 +02:00
Remita Amine fc645d1052 [rai] fix RaiPlay extraction 2021-10-23 01:06:50 +02:00
Remita Amine 065a8e40de [usanetwork] fix extraction 2021-10-23 01:06:50 +02:00
Remita Amine 8ff536d5be [nbc] fix NBCNews/Today/MSNBC extraction 2021-10-23 01:06:50 +02:00
Remita Amine d23d09c709 [cnbc] fix extraction 2021-10-23 01:06:50 +02:00
Laura Liberda f42428e8e0 tvn24: next.js frontend extraction without playwright 
thanks to @ptrcnull
 2021-02-25 15:35:14 +01:00
Laura Liberda 07f5e2ae1c common: next.js data searcher 2021-02-25 15:22:17 +01:00
Laura Liberda 3ac7b35f1b PolskaPress extractor 2021-02-24 17:06:33 +01:00
Laura Liberda f91cd92ea0 [x-news] search for x-link in divs 2021-02-24 14:48:54 +01:00
Laura Liberda 8d30f19740 transistorfm extractors 
based on extractor by @asz: https://github.com/ytdl-org/youtube-dl/pull/28022
 2021-02-24 12:20:49 +01:00
Dominika eb0891a824 version 2021.02.23 2021-02-23 15:06:34 +01:00
Laura Liberda 84c08079bd [youtube] fix dynamic crypto 2021-02-23 14:01:39 +01:00
Dominika Liberda 5f6c836641 version 2021.02.22 2021-02-22 20:44:54 +01:00
Dominika Liberda 13db87c0a2 + new crypto for YT 2021-02-22 20:31:44 +01:00
Dominika Liberda 85bb796e05 * jwplayer search meaningful error 2021-02-22 20:23:33 +01:00
Laura Liberda e35e90a263 [tvn24] fix age_limit on fakty 2021-02-12 13:16:04 +01:00
Laura Liberda 9bcb5f1b61 [tvn24] fix fakty extraction (closes #37) 2021-02-12 12:59:24 +01:00
Laura Liberda ac9192619a [pulsevideo] support age limit 2021-02-11 14:34:59 +01:00
Laura Liberda 4cfa7883a3 [clip.rs] fix extraction 2021-02-11 14:08:07 +01:00
Laura Liberda b55552ad1a [vod.pl] fix extraction 2021-02-11 13:18:57 +01:00
Laura Liberda 630a86c5e3 refactor from onet mvp to pulsevideo 2021-02-11 01:09:05 +01:00
Laura Liberda f603f36c3f warn about python 2 2021-02-10 22:22:37 +01:00
Laura Liberda 46643f645d [pulsembed] fix 2021-02-10 22:06:47 +01:00
Laura Liberda 62008d3f8b pulsembed extractor 2021-02-10 01:55:47 +01:00
Laura Liberda d980ef4e35 [tvp:embed] fix DeprecationWarning 2021-02-10 01:50:08 +01:00
Laura Liberda bffba35446 [x-link] add iframe support 2021-02-10 01:39:10 +01:00
Laura Liberda 07f326f52d [tvp:embed] fix _extract_urls 2021-02-10 01:05:00 +01:00
Laura Liberda f2038499ef [OnetMVP] url extractor 2021-02-10 00:40:16 +01:00
Laura Liberda a60c736c44 [tvp:embed] new url scheme and url extractor 2021-02-10 00:39:27 +01:00
Laura Liberda edca3b8c96 simplify libsyn extraction 2021-02-10 00:38:40 +01:00
Laura Liberda b98dd103da [tiktok] user profile extractor 2021-02-05 16:37:22 +01:00
Laura Liberda a9cd876cf9 [lurker] domain update 2021-02-05 13:00:36 +01:00
Laura Liberda 87fad4b7eb x-link (x-news.pl embeds) extractor 2021-01-31 01:30:47 +01:00
Laura Liberda a3816f69be [generic] normalizing embeds part 2137 2021-01-31 01:26:39 +01:00
Laura Liberda b1c1d64de0 albicla extractor 2021-01-30 19:47:13 +01:00
Laura Liberda d2e522de09 wp.pl extractor 2021-01-25 15:45:55 +01:00
Laura Liberda 0b1dcd17b3 [tvn24] fix next.js frontend extraction on no cookies 2021-01-24 22:21:55 +01:00
Laura Liberda f39144fa0a [youtube] youtube.com/video/ url scheme 2021-01-24 20:14:01 +01:00
Laura Liberda d14745983d [peertube] reduce request amount if webpage downloaded 2021-01-24 06:13:30 +01:00
Dominika e65850dfd5 version 2021.01.24 2021-01-24 05:17:04 +01:00
Laura Liberda d08ac18c25 [tvn24] remove tvn24bis.pl references, remove GDPR consent cookies before opening page in browser 2021-01-24 04:56:39 +01:00