Sergey M․
ff17be3ac9
[extractor/generic] Extract from LD-JSON last of all
...
Previous sources may contain several formats, e.g. http://tamasha.com/v/PgGZ
2017-08-27 03:31:40 +07:00
Sergey M․
1ed4549942
[extractor/common] Extract format id from label attribute of source tag for HTML5 videos ( #14034 )
2017-08-27 03:27:05 +07:00
Sergey M․
dd121cc1ca
[extractor/common] Extract height from res attribute of source tag for HTML5 videos ( closes #14034 )
2017-08-27 03:12:56 +07:00
Sergey M․
a3c3a1e128
[http] Rework HTTP downloader
...
* Simplify code and split into separate routines to facilitate maintaining
* Make retry mechanism work on errors during actual download not only during connection establishment phase
* Retry on ECONNRESET and ETIMEDOUT during reading data from network
* Retry on content too short and various timeout errors
* Show error description on retry
* Closes #506 , closes #809 , closes #2849 , closes #4240 , closes #6023 , closes #8625 , closes #9483
2017-08-27 02:22:30 +07:00
Sergey M․
085d9dd9be
[rai] Fix audio formats extraction ( closes #14024 )
2017-08-26 22:02:49 +07:00
Vijay Singh
151978f38a
[mixcloud] Fix extraction ( closes #14020 )
2017-08-26 19:32:57 +07:00
Sergey M․
c7121fa7b8
[youtube] Fix controversy videos extraction ( closes #14027 , closes #14029 )
2017-08-26 15:38:38 +07:00
Vijay Singh
745968bc72
[mixcloud] Fix extraction ( closes #14015 )
2017-08-24 22:28:44 +07:00
Sergey M․
df235dbba8
release 2017.08.23
2017-08-23 23:23:13 +07:00
Sergey M․
5bae33485c
[toutv] PEP 8
2017-08-23 22:50:00 +07:00
Sergey M․
0830f3e048
[cbc:watch] Bypass geo-restriction ( closes #13993 )
2017-08-23 22:45:45 +07:00
Sergey M․
8d7a24aff6
[toutv] Relax DRM check ( closes #13994 )
2017-08-23 22:28:09 +07:00
Sergey M․
37d9af306a
[googledrive] Simplify and carry long lines ( #13638 )
2017-08-23 00:33:53 +07:00
Sergey M․
e01c3d2ef7
[extractor/common] Introduce _parse_xml
2017-08-23 00:32:41 +07:00
Parmjit Virk
05915e379a
[googledrive] Add support for subtitles ( fixes #13619 )
2017-08-22 23:48:59 +07:00
Sergey M․
8d9c2a681a
[pornhub] Relax uploader regex ( closes #13906 , closes #13975 )
2017-08-21 23:06:27 +07:00
Luca Steeb
8239c6791a
[bandcamp:album] Extract track titles
2017-08-20 23:32:33 +07:00
Sergey M․
b359e977b9
[extractor/common] Make HLS and DASH extraction non fatal in _parse_html5_media_entries ( closes #13970 )
2017-08-20 14:16:58 +07:00
Sergey M․
d3d45e0a45
[bbccouk] Add support for events URLs ( closes #13893 )
2017-08-19 23:54:15 +07:00
Yen Chi Hsuan
381ad4f309
[liveleak] Support multi-video pages ( closes #6542 )
2017-08-19 22:48:00 +08:00
Yen Chi Hsuan
09747ba766
[liveleak] Support another liveleak embedding pattern ( closes #13336 )
2017-08-19 22:28:13 +08:00
Yen Chi Hsuan
f8f18f332f
[cda] Fix extraction ( closes #13935 )
2017-08-19 21:44:47 +08:00
Yen Chi Hsuan
95f3f7c20a
[utils] Fix unescapeHTML for misformed string like "&a"" ( #13935 )
2017-08-19 21:40:53 +08:00
Sergey M․
f5469da9e6
[laola1tv] Add support for tv.ittf.com ( closes #13965 )
2017-08-19 19:48:20 +07:00
Sergey M․
d14d9d8903
[mixcloud] Fix extraction ( closes #13958 )
2017-08-18 23:31:42 +07:00
Sergey M․
ea004d34f8
release 2017.08.18
2017-08-18 01:05:27 +07:00
Sergey M․
4a91910365
[qqmusic:toplist] PEP 8
2017-08-18 01:00:07 +07:00
Sergey M․
c0892b2b46
[arte] Detect unavailable videos ( closes #13945 )
2017-08-18 00:58:23 +07:00
Sergey M․
a5ac0c4755
[YoutubeDL] Sanitize byte string format URLs ( #13951 )
2017-08-17 23:59:12 +07:00
Sergey M․
5551d7714d
[generic] Convert redirect URLs to unicode strings ( closes #13951 )
2017-08-17 23:58:01 +07:00
Sergey M․
5f5c7b92dd
[udemy] Fix paid course detection ( #13943 )
2017-08-17 23:14:46 +07:00
Sergey M․
93d0583e34
[pluralsight] Use RPC API for course extraction ( closes #13937 )
2017-08-17 22:45:40 +07:00
Genki Sky
bfabd17b33
Add new extractor
2017-08-17 16:56:06 +08:00
Yen Chi Hsuan
25a6e769a1
[qqmusic] Fix tests and cleanup
2017-08-17 16:39:57 +08:00
Yen Chi Hsuan
d22b67f356
Merge pull request #13805 from gam2046/master
...
Fix QQ Music url changed
2017-08-17 16:11:35 +08:00
Sergey M․
a1aa659662
[periscope] Renew HLS extraction ( closes #13917 )
2017-08-16 23:03:42 +07:00
Sergey M․
4850478543
[extractor/common] Add support for float durations in _parse_mpd_formats ( closes #13919 )
2017-08-15 23:58:00 +07:00
forDream
134d85a7bd
[qqmusic] review
2017-08-15 13:14:35 +08:00
forDream
5c037c0d1f
[qqmusic]support QQMusicSingerIE
2017-08-15 13:14:35 +08:00
forDream
5d1bd3b907
[qqmusic]update valid url
2017-08-15 13:14:34 +08:00
forDream
19ada898dc
fix QQ Music Url changed
2017-08-15 13:14:34 +08:00
Sergey M․
da20951a57
[mixcloud] Extract decrypt key
2017-08-14 22:39:05 +07:00
Sergey M․
16393d6535
release 2017.08.13
2017-08-13 08:58:30 +07:00
Sergey M․
475bcb225f
[pornhub:playlistbase] Skip videos from drop-down menu for all playlists ( closes #12819 , closes #13902 )
2017-08-13 07:53:02 +07:00
Sergey M․
b3c6515365
[fourtube] Add support for other sites ( closes #6022 , closes #7859 , closes #13901 )
2017-08-13 07:23:29 +07:00
Sergey M․
eb02940cc7
[generic] Add test for #13895
2017-08-13 01:11:27 +07:00
Sergey M․
4ef9152428
[limelight] Improve embeds detection ( closes #13895 )
2017-08-13 00:58:39 +07:00
Sergey M․
0c43a481b9
[reddit] Add extractors ( closes #13847 )
2017-08-12 23:43:51 +07:00
Sergey M․
868f79db41
[extractor/common] Fix _media_formats
2017-08-12 19:24:26 +07:00
Sergey M․
70851a95c3
[aparat] Extract all formats ( closes #13887 )
2017-08-12 17:18:23 +07:00
Sergey M․
e74e3b63e3
[YoutubeDL] Make sure format id is not empty
2017-08-12 17:14:11 +07:00
Sergey M․
ac8491fcca
[extractor/common] Make _family_friendly_search optional
2017-08-12 17:11:35 +07:00
Sergey M․
82889d4ae5
[extractor/common] Respect source's type attribute for HTML5 media ( closes #13892 )
2017-08-12 16:48:11 +07:00
Sergey M․
92a5c41532
[mixcloud] Fix play info decryption ( closes #13885 )
2017-08-12 16:30:50 +07:00
Sergey M․
1663bd6e1c
[generic] Replace vzaar embed test
2017-08-11 22:02:00 +07:00
tetra-eder
41918eaa5c
[generic] Add support for vzaar embeds
2017-08-11 22:00:39 +07:00
Sergey M․
6ed99754bb
release 2017.08.09
2017-08-09 23:52:22 +07:00
Sergey M․
baba5f4d1d
[xxxymovies] Fix title extraction ( closes #13868 )
2017-08-09 23:46:49 +07:00
Sergey M․
dee04d24a4
[nick] Add support for nick.com.pl ( closes #13860 )
2017-08-09 23:12:02 +07:00
Sergey M․
5b3ddadcc3
[mixcloud] Fix play info decryption ( closes #13867 )
2017-08-09 22:55:13 +07:00
Sergey M․
5b232f46dc
[utils] Skip missing params in cli_bool_option ( closes #13865 )
2017-08-09 22:28:19 +07:00
Alex Seiler
4bf22f7a10
[20min] Fix embeds extraction
2017-08-08 05:41:38 +07:00
Sergey M․
15d1e8a23d
[dplayit] Fix extraction ( closes #13851 )
2017-08-07 22:43:42 +07:00
Yen Chi Hsuan
ee6a611665
[niconico] Support videos with multiple formats ( closes #13522 )
2017-08-07 00:19:46 +08:00
Yen Chi Hsuan
463e7216c8
[niconico] Support HTML5-only videos ( closes #13806 )
2017-08-06 23:07:28 +08:00
Sergey M․
903a183b6a
release 2017.08.06
2017-08-06 09:05:36 +07:00
Sergey M․
fac188c695
[pluralsight] Fix format selection
2017-08-06 08:44:28 +07:00
Sergey M․
16afce174e
[mpora] Remove extractor ( closes #13826 )
2017-08-06 08:18:16 +07:00
Sergey M․
e2b4808fd8
[voot] Improve extraction ( #10255 , closes #11814 )
2017-08-06 08:05:29 +07:00
Ashutosh Chaudhary
daaaf5f594
[voot] Add extractor
2017-08-06 08:05:24 +07:00
Sergey M․
f172c86dcd
[vlive:channel] Limit number of videos per page to 100 ( closes #13830 )
2017-08-05 21:17:55 +07:00
Sergey M․
1d5472290f
[podomatic] Extend _VALID_URL ( closes #13827 )
2017-08-05 08:28:12 +07:00
Sergey M․
c983cc3b71
[cinchcast] Extend _VALID_URL
2017-08-05 08:17:01 +07:00
Sergey M․
1141e9104b
Use relative paths for DASH fragments ( closes #12990 )
...
10x reduced JSON size
refs #13810
2017-08-05 07:40:29 +07:00
Sergey M․
8519b88f67
[yandexdisk] Relax _VALID_URL ( closes #13824 )
2017-08-05 00:59:07 +07:00
Sergey M․
bbbe1cebfc
[mlb] Update test ( closes #13777 )
2017-08-05 00:09:36 +07:00
Sergey M․
f31fd0693b
[vidme] Extract DASH and HLS formats
2017-08-05 00:00:21 +07:00
Sergey M․
799802f368
[teamfour] Remove extractor ( closes #13782 )
...
Now covered with generic extractor
2017-08-04 23:54:28 +07:00
Sergey M․
b3b5870cba
[pornhd] Fix extraction ( closes #13783 )
2017-08-04 23:51:03 +07:00
Sergey M․
57a38a38c3
[udemy] Fix subtitles extraction ( closes #13812 )
2017-08-04 23:45:13 +07:00
Matt Crupi
11a6793f80
[mlb] Extend _VALID_URL ( closes #13740 )
2017-08-04 22:46:54 +07:00
Sergey M․
183062a4ab
[pbs] Add support for new URL schema ( closes #13801 )
2017-08-03 23:19:59 +07:00
Tithen-Firion
feee8d32e4
[phantomjs] add exe version to debug info
2017-08-03 14:17:25 +02:00
Sergey M․
9118c9f18a
[nrktv] Update API host ( closes #13796 )
2017-08-01 05:21:00 +07:00
Sergey M․
5c9ea67bc0
release 2017.07.30.1
2017-07-30 20:47:31 +07:00
Sergey M․
8b9f50d7cb
[watchbox] Add extractor ( #13739 )
2017-07-30 19:09:44 +07:00
Sergey M․
0ed4758023
[clipfish] Remove extractor
2017-07-30 19:08:44 +07:00
Sergey M․
a0a477b885
[youjizz] Fix extraction ( closes #13744 )
2017-07-30 15:48:22 +07:00
Grzegorz Ruciński
198d4cb40c
[generic] Add support for another ooyala embed pattern ( closes #13727 )
2017-07-30 01:30:04 +07:00
Sergey M․
ca127ab2c1
[ard] Add support for lives ( closes #13771 )
2017-07-29 23:07:28 +07:00
Sergey M․
e445850e69
[soundcloud] Update client id
2017-07-29 18:45:57 +07:00
Sergey M․
836ef26486
[soundcloud:trackstation] Add extractor ( closes #13733 )
2017-07-29 18:41:42 +07:00
Sergey M․
c04017519d
[svtplay] Use geo verification proxy for API request
2017-07-29 15:30:53 +07:00
Sergey M․
2a7a823211
[svtplay] Update API URL ( closes #13767 )
2017-07-29 15:25:32 +07:00
Sergey M․
95908ce453
[extractor/generic] PEP 8
2017-07-29 15:13:12 +07:00
Sergey M․
cbbe66635f
[yandexdisk] Add extractor ( closes #13755 )
2017-07-29 15:10:19 +07:00
Sergey M․
c5a49ff084
[downloader/hls] Use redirect URL as manifest base ( #13755 )
2017-07-29 15:02:41 +07:00
Philipp Hagemeister
24e966e8da
[megaphone] Add extractor
2017-07-28 12:13:19 +02:00
Sergey M․
9682666bda
[amcnetworks] Make rating optional ( closes #12453 )
2017-07-27 02:04:51 +07:00
Sergey M․
f9c48d895b
[cloudy] Fix extraction ( closes #13737 )
2017-07-26 23:12:43 +07:00
Sergey M․
c99d6890cb
[nickru] Add extractor
2017-07-23 21:02:06 +07:00
Sergey M․
70bfab0e9a
[mtv] Improve thumbnal extraction
2017-07-23 21:02:06 +07:00
nyuszika7h
f0e31e32c9
[nick] Automate geo-restriction bypass ( #13711 )
2017-07-23 20:40:04 +07:00
Yen Chi Hsuan
e3ce912c3d
[niconico] improve error reporting ( #13696 )
2017-07-23 16:25:30 +08:00
Yen Chi Hsuan
905d18a7aa
[options] Correctly hide login info from debug outputs ( #13696 )
...
Iterate over opts instead of PRIVATE_OPTS for both performance and
correctness
2017-07-23 16:22:14 +08:00
Sergey M․
0db492c02a
release 2017.07.23
2017-07-23 01:09:09 +07:00
Sergey M․
71dde5eecf
[itv] Fix production id extraction ( closes #13671 )
2017-07-23 00:59:07 +07:00
Sergey M․
935d6c20c0
[vidio] Make duration non fatal and fix typo
2017-07-23 00:44:50 +07:00
Sergey M․
e0f1fb0a27
[mtv] Skip missing video parts ( closes #13690 )
2017-07-23 00:25:23 +07:00
Sergey M․
0017d9ad6d
[YoutubeDL] Improve default format specification ( closes #13704 )
2017-07-23 00:12:01 +07:00
Sergey M․
327c8364f1
[sportbox:embed] Fix extraction
2017-07-22 21:35:14 +07:00
dubber0
359aa2fdd1
[npo] Add support for npo3.nl URLs
2017-07-22 19:15:55 +07:00
Sergey M․
f76c02c87b
[dramafever] Fix tests
2017-07-22 11:41:40 +07:00
Sergey M․
7d9a1db111
[dramafever] Remove video id from title ( closes #13699 )
2017-07-22 11:40:46 +07:00
Sergey M․
0396806f67
[YoutubeDL] Do not override id, extractor and extractor_key in url_transparent
...
All these meta fields must be borrowed from final extractor that actually performs extraction.
This commit fixes extractor id in download archives for url_transparent downloads. Previously, 'transparent' extractor was erroneously
used for extractor archive id, e.g. 'eggheadlesson 4n8ugwwj5t' instead of 'wistia 4n8ugwwj5t'.
2017-07-21 00:13:32 +07:00
Sergey M․
dc6520aa3d
[egghead:lesson] Add extractor ( #6635 )
2017-07-20 23:22:36 +07:00
Sergey M․
c653326a14
[funnyordie] Extract more metadata ( closes #13677 )
2017-07-20 22:50:56 +07:00
Yen Chi Hsuan
3fcf346ac1
[youku:show] Refine playlist extraction
...
Handle playlists that the initial page is not the first page
2017-07-20 23:20:46 +08:00
Yen Chi Hsuan
fa63cf6c23
[youku:show] Fix playlist extraction ( closes #13248 )
2017-07-20 22:57:51 +08:00
Yen Chi Hsuan
85f5a74b6c
[tbs] Mark as broken and skip invalid tests
2017-07-20 21:19:09 +08:00
Yen Chi Hsuan
d20b1c6725
[dispeak] Recognize sevt subdomain ( closes #13276 )
2017-07-20 18:14:14 +08:00
Sergey M․
bb176df3bb
[spiegel:article] Move test
2017-07-17 22:19:40 +07:00
Sergey M․
83d00044c1
[adn] Improve error reporting ( #13663 )
2017-07-16 20:50:32 +07:00
Sergey M․
7abed4e06c
[crunchyroll] Relax series and season regex ( closes #13659 )
2017-07-16 12:40:45 +07:00
Sergey M․
13eb526f11
[nexx:embed] PEP 8
2017-07-16 05:23:19 +07:00
Sergey M․
00d06e3cfc
[spiegel:article] Add support for nexx iframe embeds ( closes #13029 )
2017-07-16 04:38:20 +07:00
Sergey M․
749ca5eced
[extractor/common] Fix playlist_from_matches
2017-07-16 04:33:14 +07:00
Sergey M․
3f59b0154a
[nexx:embed] Add extractor for iframe embeds
2017-07-16 04:32:37 +07:00
Sergey M․
089b97cfee
[nexx] Improve JS embed extraction
2017-07-16 04:30:48 +07:00
Sergey M․
decf86044d
[pearvideo] Improve ( closes #13031 )
2017-07-16 03:06:04 +07:00
troywith77
94b817edeb
[pearvideo] Add extractor
2017-07-16 03:02:31 +07:00
Sergey M․
cea931a9e5
release 2017.07.15
2017-07-15 07:36:05 +07:00
Sergey M․
961ea474b6
[YoutubeDL] PEP 8
2017-07-15 07:02:57 +07:00
Sergey M․
ea3f20494f
[youtube] PEP 8
2017-07-15 07:02:57 +07:00
Sergey M․
c7604d79e9
[spiegeltv] Delegate extraction to nexx ( closes #13159 )
2017-07-15 07:02:57 +07:00
Sergey M․
4e826cd9ae
[nexx] Add extractor ( closes #10807 , closes #13465 )
2017-07-15 07:02:57 +07:00
Robin Neatherway
2583c0b54e
Fix bugs caused by typos
2017-07-14 23:08:32 +07:00
Sergey M․
7d02dcfaa2
[youtube] Don't capture YouTube Red ad for creator meta field ( closes #13621 )
2017-07-14 22:37:04 +07:00
satunnainen
00dbdfc1f7
[slideshare] Fix extraction
2017-07-14 22:11:07 +07:00
rrooij
f354d84807
[5tv] Add another video URL pattern ( closes #13354 )
2017-07-14 22:10:17 +07:00
Sergey M․
15da37c7dc
[YoutubeDL] Don't expand env variables in meta fields ( closes #13637 )
2017-07-14 00:42:12 +07:00
Sergey M․
9a0942ad55
[drtv] Make HLS and HDS extraction non fatal
2017-07-11 22:59:56 +07:00
Sergey M․
f2bb33a986
[ted] Fix subtitles extraction ( closes #13628 , closes #13629 )
2017-07-11 21:36:45 +07:00
Yen Chi Hsuan
3615bfe1b4
[twitter] Fix remaining tests
2017-07-11 16:46:37 +08:00
Yen Chi Hsuan
e8f20ffa03
[vine] Make sure the title won't be empty
...
And fix a relevant TwitterCard test case
2017-07-11 16:05:15 +08:00
Yen Chi Hsuan
9be31e771c
[twitter] Support HLS streams in vmap URLs
2017-07-11 15:48:48 +08:00
Yen Chi Hsuan
7f176ac477
[periscope] Support pscp.tv URLs in embedded frames
...
And fix a relevant twitter test
2017-07-11 15:35:19 +08:00
Yen Chi Hsuan
2edfd745df
[twitter] Extract mp4 urls via mobile API ( closes #12726 )
2017-07-11 15:19:36 +08:00
Yen Chi Hsuan
bb13949197
[niconico] Check login errors ( #12486 )
2017-07-11 15:03:11 +08:00
Yen Chi Hsuan
c3c94ca4a4
[giantbomb] Extract m3u8 formats ( closes #13626 )
2017-07-10 21:34:27 +08:00
