Commit graph

1351 commits

Author SHA1 Message Date
Tobias Gruetzmacher
5afab71e7f Fix BoredAndEvil 2020-09-29 22:35:09 +02:00
Tobias Gruetzmacher
5863ddb73b Fix BookOfBiff 2020-09-29 22:27:32 +02:00
Tobias Gruetzmacher
bbac2f99a7 Fix BetweenFailures 2020-09-29 22:22:55 +02:00
Tobias Gruetzmacher
3330162c6b Fix BetterDays with archive.org 2020-09-29 21:35:41 +02:00
Tobias Gruetzmacher
e98a1601ca Remove workaround for libxml2 older 2.9.3 (2015)
This workaround was written in 2016 while that version was still found
on many systems. Addionally, this workaround needs to be enabled by the
developer, who might not even be aware that they need to enable it for a
specific module. We still throw a warning to the user if running with
such an old libxml version.
2020-09-29 21:16:48 +02:00
Tobias Gruetzmacher
c065a820ed Fix BadMachinery and mark as endOfLife 2020-09-29 21:01:33 +02:00
Tobias Gruetzmacher
24efafdf96 Fix BMovieComic 2020-09-29 20:30:44 +02:00
Tobias Gruetzmacher
0fe32e7562 Remove unused f-string
Since we still want to support Python 3.5 for a bit, we should avoid
f-strings until we finally drop support for that.
2020-09-28 22:19:48 +02:00
Tobias Gruetzmacher
7e040086b6 Try to inform the user about geo-blocks
Instead of letting the crawler run into "random" error messages, throw a
specific "geoblocked" exception instead.
2020-09-28 13:11:34 +02:00
Tobias Gruetzmacher
e34a0b539c Don't rethrow RequestException as IOError
Since RequestException already is an IOError, nothing of value is lost.
2020-09-28 12:05:01 +02:00
Tobias Gruetzmacher
8d7fd8b884 Update GoComics modules
The usual: GoComics removed some comics, added some and renamed some...
2020-09-28 01:15:07 +02:00
Tobias Gruetzmacher
b090d86c9b Switch Drowtales to parser scraper (also fixes it) 2020-09-27 20:56:26 +02:00
Tobias Gruetzmacher
a7f9692ffe Add StalkerXStalker to WebToons module (fixes #173) 2020-09-27 19:21:28 +02:00
Tobias Gruetzmacher
ccb4c32c6b Fix DumbingOfAge 2020-09-27 19:16:34 +02:00
Tobias Gruetzmacher
346b3b4abd Fix ShipInABottle 2020-09-27 18:34:36 +02:00
Tobias Gruetzmacher
632433d896 Move CrapIDrewOnMyLunchBreak to WebToons
Unfortunatly, the original website is broken.
2020-09-27 18:25:33 +02:00
Tobias Gruetzmacher
85c40a942f Remove StuffNoOneToldMe 2020-09-27 15:50:48 +02:00
Tobias Gruetzmacher
8cc916b292 Fix CynWolf 2020-09-27 15:50:25 +02:00
Tobias Gruetzmacher
193b3da801 Repair EarthsongSaga (fixes #172)
Verified as fetching the complete history right now.
2020-09-26 11:29:45 +02:00
Tobias Gruetzmacher
383e759a0e Switch Achewood to ParserScraper 2020-09-26 09:42:48 +02:00
Tobias Gruetzmacher
fd779475c1 Fix first comic for Achewood (fixes #175) 2020-09-26 09:31:31 +02:00
garbled1
598cdd092c Add TheGlassScientists 2020-09-13 08:28:19 -07:00
garbled1
c870f71715 Add TheBoyWhoFell 2020-09-13 08:18:42 -07:00
garbled1
f223bc09fb Add TheForgottenOrder 2020-09-13 08:14:52 -07:00
garbled1
5fca596216 Add SisterClaire 2020-09-13 08:11:05 -07:00
garbled1
4dd52cd160 Add NeverSatisfied 2020-09-13 08:04:02 -07:00
garbled1
3b27a530d7 Add GuildedAge 2020-09-13 07:52:38 -07:00
garbled1
6fa835c928 Add ParaNatural 2020-09-13 07:48:32 -07:00
garbled1
10b419331a Add SaffronAndSage 2020-09-13 07:37:24 -07:00
garbled1
6eb0087c9f Add DaughterOfTheLilies 2020-09-13 07:25:05 -07:00
Techwolf
d4fb75b844 Add MangaDex/TheWolfAndRedRidingHood 2020-08-19 00:04:55 -07:00
Techwolf
073890c237 Add MangaDex/HangingOutWithAGamerGirl 2020-08-15 21:11:40 -07:00
Techwolf
191df7d5ed Mark SchlockMercenary as endOfLife 2020-08-14 20:51:34 -07:00
Techwolf
70c030ca32 Add MangaDex/OokamiShounenWaKyouMoUsoOKasaneru 2020-08-14 20:51:34 -07:00
Techwolf
49c02541f4 Add MangaDex/KawaiiJoushiWoKomarasetai 2020-08-14 20:51:34 -07:00
Techwolf
711d8d5e23 Fix BlackTapestries and TheRealmOfKaerwyn 2020-08-14 20:51:34 -07:00
Techwolf
103520e586 Add LazJonesAndTheMayfieldRegulators/SideStories 2020-08-14 20:51:34 -07:00
Techwolf
2c05fbb78f Fix Tamberlane 2020-08-14 20:51:34 -07:00
Techwolf
4a24afa652 Mark OriginalLife as endOfLife 2020-08-14 20:51:34 -07:00
Techwolf
88e54258d0 Fix StudioKhimera/UberQuest 2020-08-14 20:51:34 -07:00
Techwolf
1e4c291145 Add ComicFury/LustAndIre 2020-08-14 20:51:34 -07:00
Techwolf
5d27402346 Add TheNightBelongsToUs 2020-08-14 20:51:34 -07:00
Techwolf
a191f7e909 Add SoloLeveling 2020-08-14 20:51:34 -07:00
Techwolf
2ef6ebb6f8 Fix Nightshift and StarfireAgency 2020-08-14 20:51:33 -07:00
Techwolf
2688ffad91 Fix DesertFox 2020-08-14 20:51:33 -07:00
Techwolf
9764b82101 Fix Moonlace and Bethellium 2020-08-14 20:51:33 -07:00
Techwolf
c29bd2f069 Add ProjectFuture/Emily 2020-08-14 20:51:33 -07:00
Techwolf
de3b396d11 Add RayFox 2020-08-14 20:51:33 -07:00
Techwolf
4726497c06 Update WebToons comics 2020-08-14 20:50:54 -07:00
Techwolf
c362f39e3a Fix FurryExperience 2020-08-14 20:50:54 -07:00
Tobias Gruetzmacher
7a176b29f2 Replace xpath_class with custom xpath function 2020-07-31 22:56:30 +02:00
Tobias Gruetzmacher
64123eab64 Add an xpath extension to match CSS classes 2020-07-31 20:14:04 +02:00
Tobias Gruetzmacher
bd44fdbb79 Fix SequentialArt (closes #167) 2020-07-31 19:28:25 +02:00
Tobias Gruetzmacher
98d5d9eb26 Switch SinFest to parser scraper (fixes #168) 2020-07-02 22:54:20 +02:00
Techwolf
cac269e0bc Fix AntiheroForHire 2020-04-29 01:40:27 -07:00
Techwolf
9b69eaf4ff Fix Nightshift 2020-04-29 01:40:27 -07:00
Techwolf
d3f2a9e27a Fix NSFW tagging 2020-04-22 01:40:30 -07:00
Techwolf
7f1ffff3ac Add KeenSpot/GeneCatlowAlternate 2020-04-22 01:39:52 -07:00
DavidAccola
131deeaa34
Add False Knees and Yes, I'm Hot in This (#161) 2020-04-20 01:00:38 +02:00
Tobias Gruetzmacher
c8374474c6 Remove _TumblrScraper (no modules uses it anymore) 2020-04-20 00:49:53 +02:00
Tobias Gruetzmacher
23b028feaf Add WebcomicName 2020-04-19 23:42:27 +02:00
Tobias Gruetzmacher
dbe8e57e11 Fix license header for imported code 2020-04-18 13:57:18 +02:00
Tobias Gruetzmacher
27d28b8eef Update file headers
The default encoding for source files is UTF-8 since Python 3, so we can
drop all encoding headers. While we are at it, just replace them with
SPDX headers.
2020-04-18 13:45:44 +02:00
Tobias Gruetzmacher
e70bf8c7ad Small style fixes (mostly in tests) 2020-04-18 13:03:02 +02:00
Techwolf
c2e3264be0 Add LazJonesAndTheMayfieldRegulators 2020-04-18 11:44:05 +02:00
Techwolf
2068130ae1 Add WintersLight 2020-04-18 11:44:05 +02:00
Techwolf
dc387819f2 Fix Bethellium 2020-04-18 11:44:05 +02:00
Techwolf
345a1aff30 Fix GrowingTroubles 2020-04-18 11:44:05 +02:00
Techwolf
137e599dd3 Fix IslaAukate and IslaAukateColor 2020-04-18 11:44:05 +02:00
Tobias Gruetzmacher
28fa430b8a Fix categories of some WebToons comics 2020-04-14 01:38:41 +02:00
Ruthalas
e9ccdfca37
Add 11 Mangadex Comics (#160)
Added AttackonTitan, DeliciousinDungeon, DrStone, HeavensDesignTeam, OMaidensinYourSavageSeason, PleaseDontBullyMeNagatoro, PleaseDontBullyMeNagatoroComicAnthology, PleaseTellMeGalkochan, SPYxFAMILY, YotsubaAnd, InterspeciesReviewers
2020-04-13 10:00:46 +02:00
Tobias Gruetzmacher
62c3540c28 Remove (useless) wrapper around html.unescape 2020-04-13 01:53:45 +02:00
Daniel Ring
595c49ba53
Add MangaDex site engine (#159) 2020-04-12 12:54:15 +02:00
Daniel Ring
e1821e23ba
Minor fixes to several strips (#158)
* Fix Twokinds
* Fix XKCD
* Fix Unsounded
* Fix SluggyFreelance
* Fix Oglaf
* Fix missing and incorrect renames
* Fix WLP/PeterIsTheWolf{General,Adult}
2020-04-06 13:23:23 +02:00
Techwolf
d9988bc55d Fix WebToons file naming 2020-04-02 12:58:17 +02:00
Techwolf
206db33761 Add ComicFury/Scuvener 2020-04-02 12:58:17 +02:00
Techwolf
4d1a0d9ad3 Fix TheWhiteboard 2020-03-26 01:01:09 +01:00
Techwolf
92f02ce660 Fix Nightshift 2020-03-26 01:00:00 +01:00
Techwolf
daf734c53d Fix TheOrderOfTheStick 2020-03-26 00:59:02 +01:00
Techwolf
997953f861 Add Exvulnerum 2020-03-26 00:58:28 +01:00
Techwolf
50f8441e9b Add FriendsYouAreStuckWith 2020-03-26 00:58:00 +01:00
Techwolf
8887b7b794 Mark ButImACatPerson as endOfLife 2020-03-26 00:57:40 +01:00
Techwolf
cee1bb67ea Add InsignificantOtters 2020-03-26 00:57:04 +01:00
Techwolf
d889cb7d74 Add TheDepths 2020-03-26 00:56:05 +01:00
Techwolf
b4bc7f27c6 Add BackOffice 2020-03-26 00:55:32 +01:00
Techwolf
c45d3839b2 Update WebToons comic list 2020-03-26 00:55:14 +01:00
Techwolf
12312dd6b4 Add SixGunMage 2020-03-26 00:54:23 +01:00
Techwolf
e49c55109b Merge WebToons Canvas comics into autoupdate block 2020-03-26 00:47:00 +01:00
Tobias Gruetzmacher
c4b7d5b930 Fix index feature for GoComics (fixes #155) 2020-03-26 00:43:43 +01:00
Ruthalas
3d0ab60642
Added two ComicFury comics (#154)
Added Dragons and Silk and View Hub from ComicFury
2020-02-26 21:24:54 +01:00
Ruthalas
5fa65741a2
Added Punderworld (#152)
Added Webtoons/Punderworld
2020-02-14 00:10:49 +01:00
Mark King
a05826f4d6
Fix GoblinsComic (#153)
The site had a redesign a while back which broke this plugin. I've
updated the selectors and confirmed that it's working again.
2020-02-14 00:08:41 +01:00
Tobias Gruetzmacher
44791439a5 Drop Python 2 support: Obsolete future statements 2020-02-04 01:06:19 +01:00
Ruthalas
da137f043c
Added FisheyePlacebo, ScoobandShag, ZomCom (#151)
Added the following to the webtoons plugin: FisheyePlacebo, ScoobandShag, ZomCom
2020-02-04 00:47:14 +01:00
Tobias Gruetzmacher
9c65c3e05f Drop Python 2 support: six & other imports 2020-02-03 01:03:31 +01:00
Techwolf
9fb1fccd08 Fix Draconia (fixes #150) 2020-02-02 21:38:50 +01:00
Tobias Gruetzmacher
932f5ba57b Webtoons: Set ageGatePass cookie
This is only done via JavaScript, but seems to be required in some
regions to use the site.
2020-02-02 21:08:26 +01:00
Techwolf
585cc7dc90 Add site engine for WebToons 2020-02-02 21:00:02 +01:00
Techwolf
eb69210e58 Add self to authors list, update copyright headers 2020-01-28 00:23:15 +01:00
Techwolf
dc923028d5 Add SmackJeeves/WhatWeRememberTheMost 2020-01-28 00:16:10 +01:00
Tobias Gruetzmacher
24be29aec4 Fix Wapsi Square (fixes #149) 2020-01-27 23:46:27 +01:00
Tobias Gruetzmacher
66b89f4fed Fix update check
It should return assets for all platforms, since the repo tarball is
unsuitable for setuptools_scm. Preferred asset is the universal wheel.
2020-01-26 17:42:35 +01:00
Tobias Gruetzmacher
6e14e8709b Reduce allowed line length 2020-01-13 00:36:46 +01:00
Tobias Gruetzmacher
063ce4e85f Prepare old list for next release 2020-01-13 00:18:42 +01:00
Tobias Gruetzmacher
fc4655157a Move some more modules to HTTPS and fix canonical URL 2020-01-12 22:41:06 +01:00
Tobias Gruetzmacher
5e09b631db Move EyeOfRamalach to KemonoCafe 2020-01-12 22:41:06 +01:00
Techwolf
b168e05cfd Add site engine for Derideal 2020-01-12 21:29:47 +01:00
Techwolf
d232d1e43d Add LifeAsRendered 2020-01-12 21:29:47 +01:00
Techwolf
0aa1ba3c66 Fix CatsAndCameras 2020-01-12 21:29:47 +01:00
Techwolf
4219b32074 Fix VerloreGeleentheid 2020-01-12 21:29:47 +01:00
Techwolf
15ac062dff Fix DoemainOfOurOwn 2020-01-12 21:29:47 +01:00
Techwolf
947405a50d Fix Djandora 2020-01-12 21:29:47 +01:00
Techwolf
aa22d05c44 Fix WLP/PeterIsTheWolf 2020-01-12 21:29:47 +01:00
Techwolf
1a938ffa05 Fix Python 2 compatibility for Newshounds 2020-01-12 21:29:47 +01:00
Techwolf
241732bbba Add common handler for mgsisk's Wordpress Webcomic plugin 2020-01-12 21:29:47 +01:00
Techwolf
c44a5a3b43 Mark endOfLife comics as completed when checking for updates 2020-01-12 21:29:47 +01:00
Techwolf
121e63c069 Add site engine for StudioKhimera 2020-01-12 21:29:47 +01:00
Techwolf
f49dff13be Move AddictiveScience to KemonoCafe 2020-01-12 21:29:47 +01:00
Techwolf
af44479b5f Add DesertFox 2020-01-12 21:29:47 +01:00
Techwolf
81b92a8c18 Add KemonoCafe site engine 2020-01-12 21:29:47 +01:00
Techwolf
419c41fb74 Add PeterAndWhitney 2020-01-12 21:19:56 +01:00
Techwolf
6131c9e2b5 Add PeterAndCompany 2020-01-12 21:19:56 +01:00
Techwolf
163b252776 Add ArtificialIncident 2020-01-12 21:19:56 +01:00
Techwolf
e54d153ca7 Add YoshSaga 2020-01-12 21:19:56 +01:00
Techwolf
3503a2bede Add site engine for RHJunior and migrate existing comics 2020-01-12 21:19:56 +01:00
Techwolf
0fed6c2c36 Add site engine for NamirDeiter comics and migrate existing comics 2020-01-12 21:19:56 +01:00
Techwolf
4795613343 Add site engine for ProjectFuture 2020-01-12 19:12:26 +01:00
Techwolf
6576dd7ec7 Add ShadesOfGray 2020-01-12 18:45:06 +01:00
Tobias Gruetzmacher
e393ccdce1 Fix Qwantz 2020-01-09 23:36:05 +01:00
Tobias Gruetzmacher
290f4167d9 Remove Creators/Recess, it's gone 2020-01-09 23:27:46 +01:00
Tobias Gruetzmacher
f0348d6b90 Remove ComicGenesis/Cerintha, it's broken
Additionally, it also exists on SmackJeeves.
2020-01-09 23:23:20 +01:00
Tobias Gruetzmacher
d9045030cc Remove ComicFury/Khulthagar, it's gone 2020-01-09 23:17:43 +01:00
Tobias Gruetzmacher
0f28770aaa Remove old ComicSherpa submodules 2020-01-09 23:15:52 +01:00
Tobias Gruetzmacher
3fe40326e0 Fix AbstruseGoose 2020-01-09 22:59:12 +01:00
Tobias Gruetzmacher
42b5aa9321 Fix Unsounded (fixes #107) 2020-01-09 22:21:20 +01:00
Tobias Gruetzmacher
cfd7b80053 Fix Exiern (fixes #119) 2020-01-09 21:13:54 +01:00
Tobias Gruetzmacher
18546c194a Switch SomethingPositive to parser (fixes #128) 2020-01-09 21:00:24 +01:00
Tobias Gruetzmacher
041d8be7ef Re-add one comic that got lost 2020-01-09 19:46:24 +01:00
Tobias Gruetzmacher
3c930167c6 Remove some comics which disappeared 2020-01-09 18:04:09 +01:00
Tobias Gruetzmacher
ff3b7f2cbe Fix AltermetaOld 2020-01-09 17:41:07 +01:00
Tobias Gruetzmacher
752525c3e9 Fix some old modules using the Internet Archive 2020-01-09 17:38:13 +01:00
Tobias Gruetzmacher
275370a835 Drop webcomic.eu (site is gone)
Not enough archived history to switch to Internet Archive...
2020-01-09 03:52:40 +01:00
Techwolf
63da9dd0d4 Fix Newshounds & ProjectionEdge split 2020-01-09 03:33:19 +01:00
Techwolf
5da87d5a66 Fix firstStripUrl for ComicFury comics 2020-01-09 03:24:09 +01:00
Techwolf
dfbc0b148a Fix Meek 2020-01-09 03:20:34 +01:00
Tobias Gruetzmacher
f05a8c33d4 Take Djandora from Internet Archive 2020-01-09 03:20:34 +01:00
Techwolf
d6e255ea4a Add ProphecyOfTheCircle 2020-01-09 03:20:34 +01:00
Techwolf
f52075d200 Add OffCentaured 2020-01-09 03:20:34 +01:00
Techwolf
32529da7e6 Add SmackJeeves/GrowingTroubles 2020-01-09 03:20:34 +01:00
Techwolf
cffa42a243 Add FoxDad 2020-01-09 03:20:34 +01:00