dmoonfire/dosage
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Activity
2348 commits 1 branch 0 tags 31 MiB
Commit graph

1575 commits

Author SHA1 Message Date
Techwolf
4caef255b4 Add WebToons/OVERPOWERED 2020-11-09 00:54:20 +01:00
Techwolf
f6eb2f088e Add WebToons/Defects 2020-11-09 00:54:20 +01:00
Techwolf
722df37080 Fix DeerMe 2020-11-09 00:54:20 +01:00
Techwolf
7d36a2e552 Add Unconventional 2020-11-09 00:54:20 +01:00
Tobias Gruetzmacher
2fcd8d92f2 Fix GeeksNextDoor (& switch to ParserScraper) 2020-10-18 20:44:47 +02:00
Tobias Gruetzmacher
fdf8164d22 Fix KuroShouri (switch to ParserScraper) 2020-10-18 20:28:00 +02:00
Tobias Gruetzmacher
e64635e86b Stricter style checking & related style fixes 2020-10-11 20:15:27 +02:00
Ruthalas
e84bbe2667
Add three new comics (#177) 
* Add BloopBloopRelationshipComic to Webtoons
* Add Todd Allison & the Petunia Violet to Smack Jeeves
* Add Oversimplified SCP to MangaDex

Co-authored-by: Tobias Gruetzmacher <tobias-git@23.gs>
 2020-10-11 11:30:02 +02:00
Tobias Gruetzmacher
d487485815 Read scraper modules from user data directory 
This allows users to add scrapers without setting up a complete Python
development environment.
 2020-10-04 23:46:57 +02:00
Tobias Gruetzmacher
0bdf3dd94b Allow adding external directories to the plugin package 2020-10-04 22:28:51 +02:00
Tobias Gruetzmacher
3256f9fdc2 Hardcode the "plugins" package name 2020-10-04 22:28:51 +02:00
Tobias Gruetzmacher
9237bd62b2 Convert scraper cache to a class 
This should make it easier to extend with additional entries.
 2020-10-04 22:28:51 +02:00
Tobias Gruetzmacher
26f63fd994 Remove unused property in Output class 2020-10-04 22:12:34 +02:00
Tobias Gruetzmacher
d93fed567c Distribute PyInstaller hook 
This uses a feature introduced in PyInstaller 4.0 to register hooks as
entry points and automatically discover them whenever a module is used.
 2020-10-01 15:51:09 +02:00
Tobias Gruetzmacher
7c2c9c3778 Fix VGCats & switch to HTTPS 2020-09-30 21:37:29 +02:00
Tobias Gruetzmacher
bb71adbe72 Remove VictimsOfTheSystem 
Domain seems to be gone for some month and archive.org doesn't have
enough to switch.
 2020-09-30 21:29:58 +02:00
Tobias Gruetzmacher
23a3e3b101 Switch WastedTalent to ParserScraper 2020-09-30 21:24:01 +02:00
Tobias Gruetzmacher
dfa412c03e Skip videos for WapsiSquare 2020-09-30 21:17:46 +02:00
Tobias Gruetzmacher
bbe3d9f9be Remove WebDesignerCOTW 2020-09-30 21:16:55 +02:00
Tobias Gruetzmacher
437afc685d Add GenshinImpact to Webtoons module 2020-09-30 18:24:33 +02:00
Tobias Gruetzmacher
e4f1f59432 Fix ButtercupFestival 2020-09-29 23:31:38 +02:00
Tobias Gruetzmacher
dc41c318e9 Fix ButterSafe 2020-09-29 23:04:56 +02:00
Tobias Gruetzmacher
f31c0c681d Fix BusinessCat and mark as endOfLife 2020-09-29 23:00:58 +02:00
Tobias Gruetzmacher
2364e8bab3 Fix Brink and mark as endOfLife 2020-09-29 23:00:53 +02:00
Tobias Gruetzmacher
5afab71e7f Fix BoredAndEvil 2020-09-29 22:35:09 +02:00
Tobias Gruetzmacher
5863ddb73b Fix BookOfBiff 2020-09-29 22:27:32 +02:00
Tobias Gruetzmacher
bbac2f99a7 Fix BetweenFailures 2020-09-29 22:22:55 +02:00
Tobias Gruetzmacher
3330162c6b Fix BetterDays with archive.org 2020-09-29 21:35:41 +02:00
Tobias Gruetzmacher
e98a1601ca Remove workaround for libxml2 older 2.9.3 (2015) 
This workaround was written in 2016 while that version was still found
on many systems. Addionally, this workaround needs to be enabled by the
developer, who might not even be aware that they need to enable it for a
specific module. We still throw a warning to the user if running with
such an old libxml version.
 2020-09-29 21:16:48 +02:00
Tobias Gruetzmacher
c065a820ed Fix BadMachinery and mark as endOfLife 2020-09-29 21:01:33 +02:00
Tobias Gruetzmacher
24efafdf96 Fix BMovieComic 2020-09-29 20:30:44 +02:00
Tobias Gruetzmacher
0fe32e7562 Remove unused f-string 
Since we still want to support Python 3.5 for a bit, we should avoid
f-strings until we finally drop support for that.
 2020-09-28 22:19:48 +02:00
Tobias Gruetzmacher
7e040086b6 Try to inform the user about geo-blocks 
Instead of letting the crawler run into "random" error messages, throw a
specific "geoblocked" exception instead.
 2020-09-28 13:11:34 +02:00
Tobias Gruetzmacher
e34a0b539c Don't rethrow RequestException as IOError 
Since RequestException already is an IOError, nothing of value is lost.
 2020-09-28 12:05:01 +02:00
Tobias Gruetzmacher
8d7fd8b884 Update GoComics modules 
The usual: GoComics removed some comics, added some and renamed some...
 2020-09-28 01:15:07 +02:00
Tobias Gruetzmacher
b090d86c9b Switch Drowtales to parser scraper (also fixes it) 2020-09-27 20:56:26 +02:00
Tobias Gruetzmacher
a7f9692ffe Add StalkerXStalker to WebToons module (fixes #173) 2020-09-27 19:21:28 +02:00
Tobias Gruetzmacher
ccb4c32c6b Fix DumbingOfAge 2020-09-27 19:16:34 +02:00
Tobias Gruetzmacher
346b3b4abd Fix ShipInABottle 2020-09-27 18:34:36 +02:00
Tobias Gruetzmacher
632433d896 Move CrapIDrewOnMyLunchBreak to WebToons 
Unfortunatly, the original website is broken.
 2020-09-27 18:25:33 +02:00
Tobias Gruetzmacher
85c40a942f Remove StuffNoOneToldMe 2020-09-27 15:50:48 +02:00
Tobias Gruetzmacher
8cc916b292 Fix CynWolf 2020-09-27 15:50:25 +02:00
Tobias Gruetzmacher
193b3da801 Repair EarthsongSaga (fixes #172) 
Verified as fetching the complete history right now.
 2020-09-26 11:29:45 +02:00
Tobias Gruetzmacher
383e759a0e Switch Achewood to ParserScraper 2020-09-26 09:42:48 +02:00
Tobias Gruetzmacher
fd779475c1 Fix first comic for Achewood (fixes #175) 2020-09-26 09:31:31 +02:00
garbled1
598cdd092c Add TheGlassScientists 2020-09-13 08:28:19 -07:00
garbled1
c870f71715 Add TheBoyWhoFell 2020-09-13 08:18:42 -07:00
garbled1
f223bc09fb Add TheForgottenOrder 2020-09-13 08:14:52 -07:00
garbled1
5fca596216 Add SisterClaire 2020-09-13 08:11:05 -07:00
garbled1
4dd52cd160 Add NeverSatisfied 2020-09-13 08:04:02 -07:00
garbled1
3b27a530d7 Add GuildedAge 2020-09-13 07:52:38 -07:00
garbled1
6fa835c928 Add ParaNatural 2020-09-13 07:48:32 -07:00
garbled1
10b419331a Add SaffronAndSage 2020-09-13 07:37:24 -07:00
garbled1
6eb0087c9f Add DaughterOfTheLilies 2020-09-13 07:25:05 -07:00
Techwolf
d4fb75b844 Add MangaDex/TheWolfAndRedRidingHood 2020-08-19 00:04:55 -07:00
Techwolf
073890c237 Add MangaDex/HangingOutWithAGamerGirl 2020-08-15 21:11:40 -07:00
Techwolf
191df7d5ed Mark SchlockMercenary as endOfLife 2020-08-14 20:51:34 -07:00
Techwolf
70c030ca32 Add MangaDex/OokamiShounenWaKyouMoUsoOKasaneru 2020-08-14 20:51:34 -07:00
Techwolf
49c02541f4 Add MangaDex/KawaiiJoushiWoKomarasetai 2020-08-14 20:51:34 -07:00
Techwolf
711d8d5e23 Fix BlackTapestries and TheRealmOfKaerwyn 2020-08-14 20:51:34 -07:00
Techwolf
103520e586 Add LazJonesAndTheMayfieldRegulators/SideStories 2020-08-14 20:51:34 -07:00
Techwolf
2c05fbb78f Fix Tamberlane 2020-08-14 20:51:34 -07:00
Techwolf
4a24afa652 Mark OriginalLife as endOfLife 2020-08-14 20:51:34 -07:00
Techwolf
88e54258d0 Fix StudioKhimera/UberQuest 2020-08-14 20:51:34 -07:00
Techwolf
1e4c291145 Add ComicFury/LustAndIre 2020-08-14 20:51:34 -07:00
Techwolf
5d27402346 Add TheNightBelongsToUs 2020-08-14 20:51:34 -07:00
Techwolf
a191f7e909 Add SoloLeveling 2020-08-14 20:51:34 -07:00
Techwolf
2ef6ebb6f8 Fix Nightshift and StarfireAgency 2020-08-14 20:51:33 -07:00
Techwolf
2688ffad91 Fix DesertFox 2020-08-14 20:51:33 -07:00
Techwolf
9764b82101 Fix Moonlace and Bethellium 2020-08-14 20:51:33 -07:00
Techwolf
c29bd2f069 Add ProjectFuture/Emily 2020-08-14 20:51:33 -07:00
Techwolf
de3b396d11 Add RayFox 2020-08-14 20:51:33 -07:00
Techwolf
4726497c06 Update WebToons comics 2020-08-14 20:50:54 -07:00
Techwolf
c362f39e3a Fix FurryExperience 2020-08-14 20:50:54 -07:00
Tobias Gruetzmacher
7a176b29f2 Replace xpath_class with custom xpath function 2020-07-31 22:56:30 +02:00
Tobias Gruetzmacher
64123eab64 Add an xpath extension to match CSS classes 2020-07-31 20:14:04 +02:00
Tobias Gruetzmacher
bd44fdbb79 Fix SequentialArt (closes #167) 2020-07-31 19:28:25 +02:00
Tobias Gruetzmacher
98d5d9eb26 Switch SinFest to parser scraper (fixes #168) 2020-07-02 22:54:20 +02:00
Techwolf
cac269e0bc Fix AntiheroForHire 2020-04-29 01:40:27 -07:00
Techwolf
9b69eaf4ff Fix Nightshift 2020-04-29 01:40:27 -07:00
Techwolf
d3f2a9e27a Fix NSFW tagging 2020-04-22 01:40:30 -07:00
Techwolf
7f1ffff3ac Add KeenSpot/GeneCatlowAlternate 2020-04-22 01:39:52 -07:00
DavidAccola
131deeaa34
Add False Knees and Yes, I'm Hot in This (#161) 2020-04-20 01:00:38 +02:00
Tobias Gruetzmacher
c8374474c6 Remove _TumblrScraper (no modules uses it anymore) 2020-04-20 00:49:53 +02:00
Tobias Gruetzmacher
23b028feaf Add WebcomicName 2020-04-19 23:42:27 +02:00
Tobias Gruetzmacher
dbe8e57e11 Fix license header for imported code 2020-04-18 13:57:18 +02:00
Tobias Gruetzmacher
27d28b8eef Update file headers 
The default encoding for source files is UTF-8 since Python 3, so we can
drop all encoding headers. While we are at it, just replace them with
SPDX headers.
 2020-04-18 13:45:44 +02:00
Tobias Gruetzmacher
e70bf8c7ad Small style fixes (mostly in tests) 2020-04-18 13:03:02 +02:00
Techwolf
c2e3264be0 Add LazJonesAndTheMayfieldRegulators 2020-04-18 11:44:05 +02:00
Techwolf
2068130ae1 Add WintersLight 2020-04-18 11:44:05 +02:00
Techwolf
dc387819f2 Fix Bethellium 2020-04-18 11:44:05 +02:00
Techwolf
345a1aff30 Fix GrowingTroubles 2020-04-18 11:44:05 +02:00
Techwolf
137e599dd3 Fix IslaAukate and IslaAukateColor 2020-04-18 11:44:05 +02:00
Tobias Gruetzmacher
28fa430b8a Fix categories of some WebToons comics 2020-04-14 01:38:41 +02:00
Ruthalas
e9ccdfca37
Add 11 Mangadex Comics (#160) 
Added AttackonTitan, DeliciousinDungeon, DrStone, HeavensDesignTeam, OMaidensinYourSavageSeason, PleaseDontBullyMeNagatoro, PleaseDontBullyMeNagatoroComicAnthology, PleaseTellMeGalkochan, SPYxFAMILY, YotsubaAnd, InterspeciesReviewers
 2020-04-13 10:00:46 +02:00
Tobias Gruetzmacher
62c3540c28 Remove (useless) wrapper around html.unescape 2020-04-13 01:53:45 +02:00
Daniel Ring
595c49ba53
Add MangaDex site engine (#159) 2020-04-12 12:54:15 +02:00
Daniel Ring
e1821e23ba
Minor fixes to several strips (#158) 
* Fix Twokinds
* Fix XKCD
* Fix Unsounded
* Fix SluggyFreelance
* Fix Oglaf
* Fix missing and incorrect renames
* Fix WLP/PeterIsTheWolf{General,Adult}
 2020-04-06 13:23:23 +02:00
Techwolf
d9988bc55d Fix WebToons file naming 2020-04-02 12:58:17 +02:00
Techwolf
206db33761 Add ComicFury/Scuvener 2020-04-02 12:58:17 +02:00
Techwolf
4d1a0d9ad3 Fix TheWhiteboard 2020-03-26 01:01:09 +01:00
Techwolf
92f02ce660 Fix Nightshift 2020-03-26 01:00:00 +01:00
Techwolf
daf734c53d Fix TheOrderOfTheStick 2020-03-26 00:59:02 +01:00
Techwolf
997953f861 Add Exvulnerum 2020-03-26 00:58:28 +01:00
Techwolf
50f8441e9b Add FriendsYouAreStuckWith 2020-03-26 00:58:00 +01:00
Techwolf
8887b7b794 Mark ButImACatPerson as endOfLife 2020-03-26 00:57:40 +01:00
Techwolf
cee1bb67ea Add InsignificantOtters 2020-03-26 00:57:04 +01:00
Techwolf
d889cb7d74 Add TheDepths 2020-03-26 00:56:05 +01:00
Techwolf
b4bc7f27c6 Add BackOffice 2020-03-26 00:55:32 +01:00
Techwolf
c45d3839b2 Update WebToons comic list 2020-03-26 00:55:14 +01:00
Techwolf
12312dd6b4 Add SixGunMage 2020-03-26 00:54:23 +01:00
Techwolf
e49c55109b Merge WebToons Canvas comics into autoupdate block 2020-03-26 00:47:00 +01:00
Tobias Gruetzmacher
c4b7d5b930 Fix index feature for GoComics (fixes #155) 2020-03-26 00:43:43 +01:00
Ruthalas
3d0ab60642
Added two ComicFury comics (#154) 
Added Dragons and Silk and View Hub from ComicFury
 2020-02-26 21:24:54 +01:00
Ruthalas
5fa65741a2
Added Punderworld (#152) 
Added Webtoons/Punderworld
 2020-02-14 00:10:49 +01:00
Mark King
a05826f4d6
Fix GoblinsComic (#153) 
The site had a redesign a while back which broke this plugin. I've
updated the selectors and confirmed that it's working again.
 2020-02-14 00:08:41 +01:00
Tobias Gruetzmacher
44791439a5 Drop Python 2 support: Obsolete future statements 2020-02-04 01:06:19 +01:00
Ruthalas
da137f043c
Added FisheyePlacebo, ScoobandShag, ZomCom (#151) 
Added the following to the webtoons plugin: FisheyePlacebo, ScoobandShag, ZomCom
 2020-02-04 00:47:14 +01:00
Tobias Gruetzmacher
9c65c3e05f Drop Python 2 support: six & other imports 2020-02-03 01:03:31 +01:00
Techwolf
9fb1fccd08 Fix Draconia (fixes #150) 2020-02-02 21:38:50 +01:00
Tobias Gruetzmacher
932f5ba57b Webtoons: Set ageGatePass cookie 
This is only done via JavaScript, but seems to be required in some
regions to use the site.
 2020-02-02 21:08:26 +01:00
Techwolf
585cc7dc90 Add site engine for WebToons 2020-02-02 21:00:02 +01:00
Techwolf
eb69210e58 Add self to authors list, update copyright headers 2020-01-28 00:23:15 +01:00
Techwolf
dc923028d5 Add SmackJeeves/WhatWeRememberTheMost 2020-01-28 00:16:10 +01:00
Tobias Gruetzmacher
24be29aec4 Fix Wapsi Square (fixes #149) 2020-01-27 23:46:27 +01:00
Tobias Gruetzmacher
66b89f4fed Fix update check 
It should return assets for all platforms, since the repo tarball is
unsuitable for setuptools_scm. Preferred asset is the universal wheel.
 2020-01-26 17:42:35 +01:00
Tobias Gruetzmacher
6e14e8709b Reduce allowed line length 2020-01-13 00:36:46 +01:00
Tobias Gruetzmacher
063ce4e85f Prepare old list for next release 2020-01-13 00:18:42 +01:00
Tobias Gruetzmacher
fc4655157a Move some more modules to HTTPS and fix canonical URL 2020-01-12 22:41:06 +01:00
Tobias Gruetzmacher
5e09b631db Move EyeOfRamalach to KemonoCafe 2020-01-12 22:41:06 +01:00
Techwolf
b168e05cfd Add site engine for Derideal 2020-01-12 21:29:47 +01:00
Techwolf
d232d1e43d Add LifeAsRendered 2020-01-12 21:29:47 +01:00
Techwolf
0aa1ba3c66 Fix CatsAndCameras 2020-01-12 21:29:47 +01:00
Techwolf
4219b32074 Fix VerloreGeleentheid 2020-01-12 21:29:47 +01:00
Techwolf
15ac062dff Fix DoemainOfOurOwn 2020-01-12 21:29:47 +01:00
Techwolf
947405a50d Fix Djandora 2020-01-12 21:29:47 +01:00
Techwolf
aa22d05c44 Fix WLP/PeterIsTheWolf 2020-01-12 21:29:47 +01:00
Techwolf
1a938ffa05 Fix Python 2 compatibility for Newshounds 2020-01-12 21:29:47 +01:00
Techwolf
241732bbba Add common handler for mgsisk's Wordpress Webcomic plugin 2020-01-12 21:29:47 +01:00
Techwolf
c44a5a3b43 Mark endOfLife comics as completed when checking for updates 2020-01-12 21:29:47 +01:00
Techwolf
121e63c069 Add site engine for StudioKhimera 2020-01-12 21:29:47 +01:00
Techwolf
f49dff13be Move AddictiveScience to KemonoCafe 2020-01-12 21:29:47 +01:00
Techwolf
af44479b5f Add DesertFox 2020-01-12 21:29:47 +01:00
Techwolf
81b92a8c18 Add KemonoCafe site engine 2020-01-12 21:29:47 +01:00
Techwolf
419c41fb74 Add PeterAndWhitney 2020-01-12 21:19:56 +01:00
Techwolf
6131c9e2b5 Add PeterAndCompany 2020-01-12 21:19:56 +01:00
Techwolf
163b252776 Add ArtificialIncident 2020-01-12 21:19:56 +01:00
Techwolf
e54d153ca7 Add YoshSaga 2020-01-12 21:19:56 +01:00
Techwolf
3503a2bede Add site engine for RHJunior and migrate existing comics 2020-01-12 21:19:56 +01:00
Techwolf
0fed6c2c36 Add site engine for NamirDeiter comics and migrate existing comics 2020-01-12 21:19:56 +01:00
Techwolf
4795613343 Add site engine for ProjectFuture 2020-01-12 19:12:26 +01:00
Techwolf
6576dd7ec7 Add ShadesOfGray 2020-01-12 18:45:06 +01:00
Tobias Gruetzmacher
e393ccdce1 Fix Qwantz 2020-01-09 23:36:05 +01:00
Tobias Gruetzmacher
290f4167d9 Remove Creators/Recess, it's gone 2020-01-09 23:27:46 +01:00
Tobias Gruetzmacher
f0348d6b90 Remove ComicGenesis/Cerintha, it's broken 
Additionally, it also exists on SmackJeeves.
 2020-01-09 23:23:20 +01:00
Tobias Gruetzmacher
d9045030cc Remove ComicFury/Khulthagar, it's gone 2020-01-09 23:17:43 +01:00
Tobias Gruetzmacher
0f28770aaa Remove old ComicSherpa submodules 2020-01-09 23:15:52 +01:00
Tobias Gruetzmacher
3fe40326e0 Fix AbstruseGoose 2020-01-09 22:59:12 +01:00
Tobias Gruetzmacher
42b5aa9321 Fix Unsounded (fixes #107) 2020-01-09 22:21:20 +01:00
Tobias Gruetzmacher
cfd7b80053 Fix Exiern (fixes #119) 2020-01-09 21:13:54 +01:00
Tobias Gruetzmacher
18546c194a Switch SomethingPositive to parser (fixes #128) 2020-01-09 21:00:24 +01:00
Tobias Gruetzmacher
041d8be7ef Re-add one comic that got lost 2020-01-09 19:46:24 +01:00
Tobias Gruetzmacher
3c930167c6 Remove some comics which disappeared 2020-01-09 18:04:09 +01:00
Tobias Gruetzmacher
ff3b7f2cbe Fix AltermetaOld 2020-01-09 17:41:07 +01:00
Tobias Gruetzmacher
752525c3e9 Fix some old modules using the Internet Archive 2020-01-09 17:38:13 +01:00
Tobias Gruetzmacher
275370a835 Drop webcomic.eu (site is gone) 
Not enough archived history to switch to Internet Archive...
 2020-01-09 03:52:40 +01:00
Techwolf
63da9dd0d4 Fix Newshounds & ProjectionEdge split 2020-01-09 03:33:19 +01:00
Techwolf
5da87d5a66 Fix firstStripUrl for ComicFury comics 2020-01-09 03:24:09 +01:00
Techwolf
dfbc0b148a Fix Meek 2020-01-09 03:20:34 +01:00
Tobias Gruetzmacher
f05a8c33d4 Take Djandora from Internet Archive 2020-01-09 03:20:34 +01:00
Techwolf
d6e255ea4a Add ProphecyOfTheCircle 2020-01-09 03:20:34 +01:00
Techwolf
f52075d200 Add OffCentaured 2020-01-09 03:20:34 +01:00
Techwolf
32529da7e6 Add SmackJeeves/GrowingTroubles 2020-01-09 03:20:34 +01:00
Techwolf
cffa42a243 Add FoxDad 2020-01-09 03:20:34 +01:00
Techwolf
3df0d6d715 Add MyLifeWithFel 2020-01-09 03:20:34 +01:00
Techwolf
f7886636cc Add SpaceFurries 2020-01-09 03:20:34 +01:00
Techwolf
e1c7538c44 Restore LatchkeyKingdom 2020-01-09 03:20:34 +01:00
Techwolf
6763c105b7 Add StolenGeneration 2020-01-09 01:13:32 +01:00
Ruthalas
1d6e80f928 Added unDivine (#147) 
Added comic unDivine using ComicControlScraper
 2020-01-09 00:17:07 +01:00
Tobias Gruetzmacher
c48d96d5e3 Use imagesize instead of Pillow to get image sizes 2020-01-04 15:59:49 +01:00
Tobias Gruetzmacher
a8ab66f781 Hello, 2020! 2020-01-04 13:41:37 +01:00
Tobias Gruetzmacher
2afc0cb645 Director: Always cleanup jobs & threads 
This shouldn't make a difference in normal dosage usage (since dosage
exits right after this anyways), but it removes hidden dependencies
between tests and might help when embedding dosage into other Python
software. As a side effect this gets rid of some global state, so
running dosage multiple times in the same process is more reliable...
 2020-01-04 13:39:14 +01:00
Ruthalas
65228ec2d0 Added Headless Bliss (#146) 2020-01-01 20:53:34 +01:00
Tobias Gruetzmacher
e5cb27ffa4 Minor URL fixes, switched some modules to https 2019-12-31 01:44:19 +01:00
Tobias Gruetzmacher
be41a692ba Slightly better namer for CloneManga modules 2019-12-31 00:50:22 +01:00
Tobias Gruetzmacher
5a92505606 Fix & test query string parsing 2019-12-31 00:43:46 +01:00
Tobias Gruetzmacher
addf78fcbc More cleanup after SmackJeeves redesign 2019-12-29 23:19:17 +01:00
Tobias Gruetzmacher
c0ebf9bbe2 Clean up ComicSherpa 2019-12-29 20:53:41 +01:00
Tobias Gruetzmacher
d0bc0572c2 Add a test to ckeck that renamed comics point to existing comics 2019-12-29 20:50:56 +01:00
Tobias Gruetzmacher
58611fe600 Remove missing GoComics submodules 2019-12-29 02:17:52 +01:00
Tobias Gruetzmacher
7e9790c7a8 Remove vanished Arcamax comics 2019-12-28 01:00:53 +01:00
Tobias Gruetzmacher
42b23c4537 Force CommitStrip to always use TLS 2019-12-28 00:16:41 +01:00
Techwolf
83cd91e229 Fix WLP/PeterIsTheWolf 2019-12-27 23:34:07 +01:00
Techwolf
0b675572df Fix MonsterUnderTheBed 2019-12-27 23:34:07 +01:00
Techwolf
33954aaab6 Add CatNine/TakeTwo 2019-12-27 23:34:07 +01:00
Techwolf
ae7ab251fd Add CatNine 2019-12-27 23:34:07 +01:00
Techwolf
2fe790f91c Add VickiFox 2019-12-27 23:34:07 +01:00
Techwolf
0fcad21b55 Add Prototype 2019-12-27 23:34:07 +01:00
Techwolf
e7ebecd03d Add TwokindsSketches 2019-12-27 23:34:07 +01:00
Techwolf
0f8fe12c10 Add LilithsWord 2019-12-27 23:34:07 +01:00
Techwolf
38a29f631f Add FarToTheNorth 2019-12-27 23:34:07 +01:00
Techwolf
a6310c8eeb Fix WhiteNoise 2019-12-27 23:34:07 +01:00
Techwolf
1fdb644cb3 Add TailsAndTactics 2019-12-27 23:34:07 +01:00
Techwolf
31b2c3c6ec Fix Namesake 2019-12-27 23:34:07 +01:00
Techwolf
93dc03a429 Fix SleeplessDomain 2019-12-27 23:34:07 +01:00
Techwolf
d8ac47f386 Add FurPiled 2019-12-27 23:34:07 +01:00
Techwolf
8f66fd3647 Fix DominicDeegan (no longer endOfLife) 2019-12-27 23:34:07 +01:00
Techwolf
e156da4457 Add ComicFury/ResNulliusCS 2019-12-27 23:34:07 +01:00
Techwolf
7a54278ccd Add ClanOfTheCats/Reunion 2019-12-27 23:34:07 +01:00
Techwolf
b340403013 Add ClanOfTheCats 2019-12-27 23:34:07 +01:00
Techwolf
3d75493183 Add CarryOn/LegendOfAnneBunny 2019-12-27 22:58:44 +01:00
Techwolf
dd88b7f133 Add CarryOn/AliceBlueAndTheGardensOfQ 2019-12-27 22:58:44 +01:00
Techwolf
95fe4b331c Add Erfworld 2019-12-27 22:52:43 +01:00
Techwolf
d39055e494 Fix PvPOnline 2019-12-27 22:48:16 +01:00
Techwolf
7e9ca4daba Add AntiheroForHire 2019-12-27 22:40:27 +01:00
Techwolf
f15f5920c0 Add CrossTimeCafe 2019-12-27 22:30:00 +01:00
Techwolf
dd8200312a Fix Galaxion 2019-12-27 22:25:27 +01:00
Techwolf
5705b1a3eb Add SeelPeel 2019-12-27 22:22:08 +01:00
Techwolf
28bf733ca5 Add Ginpu 2019-12-27 22:20:02 +01:00
Techwolf
c5f57288ec Refactor WP_LATEST_SEARCH into class variable of WordPressScraper 2019-12-27 22:20:02 +01:00
Techwolf
d732767e02 Fix Freefall 2019-12-27 22:20:02 +01:00
Techwolf
18379b8fc0 Add ComicFury/Snowfall 2019-12-27 22:20:02 +01:00
Techwolf
d733baba48 Add TheJunkHyenasDiner 2019-12-27 22:20:02 +01:00
Techwolf
deda610666 Add PowerNap 2019-12-27 22:20:02 +01:00
Techwolf
e4ded6da25 Add Vexxarr 2019-12-27 22:20:02 +01:00
Techwolf
60d37bcc1b Add CritterCoven 2019-12-27 22:20:02 +01:00
Techwolf
078841055b Add TinyDickAdventures 2019-12-27 22:20:02 +01:00
Techwolf
c260640e0a Add NonPlayerCharacter 2019-12-27 22:20:02 +01:00
Techwolf
4d9eb7df4b Fix LookingForGroup 2019-12-27 22:20:02 +01:00
Techwolf
6364b34233 Add DeerMe 2019-12-27 22:20:02 +01:00
Techwolf
5e4bd6f34a Add PeanutBerrySundae 2019-12-27 22:20:02 +01:00
Techwolf
44d2198c34 Add AmbersNoBrainers 2019-12-27 22:20:02 +01:00
Techwolf
e6b1895d3b Fix RealLife 2019-12-27 22:20:02 +01:00
Techwolf
561646c9c4 Add Delve 2019-12-27 22:20:02 +01:00
Techwolf
2857189068 Fix Weregeek 2019-12-27 20:24:03 +01:00
Techwolf
b383a92f65 Add AdventuresOfFifne 2019-12-27 18:41:49 +01:00
Techwolf
afb2275209 Add WereIWolf 2019-12-27 18:38:02 +01:00
Techwolf
24b4d1a391 Add BeyondTheVeil 2019-12-27 18:17:18 +01:00
Techwolf
9e6bd4803a Add Centralia2050 2019-12-27 18:16:01 +01:00
Techwolf
523a65581c Fix MareInternum 2019-12-27 18:15:43 +01:00
Techwolf
8f335c15e1 Add TwinDragons 2019-12-27 17:40:00 +01:00
Techwolf
55180babcf Add Kitfox 2019-12-27 17:38:37 +01:00
Techwolf
de67d4f63b Fix KiwiBlitz 2019-12-27 17:37:56 +01:00
Techwolf
255e27eec2 Add HeyKitty 2019-12-27 17:36:51 +01:00
Techwolf
5df3cff92b Add ComicFury/DNA 2019-12-27 17:35:55 +01:00
Techwolf
66e655c074 Add HeyFox 2019-12-27 17:34:58 +01:00
Techwolf
047f023e50 Fix QuestionableContent 2019-12-27 17:34:38 +01:00
Techwolf
5e79ff9d84 Fix DoghouseDiaries 2019-12-27 17:33:53 +01:00
Techwolf
fc280badb6 Add ComicFury/Swashbuckled 2019-12-27 17:32:47 +01:00
Techwolf
eecffa53a7 Add ComicFury/RedSpot 2019-12-27 17:32:26 +01:00
Techwolf
4c495b78f7 Add DarkWhite 2019-12-27 17:26:22 +01:00
Techwolf
0a81948386 Add ComicFury/Saluna 2019-12-27 17:25:44 +01:00
Techwolf
4d8b35182d Add ComicFury/Threan 2019-12-27 17:25:23 +01:00
Techwolf
1377830917 Add BallerinaMafia 2019-12-27 17:23:44 +01:00
Techwolf
fff73f9a09 Add FurthiaHigh 2019-12-27 17:23:01 +01:00
Techwolf
ea94a62f58 Fix Concession 2019-12-27 17:22:08 +01:00
Techwolf
f6b358c754 Add VirmirWorld 2019-12-27 17:21:05 +01:00
Techwolf
6df6549c97 Split Catena into CatenaCafe & CatenaManor 2019-12-27 17:16:06 +01:00
Techwolf
1fe966102f Add OzyAndMillie 2019-12-27 16:14:30 +01:00
Techwolf
306a6eca8c Add CynWolf 2019-12-27 16:12:43 +01:00
Techwolf
15c9426a2d Add CommanderKitty 2019-12-27 16:12:17 +01:00
Techwolf
f99839f42a Add BittersweetCandyBowl 2019-12-27 16:11:01 +01:00
Techwolf
48ed091878 Add PoppyOPossum 2019-12-27 16:10:22 +01:00
Techwolf
9aa0845b17 Fix StandStillStaySilent 2019-12-27 16:09:54 +01:00
Techwolf
8831984991 Add MynarskiForest 2019-12-27 16:07:08 +01:00
Techwolf
24573c4793 Fix Shivae and add side comics 2019-12-27 15:59:10 +01:00
Tobias Gruetzmacher
963db7f448 Adopt SmackJeeves to new site design (fixes #144) 
Some things got lost on the way:
- Since there is no comprehensive comic directory anymore, removed
  automatic update script. New comics need to be added manually.
- Some authors used the opportunity to move from SmackJeeves somewhere
  else - some of those got new modules (either standalone or ComicFury)
- Abunch of comics just disappeared...
 2019-12-26 22:03:18 +01:00
Tobias Gruetzmacher
44af7acdbc Clean up ComicFury a bit 
Mostly getting rid of vanished comics, but also cleaning up the matching
expressions a bit.
 2019-12-25 23:05:11 +01:00
Techwolf
ab488cbbd6 Add TheCyantianChronicles comics 2019-12-17 01:29:25 +01:00
Techwolf
24ee2e2594 Add AbbysAgency 2019-12-17 01:28:02 +01:00
Techwolf
becc3b98f6 Add AlienDice and AlienDice/Legacy 2019-12-17 01:28:02 +01:00
Techwolf
1def5739b1 Add Tamberlane 2019-12-17 01:28:02 +01:00
Techwolf
05854b6ddf Add DocRat 2019-12-17 01:28:02 +01:00
Techwolf
0d8a803913 Add LittleTales 2019-12-17 01:28:02 +01:00
Techwolf
a3d3ea92db Add NeoCTC 2019-12-17 01:28:02 +01:00
Techwolf
ab366f12d3 Add FreighterTails 2019-12-17 01:28:02 +01:00
Techwolf
85a7adadc9 Add TheGentleWolf 2019-12-17 01:28:02 +01:00
Techwolf
6e125fb05f Merge TracyAndTristan into ComicFury list 2019-12-17 01:28:02 +01:00
Techwolf
48e064cf1b Add ComicFury/Eros 2019-12-17 01:28:02 +01:00
Techwolf
9cca10b0b7 Add Ryugou 2019-12-17 01:28:02 +01:00
Techwolf
478125f621 Fix UrgentTransformationCrisis 2019-12-17 01:28:02 +01:00
Techwolf
56573c41ae Add Anaria 2019-12-17 01:28:02 +01:00
Techwolf
cad90e80e2 Fix SkinDeep 2019-12-17 01:28:02 +01:00
Techwolf
a259a65d83 Add Cloudscratcher 2019-12-17 01:28:02 +01:00
Techwolf
138f6001db Fix Flipside 2019-12-17 01:28:02 +01:00
Techwolf
d370ac5612 Add TheProbabilityBomb 2019-12-17 01:28:02 +01:00
Techwolf
bc87413b22 Add TheOldVictorian 2019-12-17 01:28:02 +01:00
Techwolf
6ed242a7b0 Add OffWhite 2019-12-17 01:28:02 +01:00
Techwolf
b6f2000c0b Fix TheGamerCat 2019-12-17 01:28:02 +01:00
Techwolf
1b8c404a15 Add FoxTails 2019-12-17 01:28:02 +01:00
Techwolf
9eacd96f5f Add Everblue 2019-12-17 01:28:02 +01:00
Techwolf
52b0e15330 Add ErmaFelnaEDF 2019-12-17 01:28:02 +01:00
Techwolf
b131baa561 Add ComicFury/ProfessorAmazingAndTheIncredibleGoldenFox 2019-12-17 01:28:02 +01:00
Techwolf
23afbd1fb7 Fix Misfile, add Misfile/HellHigh 2019-12-17 01:28:02 +01:00
Techwolf
6f47be87f7 Add WildeLife 2019-12-17 01:28:02 +01:00
Techwolf
0b433d5897 Add Wrongside 2019-12-17 01:28:02 +01:00
Techwolf
6a5823b3fe Add StarfireAgency 2019-12-17 01:28:02 +01:00
Techwolf
e62bcb6267 Add Nightshift 2019-12-17 01:28:02 +01:00
Techwolf
8e8d5e5723 Add TracesOfThePast (SFW/NSFW) 2019-12-17 01:28:02 +01:00
Techwolf
57046e23ca Add A&HClub 2019-12-17 01:28:02 +01:00
Techwolf
ae0b702107 Add Bethellium 2019-12-17 01:28:02 +01:00
Techwolf
085e1642fb Add Moonlace 2019-12-17 01:28:02 +01:00
Techwolf
280f4fdbb8 Add CutLoose 2019-12-17 01:28:02 +01:00
Techwolf
81e4942e7c Add Replay 2019-12-17 01:28:02 +01:00
Techwolf
7e6d33ddf5 Fix Lackadaisy 2019-12-17 01:28:02 +01:00
Techwolf
c9e3923442 Fix AlphaLuna 2019-12-17 01:28:02 +01:00
Techwolf
6cfde34663 Fix Altermeta 2019-12-17 01:28:02 +01:00
Techwolf
2916b39c98 Add ApartmentForTwo 2019-12-17 01:28:02 +01:00
Techwolf
ae82096e96 Add QuentynQuinnSpaceRanger 2019-12-17 01:28:02 +01:00
Techwolf
5fb39c5faf Add TalesOfTheQuestor 2019-12-17 01:28:02 +01:00
Techwolf
ff4fa7892d Add QuantumVibe 2019-12-17 01:28:02 +01:00
Techwolf
7d03d3369b Add LastResort 2019-12-17 01:28:02 +01:00
Techwolf
cb360bc983 Add Bloodline 2019-12-17 01:28:02 +01:00
Techwolf
9e52bea334 Add SixPackOfOtters 2019-12-17 01:28:02 +01:00
Techwolf
0648bbadc9 Add Kaspall 2019-12-17 01:28:02 +01:00
Techwolf
379f963442 Add TheClassMenagerie 2019-12-17 01:28:02 +01:00
Techwolf
a6aacf0cc7 Add DMFA side stories 
(this also moves all DMFA modules into their own file)
 2019-12-17 01:28:02 +01:00
Techwolf
b79f22fb65 Mark KeenSpot/GeneCatlow completed :( 2019-12-17 00:05:47 +01:00
Techwolf
f79d3c9309 Fix GunnerkriggCourt 2019-12-17 00:04:20 +01:00
Tobias Gruetzmacher
835f484673 Simplify ComicsKingdom extraction a bit 2019-12-16 23:47:14 +01:00
littauer
4d369376c0 Add ComicsKingdom.com (aka King Features) (#134) 
Note that going back more than about seven days is a paid feature and is untested.
 2019-12-16 23:18:04 +01:00
Tobias Gruetzmacher
adb3db3d22 Add some tests for the update check 2019-12-05 22:23:48 +01:00
Tobias Gruetzmacher
f5253c7f45 Return a fallback "version" if dosage is not installed 
Additionally, inform the user on how to fix the problem. Thanks to twb
for noticing this.
 2019-12-05 21:41:15 +01:00
Tobias Gruetzmacher
7615ee60d1 Switch from pkg_resources to importlib 
One dependency less (at least für Python 3.8+) and it should be faster
(not tested).
 2019-12-05 21:40:45 +01:00
Tobias Gruetzmacher
4511bab996 Fix xkcd pages where comic is linked 2019-12-05 07:10:49 +01:00
Tobias Gruetzmacher
66f154f074 Add throttling for GoComics (fixes #90) 
Since this was the goal of the whole throttling implementation ;)
 2019-12-04 00:28:27 +01:00
Tobias Gruetzmacher
a347bebfe3 Add simple host-based throttling 2019-12-04 00:28:27 +01:00
Tobias Gruetzmacher
e5e7dfacd6 Move basic HTTP setup into a new module 
We now subclass requests' Session to make further extensions of the HTTP
flow possible.
 2019-12-03 23:58:20 +01:00
Tobias Gruetzmacher
d2861d029f Fix "Extra Fabulous Comics" (fixes #129) 2019-12-03 19:50:41 +01:00
Tobias Gruetzmacher
ddba32391b Add BlondeSunrise (fixes #142) 2019-12-03 00:14:57 +01:00
Tobias Gruetzmacher
f5a5106381 Allow combining -n with -c or -a (related to #90) 
This allows fetching "all" comics (or catch up until the last existing
one) while setting an upper bound on how many pages to fetch at the same
time.
 2019-12-01 23:19:06 +01:00
Jakob Kogler
6fd3282047 Add comic "turnoff" (closes #139) 2019-12-01 21:46:00 +01:00
hkocharyan
31309a26d2 fixed oglaf next and previous tags (#141) 2019-11-19 20:56:54 +01:00
Tobias Gruetzmacher
00d0201c5f Fix a bunch of flake8 issues 2019-11-04 00:16:25 +01:00
Techwolf
255fbfa1b4 Add Evon 2019-11-03 23:51:58 +01:00
Techwolf
b230ef31d8 Add Guardia 2019-11-03 23:51:27 +01:00
Techwolf
70223bd38f Add YouSayItFirst 2019-11-03 23:50:47 +01:00
Techwolf
a5a868c2e7 Add NicoleAndDerek 2019-11-03 23:50:47 +01:00
Techwolf
be6a6722b5 Add UnlikeMinerva 2019-11-03 23:50:47 +01:00
Techwolf
fcdbd563a2 Add HavocInc 2019-11-03 23:44:49 +01:00
Techwolf
a575e5e0f0 Add Dissonance 2019-11-03 23:44:24 +01:00
Techwolf
14a01c3e47 Add OutOfPlacers 2019-11-03 23:43:23 +01:00
Techwolf
edc59a86e3 Add PlushAndBlood 2019-11-03 23:42:46 +01:00
Techwolf
4c7a654dcc Add WhiteNoiseLee 2019-11-03 23:42:25 +01:00
Techwolf
12b048d449 Add Savestate 2019-11-03 23:41:48 +01:00
Techwolf
4a783c11ec Add NotAVillain 2019-11-03 23:41:28 +01:00
Techwolf
013d10a1f2 Add SmackJeeves/FurryExperience 2019-11-03 23:40:58 +01:00
Techwolf
2a7d63b7eb Add CrimsonFlag 2019-11-03 23:39:53 +01:00
Techwolf
e06f31784e Add Supercell 2019-11-03 23:38:12 +01:00
Techwolf
f4e3c09717 Add CollegeCatastrophe 2019-11-03 23:37:46 +01:00