dmoonfire/dosage
1
0
Fork 0
Code Issues Pull requests Packages Projects Releases Activity
2349 commits 1 branch 0 tags 31 MiB
Commit graph

1575 commits

Author SHA1 Message Date
Techwolf 4caef255b4 Add WebToons/OVERPOWERED 2020-11-09 00:54:20 +01:00
Techwolf f6eb2f088e Add WebToons/Defects 2020-11-09 00:54:20 +01:00
Techwolf 722df37080 Fix DeerMe 2020-11-09 00:54:20 +01:00
Techwolf 7d36a2e552 Add Unconventional 2020-11-09 00:54:20 +01:00
Tobias Gruetzmacher 2fcd8d92f2 Fix GeeksNextDoor (& switch to ParserScraper) 2020-10-18 20:44:47 +02:00
Tobias Gruetzmacher fdf8164d22 Fix KuroShouri (switch to ParserScraper) 2020-10-18 20:28:00 +02:00
Tobias Gruetzmacher e64635e86b Stricter style checking & related style fixes 2020-10-11 20:15:27 +02:00
Ruthalas e84bbe2667
Add three new comics (#177) 
* Add BloopBloopRelationshipComic to Webtoons
* Add Todd Allison & the Petunia Violet to Smack Jeeves
* Add Oversimplified SCP to MangaDex

Co-authored-by: Tobias Gruetzmacher <tobias-git@23.gs>
 2020-10-11 11:30:02 +02:00
Tobias Gruetzmacher d487485815 Read scraper modules from user data directory 
This allows users to add scrapers without setting up a complete Python
development environment.
 2020-10-04 23:46:57 +02:00
Tobias Gruetzmacher 0bdf3dd94b Allow adding external directories to the plugin package 2020-10-04 22:28:51 +02:00
Tobias Gruetzmacher 3256f9fdc2 Hardcode the "plugins" package name 2020-10-04 22:28:51 +02:00
Tobias Gruetzmacher 9237bd62b2 Convert scraper cache to a class 
This should make it easier to extend with additional entries.
 2020-10-04 22:28:51 +02:00
Tobias Gruetzmacher 26f63fd994 Remove unused property in Output class 2020-10-04 22:12:34 +02:00
Tobias Gruetzmacher d93fed567c Distribute PyInstaller hook 
This uses a feature introduced in PyInstaller 4.0 to register hooks as
entry points and automatically discover them whenever a module is used.
 2020-10-01 15:51:09 +02:00
Tobias Gruetzmacher 7c2c9c3778 Fix VGCats & switch to HTTPS 2020-09-30 21:37:29 +02:00
Tobias Gruetzmacher bb71adbe72 Remove VictimsOfTheSystem 
Domain seems to be gone for some month and archive.org doesn't have
enough to switch.
 2020-09-30 21:29:58 +02:00
Tobias Gruetzmacher 23a3e3b101 Switch WastedTalent to ParserScraper 2020-09-30 21:24:01 +02:00
Tobias Gruetzmacher dfa412c03e Skip videos for WapsiSquare 2020-09-30 21:17:46 +02:00
Tobias Gruetzmacher bbe3d9f9be Remove WebDesignerCOTW 2020-09-30 21:16:55 +02:00
Tobias Gruetzmacher 437afc685d Add GenshinImpact to Webtoons module 2020-09-30 18:24:33 +02:00
Tobias Gruetzmacher e4f1f59432 Fix ButtercupFestival 2020-09-29 23:31:38 +02:00
Tobias Gruetzmacher dc41c318e9 Fix ButterSafe 2020-09-29 23:04:56 +02:00
Tobias Gruetzmacher f31c0c681d Fix BusinessCat and mark as endOfLife 2020-09-29 23:00:58 +02:00
Tobias Gruetzmacher 2364e8bab3 Fix Brink and mark as endOfLife 2020-09-29 23:00:53 +02:00
Tobias Gruetzmacher 5afab71e7f Fix BoredAndEvil 2020-09-29 22:35:09 +02:00
Tobias Gruetzmacher 5863ddb73b Fix BookOfBiff 2020-09-29 22:27:32 +02:00
Tobias Gruetzmacher bbac2f99a7 Fix BetweenFailures 2020-09-29 22:22:55 +02:00
Tobias Gruetzmacher 3330162c6b Fix BetterDays with archive.org 2020-09-29 21:35:41 +02:00
Tobias Gruetzmacher e98a1601ca Remove workaround for libxml2 older 2.9.3 (2015) 
This workaround was written in 2016 while that version was still found
on many systems. Addionally, this workaround needs to be enabled by the
developer, who might not even be aware that they need to enable it for a
specific module. We still throw a warning to the user if running with
such an old libxml version.
 2020-09-29 21:16:48 +02:00
Tobias Gruetzmacher c065a820ed Fix BadMachinery and mark as endOfLife 2020-09-29 21:01:33 +02:00
Tobias Gruetzmacher 24efafdf96 Fix BMovieComic 2020-09-29 20:30:44 +02:00
Tobias Gruetzmacher 0fe32e7562 Remove unused f-string 
Since we still want to support Python 3.5 for a bit, we should avoid
f-strings until we finally drop support for that.
 2020-09-28 22:19:48 +02:00
Tobias Gruetzmacher 7e040086b6 Try to inform the user about geo-blocks 
Instead of letting the crawler run into "random" error messages, throw a
specific "geoblocked" exception instead.
 2020-09-28 13:11:34 +02:00
Tobias Gruetzmacher e34a0b539c Don't rethrow RequestException as IOError 
Since RequestException already is an IOError, nothing of value is lost.
 2020-09-28 12:05:01 +02:00
Tobias Gruetzmacher 8d7fd8b884 Update GoComics modules 
The usual: GoComics removed some comics, added some and renamed some...
 2020-09-28 01:15:07 +02:00
Tobias Gruetzmacher b090d86c9b Switch Drowtales to parser scraper (also fixes it) 2020-09-27 20:56:26 +02:00
Tobias Gruetzmacher a7f9692ffe Add StalkerXStalker to WebToons module (fixes #173) 2020-09-27 19:21:28 +02:00
Tobias Gruetzmacher ccb4c32c6b Fix DumbingOfAge 2020-09-27 19:16:34 +02:00
Tobias Gruetzmacher 346b3b4abd Fix ShipInABottle 2020-09-27 18:34:36 +02:00
Tobias Gruetzmacher 632433d896 Move CrapIDrewOnMyLunchBreak to WebToons 
Unfortunatly, the original website is broken.
 2020-09-27 18:25:33 +02:00
Tobias Gruetzmacher 85c40a942f Remove StuffNoOneToldMe 2020-09-27 15:50:48 +02:00
Tobias Gruetzmacher 8cc916b292 Fix CynWolf 2020-09-27 15:50:25 +02:00
Tobias Gruetzmacher 193b3da801 Repair EarthsongSaga (fixes #172) 
Verified as fetching the complete history right now.
 2020-09-26 11:29:45 +02:00
Tobias Gruetzmacher 383e759a0e Switch Achewood to ParserScraper 2020-09-26 09:42:48 +02:00
Tobias Gruetzmacher fd779475c1 Fix first comic for Achewood (fixes #175) 2020-09-26 09:31:31 +02:00
garbled1 598cdd092c Add TheGlassScientists 2020-09-13 08:28:19 -07:00
garbled1 c870f71715 Add TheBoyWhoFell 2020-09-13 08:18:42 -07:00
garbled1 f223bc09fb Add TheForgottenOrder 2020-09-13 08:14:52 -07:00
garbled1 5fca596216 Add SisterClaire 2020-09-13 08:11:05 -07:00
garbled1 4dd52cd160 Add NeverSatisfied 2020-09-13 08:04:02 -07:00
garbled1 3b27a530d7 Add GuildedAge 2020-09-13 07:52:38 -07:00
garbled1 6fa835c928 Add ParaNatural 2020-09-13 07:48:32 -07:00
garbled1 10b419331a Add SaffronAndSage 2020-09-13 07:37:24 -07:00
garbled1 6eb0087c9f Add DaughterOfTheLilies 2020-09-13 07:25:05 -07:00
Techwolf d4fb75b844 Add MangaDex/TheWolfAndRedRidingHood 2020-08-19 00:04:55 -07:00
Techwolf 073890c237 Add MangaDex/HangingOutWithAGamerGirl 2020-08-15 21:11:40 -07:00
Techwolf 191df7d5ed Mark SchlockMercenary as endOfLife 2020-08-14 20:51:34 -07:00
Techwolf 70c030ca32 Add MangaDex/OokamiShounenWaKyouMoUsoOKasaneru 2020-08-14 20:51:34 -07:00
Techwolf 49c02541f4 Add MangaDex/KawaiiJoushiWoKomarasetai 2020-08-14 20:51:34 -07:00
Techwolf 711d8d5e23 Fix BlackTapestries and TheRealmOfKaerwyn 2020-08-14 20:51:34 -07:00
Techwolf 103520e586 Add LazJonesAndTheMayfieldRegulators/SideStories 2020-08-14 20:51:34 -07:00
Techwolf 2c05fbb78f Fix Tamberlane 2020-08-14 20:51:34 -07:00
Techwolf 4a24afa652 Mark OriginalLife as endOfLife 2020-08-14 20:51:34 -07:00
Techwolf 88e54258d0 Fix StudioKhimera/UberQuest 2020-08-14 20:51:34 -07:00
Techwolf 1e4c291145 Add ComicFury/LustAndIre 2020-08-14 20:51:34 -07:00
Techwolf 5d27402346 Add TheNightBelongsToUs 2020-08-14 20:51:34 -07:00
Techwolf a191f7e909 Add SoloLeveling 2020-08-14 20:51:34 -07:00
Techwolf 2ef6ebb6f8 Fix Nightshift and StarfireAgency 2020-08-14 20:51:33 -07:00
Techwolf 2688ffad91 Fix DesertFox 2020-08-14 20:51:33 -07:00
Techwolf 9764b82101 Fix Moonlace and Bethellium 2020-08-14 20:51:33 -07:00
Techwolf c29bd2f069 Add ProjectFuture/Emily 2020-08-14 20:51:33 -07:00
Techwolf de3b396d11 Add RayFox 2020-08-14 20:51:33 -07:00
Techwolf 4726497c06 Update WebToons comics 2020-08-14 20:50:54 -07:00
Techwolf c362f39e3a Fix FurryExperience 2020-08-14 20:50:54 -07:00
Tobias Gruetzmacher 7a176b29f2 Replace xpath_class with custom xpath function 2020-07-31 22:56:30 +02:00
Tobias Gruetzmacher 64123eab64 Add an xpath extension to match CSS classes 2020-07-31 20:14:04 +02:00
Tobias Gruetzmacher bd44fdbb79 Fix SequentialArt (closes #167) 2020-07-31 19:28:25 +02:00
Tobias Gruetzmacher 98d5d9eb26 Switch SinFest to parser scraper (fixes #168) 2020-07-02 22:54:20 +02:00
Techwolf cac269e0bc Fix AntiheroForHire 2020-04-29 01:40:27 -07:00
Techwolf 9b69eaf4ff Fix Nightshift 2020-04-29 01:40:27 -07:00
Techwolf d3f2a9e27a Fix NSFW tagging 2020-04-22 01:40:30 -07:00
Techwolf 7f1ffff3ac Add KeenSpot/GeneCatlowAlternate 2020-04-22 01:39:52 -07:00
DavidAccola 131deeaa34
Add False Knees and Yes, I'm Hot in This (#161) 2020-04-20 01:00:38 +02:00
Tobias Gruetzmacher c8374474c6 Remove _TumblrScraper (no modules uses it anymore) 2020-04-20 00:49:53 +02:00
Tobias Gruetzmacher 23b028feaf Add WebcomicName 2020-04-19 23:42:27 +02:00
Tobias Gruetzmacher dbe8e57e11 Fix license header for imported code 2020-04-18 13:57:18 +02:00
Tobias Gruetzmacher 27d28b8eef Update file headers 
The default encoding for source files is UTF-8 since Python 3, so we can
drop all encoding headers. While we are at it, just replace them with
SPDX headers.
 2020-04-18 13:45:44 +02:00
Tobias Gruetzmacher e70bf8c7ad Small style fixes (mostly in tests) 2020-04-18 13:03:02 +02:00
Techwolf c2e3264be0 Add LazJonesAndTheMayfieldRegulators 2020-04-18 11:44:05 +02:00
Techwolf 2068130ae1 Add WintersLight 2020-04-18 11:44:05 +02:00
Techwolf dc387819f2 Fix Bethellium 2020-04-18 11:44:05 +02:00
Techwolf 345a1aff30 Fix GrowingTroubles 2020-04-18 11:44:05 +02:00
Techwolf 137e599dd3 Fix IslaAukate and IslaAukateColor 2020-04-18 11:44:05 +02:00
Tobias Gruetzmacher 28fa430b8a Fix categories of some WebToons comics 2020-04-14 01:38:41 +02:00
Ruthalas e9ccdfca37
Add 11 Mangadex Comics (#160) 
Added AttackonTitan, DeliciousinDungeon, DrStone, HeavensDesignTeam, OMaidensinYourSavageSeason, PleaseDontBullyMeNagatoro, PleaseDontBullyMeNagatoroComicAnthology, PleaseTellMeGalkochan, SPYxFAMILY, YotsubaAnd, InterspeciesReviewers
 2020-04-13 10:00:46 +02:00
Tobias Gruetzmacher 62c3540c28 Remove (useless) wrapper around html.unescape 2020-04-13 01:53:45 +02:00
Daniel Ring 595c49ba53
Add MangaDex site engine (#159) 2020-04-12 12:54:15 +02:00
Daniel Ring e1821e23ba
Minor fixes to several strips (#158) 
* Fix Twokinds
* Fix XKCD
* Fix Unsounded
* Fix SluggyFreelance
* Fix Oglaf
* Fix missing and incorrect renames
* Fix WLP/PeterIsTheWolf{General,Adult}
 2020-04-06 13:23:23 +02:00
Techwolf d9988bc55d Fix WebToons file naming 2020-04-02 12:58:17 +02:00
Techwolf 206db33761 Add ComicFury/Scuvener 2020-04-02 12:58:17 +02:00
Techwolf 4d1a0d9ad3 Fix TheWhiteboard 2020-03-26 01:01:09 +01:00
Techwolf 92f02ce660 Fix Nightshift 2020-03-26 01:00:00 +01:00
Techwolf daf734c53d Fix TheOrderOfTheStick 2020-03-26 00:59:02 +01:00
Techwolf 997953f861 Add Exvulnerum 2020-03-26 00:58:28 +01:00
Techwolf 50f8441e9b Add FriendsYouAreStuckWith 2020-03-26 00:58:00 +01:00
Techwolf 8887b7b794 Mark ButImACatPerson as endOfLife 2020-03-26 00:57:40 +01:00
Techwolf cee1bb67ea Add InsignificantOtters 2020-03-26 00:57:04 +01:00
Techwolf d889cb7d74 Add TheDepths 2020-03-26 00:56:05 +01:00
Techwolf b4bc7f27c6 Add BackOffice 2020-03-26 00:55:32 +01:00
Techwolf c45d3839b2 Update WebToons comic list 2020-03-26 00:55:14 +01:00
Techwolf 12312dd6b4 Add SixGunMage 2020-03-26 00:54:23 +01:00
Techwolf e49c55109b Merge WebToons Canvas comics into autoupdate block 2020-03-26 00:47:00 +01:00
Tobias Gruetzmacher c4b7d5b930 Fix index feature for GoComics (fixes #155) 2020-03-26 00:43:43 +01:00
Ruthalas 3d0ab60642
Added two ComicFury comics (#154) 
Added Dragons and Silk and View Hub from ComicFury
 2020-02-26 21:24:54 +01:00
Ruthalas 5fa65741a2
Added Punderworld (#152) 
Added Webtoons/Punderworld
 2020-02-14 00:10:49 +01:00
Mark King a05826f4d6
Fix GoblinsComic (#153) 
The site had a redesign a while back which broke this plugin. I've
updated the selectors and confirmed that it's working again.
 2020-02-14 00:08:41 +01:00
Tobias Gruetzmacher 44791439a5 Drop Python 2 support: Obsolete future statements 2020-02-04 01:06:19 +01:00
Ruthalas da137f043c
Added FisheyePlacebo, ScoobandShag, ZomCom (#151) 
Added the following to the webtoons plugin: FisheyePlacebo, ScoobandShag, ZomCom
 2020-02-04 00:47:14 +01:00
Tobias Gruetzmacher 9c65c3e05f Drop Python 2 support: six & other imports 2020-02-03 01:03:31 +01:00
Techwolf 9fb1fccd08 Fix Draconia (fixes #150) 2020-02-02 21:38:50 +01:00
Tobias Gruetzmacher 932f5ba57b Webtoons: Set ageGatePass cookie 
This is only done via JavaScript, but seems to be required in some
regions to use the site.
 2020-02-02 21:08:26 +01:00
Techwolf 585cc7dc90 Add site engine for WebToons 2020-02-02 21:00:02 +01:00
Techwolf eb69210e58 Add self to authors list, update copyright headers 2020-01-28 00:23:15 +01:00
Techwolf dc923028d5 Add SmackJeeves/WhatWeRememberTheMost 2020-01-28 00:16:10 +01:00
Tobias Gruetzmacher 24be29aec4 Fix Wapsi Square (fixes #149) 2020-01-27 23:46:27 +01:00
Tobias Gruetzmacher 66b89f4fed Fix update check 
It should return assets for all platforms, since the repo tarball is
unsuitable for setuptools_scm. Preferred asset is the universal wheel.
 2020-01-26 17:42:35 +01:00
Tobias Gruetzmacher 6e14e8709b Reduce allowed line length 2020-01-13 00:36:46 +01:00
Tobias Gruetzmacher 063ce4e85f Prepare old list for next release 2020-01-13 00:18:42 +01:00
Tobias Gruetzmacher fc4655157a Move some more modules to HTTPS and fix canonical URL 2020-01-12 22:41:06 +01:00
Tobias Gruetzmacher 5e09b631db Move EyeOfRamalach to KemonoCafe 2020-01-12 22:41:06 +01:00
Techwolf b168e05cfd Add site engine for Derideal 2020-01-12 21:29:47 +01:00
Techwolf d232d1e43d Add LifeAsRendered 2020-01-12 21:29:47 +01:00
Techwolf 0aa1ba3c66 Fix CatsAndCameras 2020-01-12 21:29:47 +01:00
Techwolf 4219b32074 Fix VerloreGeleentheid 2020-01-12 21:29:47 +01:00
Techwolf 15ac062dff Fix DoemainOfOurOwn 2020-01-12 21:29:47 +01:00
Techwolf 947405a50d Fix Djandora 2020-01-12 21:29:47 +01:00
Techwolf aa22d05c44 Fix WLP/PeterIsTheWolf 2020-01-12 21:29:47 +01:00
Techwolf 1a938ffa05 Fix Python 2 compatibility for Newshounds 2020-01-12 21:29:47 +01:00
Techwolf 241732bbba Add common handler for mgsisk's Wordpress Webcomic plugin 2020-01-12 21:29:47 +01:00
Techwolf c44a5a3b43 Mark endOfLife comics as completed when checking for updates 2020-01-12 21:29:47 +01:00
Techwolf 121e63c069 Add site engine for StudioKhimera 2020-01-12 21:29:47 +01:00
Techwolf f49dff13be Move AddictiveScience to KemonoCafe 2020-01-12 21:29:47 +01:00
Techwolf af44479b5f Add DesertFox 2020-01-12 21:29:47 +01:00
Techwolf 81b92a8c18 Add KemonoCafe site engine 2020-01-12 21:29:47 +01:00
Techwolf 419c41fb74 Add PeterAndWhitney 2020-01-12 21:19:56 +01:00
Techwolf 6131c9e2b5 Add PeterAndCompany 2020-01-12 21:19:56 +01:00
Techwolf 163b252776 Add ArtificialIncident 2020-01-12 21:19:56 +01:00
Techwolf e54d153ca7 Add YoshSaga 2020-01-12 21:19:56 +01:00
Techwolf 3503a2bede Add site engine for RHJunior and migrate existing comics 2020-01-12 21:19:56 +01:00
Techwolf 0fed6c2c36 Add site engine for NamirDeiter comics and migrate existing comics 2020-01-12 21:19:56 +01:00
Techwolf 4795613343 Add site engine for ProjectFuture 2020-01-12 19:12:26 +01:00
Techwolf 6576dd7ec7 Add ShadesOfGray 2020-01-12 18:45:06 +01:00
Tobias Gruetzmacher e393ccdce1 Fix Qwantz 2020-01-09 23:36:05 +01:00
Tobias Gruetzmacher 290f4167d9 Remove Creators/Recess, it's gone 2020-01-09 23:27:46 +01:00
Tobias Gruetzmacher f0348d6b90 Remove ComicGenesis/Cerintha, it's broken 
Additionally, it also exists on SmackJeeves.
 2020-01-09 23:23:20 +01:00
Tobias Gruetzmacher d9045030cc Remove ComicFury/Khulthagar, it's gone 2020-01-09 23:17:43 +01:00
Tobias Gruetzmacher 0f28770aaa Remove old ComicSherpa submodules 2020-01-09 23:15:52 +01:00
Tobias Gruetzmacher 3fe40326e0 Fix AbstruseGoose 2020-01-09 22:59:12 +01:00
Tobias Gruetzmacher 42b5aa9321 Fix Unsounded (fixes #107) 2020-01-09 22:21:20 +01:00
Tobias Gruetzmacher cfd7b80053 Fix Exiern (fixes #119) 2020-01-09 21:13:54 +01:00
Tobias Gruetzmacher 18546c194a Switch SomethingPositive to parser (fixes #128) 2020-01-09 21:00:24 +01:00
Tobias Gruetzmacher 041d8be7ef Re-add one comic that got lost 2020-01-09 19:46:24 +01:00
Tobias Gruetzmacher 3c930167c6 Remove some comics which disappeared 2020-01-09 18:04:09 +01:00
Tobias Gruetzmacher ff3b7f2cbe Fix AltermetaOld 2020-01-09 17:41:07 +01:00
Tobias Gruetzmacher 752525c3e9 Fix some old modules using the Internet Archive 2020-01-09 17:38:13 +01:00
Tobias Gruetzmacher 275370a835 Drop webcomic.eu (site is gone) 
Not enough archived history to switch to Internet Archive...
 2020-01-09 03:52:40 +01:00
Techwolf 63da9dd0d4 Fix Newshounds & ProjectionEdge split 2020-01-09 03:33:19 +01:00
Techwolf 5da87d5a66 Fix firstStripUrl for ComicFury comics 2020-01-09 03:24:09 +01:00
Techwolf dfbc0b148a Fix Meek 2020-01-09 03:20:34 +01:00
Tobias Gruetzmacher f05a8c33d4 Take Djandora from Internet Archive 2020-01-09 03:20:34 +01:00
Techwolf d6e255ea4a Add ProphecyOfTheCircle 2020-01-09 03:20:34 +01:00
Techwolf f52075d200 Add OffCentaured 2020-01-09 03:20:34 +01:00
Techwolf 32529da7e6 Add SmackJeeves/GrowingTroubles 2020-01-09 03:20:34 +01:00
Techwolf cffa42a243 Add FoxDad 2020-01-09 03:20:34 +01:00
Techwolf 3df0d6d715 Add MyLifeWithFel 2020-01-09 03:20:34 +01:00
Techwolf f7886636cc Add SpaceFurries 2020-01-09 03:20:34 +01:00
Techwolf e1c7538c44 Restore LatchkeyKingdom 2020-01-09 03:20:34 +01:00
Techwolf 6763c105b7 Add StolenGeneration 2020-01-09 01:13:32 +01:00
Ruthalas 1d6e80f928 Added unDivine (#147) 
Added comic unDivine using ComicControlScraper
 2020-01-09 00:17:07 +01:00
Tobias Gruetzmacher c48d96d5e3 Use imagesize instead of Pillow to get image sizes 2020-01-04 15:59:49 +01:00
Tobias Gruetzmacher a8ab66f781 Hello, 2020! 2020-01-04 13:41:37 +01:00
Tobias Gruetzmacher 2afc0cb645 Director: Always cleanup jobs & threads 
This shouldn't make a difference in normal dosage usage (since dosage
exits right after this anyways), but it removes hidden dependencies
between tests and might help when embedding dosage into other Python
software. As a side effect this gets rid of some global state, so
running dosage multiple times in the same process is more reliable...
 2020-01-04 13:39:14 +01:00
Ruthalas 65228ec2d0 Added Headless Bliss (#146) 2020-01-01 20:53:34 +01:00
Tobias Gruetzmacher e5cb27ffa4 Minor URL fixes, switched some modules to https 2019-12-31 01:44:19 +01:00
Tobias Gruetzmacher be41a692ba Slightly better namer for CloneManga modules 2019-12-31 00:50:22 +01:00
Tobias Gruetzmacher 5a92505606 Fix & test query string parsing 2019-12-31 00:43:46 +01:00
Tobias Gruetzmacher addf78fcbc More cleanup after SmackJeeves redesign 2019-12-29 23:19:17 +01:00
Tobias Gruetzmacher c0ebf9bbe2 Clean up ComicSherpa 2019-12-29 20:53:41 +01:00
Tobias Gruetzmacher d0bc0572c2 Add a test to ckeck that renamed comics point to existing comics 2019-12-29 20:50:56 +01:00
Tobias Gruetzmacher 58611fe600 Remove missing GoComics submodules 2019-12-29 02:17:52 +01:00
Tobias Gruetzmacher 7e9790c7a8 Remove vanished Arcamax comics 2019-12-28 01:00:53 +01:00
Tobias Gruetzmacher 42b23c4537 Force CommitStrip to always use TLS 2019-12-28 00:16:41 +01:00
Techwolf 83cd91e229 Fix WLP/PeterIsTheWolf 2019-12-27 23:34:07 +01:00
Techwolf 0b675572df Fix MonsterUnderTheBed 2019-12-27 23:34:07 +01:00
Techwolf 33954aaab6 Add CatNine/TakeTwo 2019-12-27 23:34:07 +01:00
Techwolf ae7ab251fd Add CatNine 2019-12-27 23:34:07 +01:00
Techwolf 2fe790f91c Add VickiFox 2019-12-27 23:34:07 +01:00
Techwolf 0fcad21b55 Add Prototype 2019-12-27 23:34:07 +01:00
Techwolf e7ebecd03d Add TwokindsSketches 2019-12-27 23:34:07 +01:00
Techwolf 0f8fe12c10 Add LilithsWord 2019-12-27 23:34:07 +01:00
Techwolf 38a29f631f Add FarToTheNorth 2019-12-27 23:34:07 +01:00
Techwolf a6310c8eeb Fix WhiteNoise 2019-12-27 23:34:07 +01:00
Techwolf 1fdb644cb3 Add TailsAndTactics 2019-12-27 23:34:07 +01:00
Techwolf 31b2c3c6ec Fix Namesake 2019-12-27 23:34:07 +01:00
Techwolf 93dc03a429 Fix SleeplessDomain 2019-12-27 23:34:07 +01:00
Techwolf d8ac47f386 Add FurPiled 2019-12-27 23:34:07 +01:00
Techwolf 8f66fd3647 Fix DominicDeegan (no longer endOfLife) 2019-12-27 23:34:07 +01:00
Techwolf e156da4457 Add ComicFury/ResNulliusCS 2019-12-27 23:34:07 +01:00
Techwolf 7a54278ccd Add ClanOfTheCats/Reunion 2019-12-27 23:34:07 +01:00
Techwolf b340403013 Add ClanOfTheCats 2019-12-27 23:34:07 +01:00
Techwolf 3d75493183 Add CarryOn/LegendOfAnneBunny 2019-12-27 22:58:44 +01:00
Techwolf dd88b7f133 Add CarryOn/AliceBlueAndTheGardensOfQ 2019-12-27 22:58:44 +01:00
Techwolf 95fe4b331c Add Erfworld 2019-12-27 22:52:43 +01:00
Techwolf d39055e494 Fix PvPOnline 2019-12-27 22:48:16 +01:00
Techwolf 7e9ca4daba Add AntiheroForHire 2019-12-27 22:40:27 +01:00
Techwolf f15f5920c0 Add CrossTimeCafe 2019-12-27 22:30:00 +01:00
Techwolf dd8200312a Fix Galaxion 2019-12-27 22:25:27 +01:00
Techwolf 5705b1a3eb Add SeelPeel 2019-12-27 22:22:08 +01:00
Techwolf 28bf733ca5 Add Ginpu 2019-12-27 22:20:02 +01:00
Techwolf c5f57288ec Refactor WP_LATEST_SEARCH into class variable of WordPressScraper 2019-12-27 22:20:02 +01:00
Techwolf d732767e02 Fix Freefall 2019-12-27 22:20:02 +01:00
Techwolf 18379b8fc0 Add ComicFury/Snowfall 2019-12-27 22:20:02 +01:00
Techwolf d733baba48 Add TheJunkHyenasDiner 2019-12-27 22:20:02 +01:00
Techwolf deda610666 Add PowerNap 2019-12-27 22:20:02 +01:00
Techwolf e4ded6da25 Add Vexxarr 2019-12-27 22:20:02 +01:00
Techwolf 60d37bcc1b Add CritterCoven 2019-12-27 22:20:02 +01:00
Techwolf 078841055b Add TinyDickAdventures 2019-12-27 22:20:02 +01:00
Techwolf c260640e0a Add NonPlayerCharacter 2019-12-27 22:20:02 +01:00
Techwolf 4d9eb7df4b Fix LookingForGroup 2019-12-27 22:20:02 +01:00
Techwolf 6364b34233 Add DeerMe 2019-12-27 22:20:02 +01:00
Techwolf 5e4bd6f34a Add PeanutBerrySundae 2019-12-27 22:20:02 +01:00
Techwolf 44d2198c34 Add AmbersNoBrainers 2019-12-27 22:20:02 +01:00
Techwolf e6b1895d3b Fix RealLife 2019-12-27 22:20:02 +01:00
Techwolf 561646c9c4 Add Delve 2019-12-27 22:20:02 +01:00
Techwolf 2857189068 Fix Weregeek 2019-12-27 20:24:03 +01:00
Techwolf b383a92f65 Add AdventuresOfFifne 2019-12-27 18:41:49 +01:00
Techwolf afb2275209 Add WereIWolf 2019-12-27 18:38:02 +01:00
Techwolf 24b4d1a391 Add BeyondTheVeil 2019-12-27 18:17:18 +01:00
Techwolf 9e6bd4803a Add Centralia2050 2019-12-27 18:16:01 +01:00
Techwolf 523a65581c Fix MareInternum 2019-12-27 18:15:43 +01:00
Techwolf 8f335c15e1 Add TwinDragons 2019-12-27 17:40:00 +01:00
Techwolf 55180babcf Add Kitfox 2019-12-27 17:38:37 +01:00
Techwolf de67d4f63b Fix KiwiBlitz 2019-12-27 17:37:56 +01:00
Techwolf 255e27eec2 Add HeyKitty 2019-12-27 17:36:51 +01:00
Techwolf 5df3cff92b Add ComicFury/DNA 2019-12-27 17:35:55 +01:00
Techwolf 66e655c074 Add HeyFox 2019-12-27 17:34:58 +01:00
Techwolf 047f023e50 Fix QuestionableContent 2019-12-27 17:34:38 +01:00
Techwolf 5e79ff9d84 Fix DoghouseDiaries 2019-12-27 17:33:53 +01:00
Techwolf fc280badb6 Add ComicFury/Swashbuckled 2019-12-27 17:32:47 +01:00
Techwolf eecffa53a7 Add ComicFury/RedSpot 2019-12-27 17:32:26 +01:00
Techwolf 4c495b78f7 Add DarkWhite 2019-12-27 17:26:22 +01:00
Techwolf 0a81948386 Add ComicFury/Saluna 2019-12-27 17:25:44 +01:00
Techwolf 4d8b35182d Add ComicFury/Threan 2019-12-27 17:25:23 +01:00
Techwolf 1377830917 Add BallerinaMafia 2019-12-27 17:23:44 +01:00
Techwolf fff73f9a09 Add FurthiaHigh 2019-12-27 17:23:01 +01:00
Techwolf ea94a62f58 Fix Concession 2019-12-27 17:22:08 +01:00
Techwolf f6b358c754 Add VirmirWorld 2019-12-27 17:21:05 +01:00
Techwolf 6df6549c97 Split Catena into CatenaCafe & CatenaManor 2019-12-27 17:16:06 +01:00
Techwolf 1fe966102f Add OzyAndMillie 2019-12-27 16:14:30 +01:00
Techwolf 306a6eca8c Add CynWolf 2019-12-27 16:12:43 +01:00
Techwolf 15c9426a2d Add CommanderKitty 2019-12-27 16:12:17 +01:00
Techwolf f99839f42a Add BittersweetCandyBowl 2019-12-27 16:11:01 +01:00
Techwolf 48ed091878 Add PoppyOPossum 2019-12-27 16:10:22 +01:00
Techwolf 9aa0845b17 Fix StandStillStaySilent 2019-12-27 16:09:54 +01:00
Techwolf 8831984991 Add MynarskiForest 2019-12-27 16:07:08 +01:00
Techwolf 24573c4793 Fix Shivae and add side comics 2019-12-27 15:59:10 +01:00
Tobias Gruetzmacher 963db7f448 Adopt SmackJeeves to new site design (fixes #144) 
Some things got lost on the way:
- Since there is no comprehensive comic directory anymore, removed
  automatic update script. New comics need to be added manually.
- Some authors used the opportunity to move from SmackJeeves somewhere
  else - some of those got new modules (either standalone or ComicFury)
- Abunch of comics just disappeared...
 2019-12-26 22:03:18 +01:00
Tobias Gruetzmacher 44af7acdbc Clean up ComicFury a bit 
Mostly getting rid of vanished comics, but also cleaning up the matching
expressions a bit.
 2019-12-25 23:05:11 +01:00
Techwolf ab488cbbd6 Add TheCyantianChronicles comics 2019-12-17 01:29:25 +01:00
Techwolf 24ee2e2594 Add AbbysAgency 2019-12-17 01:28:02 +01:00
Techwolf becc3b98f6 Add AlienDice and AlienDice/Legacy 2019-12-17 01:28:02 +01:00
Techwolf 1def5739b1 Add Tamberlane 2019-12-17 01:28:02 +01:00
Techwolf 05854b6ddf Add DocRat 2019-12-17 01:28:02 +01:00
Techwolf 0d8a803913 Add LittleTales 2019-12-17 01:28:02 +01:00
Techwolf a3d3ea92db Add NeoCTC 2019-12-17 01:28:02 +01:00
Techwolf ab366f12d3 Add FreighterTails 2019-12-17 01:28:02 +01:00
Techwolf 85a7adadc9 Add TheGentleWolf 2019-12-17 01:28:02 +01:00
Techwolf 6e125fb05f Merge TracyAndTristan into ComicFury list 2019-12-17 01:28:02 +01:00
Techwolf 48e064cf1b Add ComicFury/Eros 2019-12-17 01:28:02 +01:00
Techwolf 9cca10b0b7 Add Ryugou 2019-12-17 01:28:02 +01:00
Techwolf 478125f621 Fix UrgentTransformationCrisis 2019-12-17 01:28:02 +01:00
Techwolf 56573c41ae Add Anaria 2019-12-17 01:28:02 +01:00
Techwolf cad90e80e2 Fix SkinDeep 2019-12-17 01:28:02 +01:00
Techwolf a259a65d83 Add Cloudscratcher 2019-12-17 01:28:02 +01:00
Techwolf 138f6001db Fix Flipside 2019-12-17 01:28:02 +01:00
Techwolf d370ac5612 Add TheProbabilityBomb 2019-12-17 01:28:02 +01:00
Techwolf bc87413b22 Add TheOldVictorian 2019-12-17 01:28:02 +01:00
Techwolf 6ed242a7b0 Add OffWhite 2019-12-17 01:28:02 +01:00
Techwolf b6f2000c0b Fix TheGamerCat 2019-12-17 01:28:02 +01:00
Techwolf 1b8c404a15 Add FoxTails 2019-12-17 01:28:02 +01:00
Techwolf 9eacd96f5f Add Everblue 2019-12-17 01:28:02 +01:00
Techwolf 52b0e15330 Add ErmaFelnaEDF 2019-12-17 01:28:02 +01:00
Techwolf b131baa561 Add ComicFury/ProfessorAmazingAndTheIncredibleGoldenFox 2019-12-17 01:28:02 +01:00
Techwolf 23afbd1fb7 Fix Misfile, add Misfile/HellHigh 2019-12-17 01:28:02 +01:00
Techwolf 6f47be87f7 Add WildeLife 2019-12-17 01:28:02 +01:00
Techwolf 0b433d5897 Add Wrongside 2019-12-17 01:28:02 +01:00
Techwolf 6a5823b3fe Add StarfireAgency 2019-12-17 01:28:02 +01:00
Techwolf e62bcb6267 Add Nightshift 2019-12-17 01:28:02 +01:00
Techwolf 8e8d5e5723 Add TracesOfThePast (SFW/NSFW) 2019-12-17 01:28:02 +01:00
Techwolf 57046e23ca Add A&HClub 2019-12-17 01:28:02 +01:00
Techwolf ae0b702107 Add Bethellium 2019-12-17 01:28:02 +01:00
Techwolf 085e1642fb Add Moonlace 2019-12-17 01:28:02 +01:00
Techwolf 280f4fdbb8 Add CutLoose 2019-12-17 01:28:02 +01:00
Techwolf 81e4942e7c Add Replay 2019-12-17 01:28:02 +01:00
Techwolf 7e6d33ddf5 Fix Lackadaisy 2019-12-17 01:28:02 +01:00
Techwolf c9e3923442 Fix AlphaLuna 2019-12-17 01:28:02 +01:00
Techwolf 6cfde34663 Fix Altermeta 2019-12-17 01:28:02 +01:00
Techwolf 2916b39c98 Add ApartmentForTwo 2019-12-17 01:28:02 +01:00
Techwolf ae82096e96 Add QuentynQuinnSpaceRanger 2019-12-17 01:28:02 +01:00
Techwolf 5fb39c5faf Add TalesOfTheQuestor 2019-12-17 01:28:02 +01:00
Techwolf ff4fa7892d Add QuantumVibe 2019-12-17 01:28:02 +01:00
Techwolf 7d03d3369b Add LastResort 2019-12-17 01:28:02 +01:00
Techwolf cb360bc983 Add Bloodline 2019-12-17 01:28:02 +01:00
Techwolf 9e52bea334 Add SixPackOfOtters 2019-12-17 01:28:02 +01:00
Techwolf 0648bbadc9 Add Kaspall 2019-12-17 01:28:02 +01:00
Techwolf 379f963442 Add TheClassMenagerie 2019-12-17 01:28:02 +01:00
Techwolf a6aacf0cc7 Add DMFA side stories 
(this also moves all DMFA modules into their own file)
 2019-12-17 01:28:02 +01:00
Techwolf b79f22fb65 Mark KeenSpot/GeneCatlow completed :( 2019-12-17 00:05:47 +01:00
Techwolf f79d3c9309 Fix GunnerkriggCourt 2019-12-17 00:04:20 +01:00
Tobias Gruetzmacher 835f484673 Simplify ComicsKingdom extraction a bit 2019-12-16 23:47:14 +01:00
littauer 4d369376c0 Add ComicsKingdom.com (aka King Features) (#134) 
Note that going back more than about seven days is a paid feature and is untested.
 2019-12-16 23:18:04 +01:00
Tobias Gruetzmacher adb3db3d22 Add some tests for the update check 2019-12-05 22:23:48 +01:00
Tobias Gruetzmacher f5253c7f45 Return a fallback "version" if dosage is not installed 
Additionally, inform the user on how to fix the problem. Thanks to twb
for noticing this.
 2019-12-05 21:41:15 +01:00
Tobias Gruetzmacher 7615ee60d1 Switch from pkg_resources to importlib 
One dependency less (at least für Python 3.8+) and it should be faster
(not tested).
 2019-12-05 21:40:45 +01:00
Tobias Gruetzmacher 4511bab996 Fix xkcd pages where comic is linked 2019-12-05 07:10:49 +01:00
Tobias Gruetzmacher 66f154f074 Add throttling for GoComics (fixes #90) 
Since this was the goal of the whole throttling implementation ;)
 2019-12-04 00:28:27 +01:00
Tobias Gruetzmacher a347bebfe3 Add simple host-based throttling 2019-12-04 00:28:27 +01:00
Tobias Gruetzmacher e5e7dfacd6 Move basic HTTP setup into a new module 
We now subclass requests' Session to make further extensions of the HTTP
flow possible.
 2019-12-03 23:58:20 +01:00
Tobias Gruetzmacher d2861d029f Fix "Extra Fabulous Comics" (fixes #129) 2019-12-03 19:50:41 +01:00
Tobias Gruetzmacher ddba32391b Add BlondeSunrise (fixes #142) 2019-12-03 00:14:57 +01:00
Tobias Gruetzmacher f5a5106381 Allow combining -n with -c or -a (related to #90) 
This allows fetching "all" comics (or catch up until the last existing
one) while setting an upper bound on how many pages to fetch at the same
time.
 2019-12-01 23:19:06 +01:00
Jakob Kogler 6fd3282047 Add comic "turnoff" (closes #139) 2019-12-01 21:46:00 +01:00
hkocharyan 31309a26d2 fixed oglaf next and previous tags (#141) 2019-11-19 20:56:54 +01:00
Tobias Gruetzmacher 00d0201c5f Fix a bunch of flake8 issues 2019-11-04 00:16:25 +01:00
Techwolf 255fbfa1b4 Add Evon 2019-11-03 23:51:58 +01:00
Techwolf b230ef31d8 Add Guardia 2019-11-03 23:51:27 +01:00
Techwolf 70223bd38f Add YouSayItFirst 2019-11-03 23:50:47 +01:00
Techwolf a5a868c2e7 Add NicoleAndDerek 2019-11-03 23:50:47 +01:00
Techwolf be6a6722b5 Add UnlikeMinerva 2019-11-03 23:50:47 +01:00
Techwolf fcdbd563a2 Add HavocInc 2019-11-03 23:44:49 +01:00
Techwolf a575e5e0f0 Add Dissonance 2019-11-03 23:44:24 +01:00
Techwolf 14a01c3e47 Add OutOfPlacers 2019-11-03 23:43:23 +01:00
Techwolf edc59a86e3 Add PlushAndBlood 2019-11-03 23:42:46 +01:00
Techwolf 4c7a654dcc Add WhiteNoiseLee 2019-11-03 23:42:25 +01:00
Techwolf 12b048d449 Add Savestate 2019-11-03 23:41:48 +01:00
Techwolf 4a783c11ec Add NotAVillain 2019-11-03 23:41:28 +01:00
Techwolf 013d10a1f2 Add SmackJeeves/FurryExperience 2019-11-03 23:40:58 +01:00
Techwolf 2a7d63b7eb Add CrimsonFlag 2019-11-03 23:39:53 +01:00
Techwolf e06f31784e Add Supercell 2019-11-03 23:38:12 +01:00
Techwolf f4e3c09717 Add CollegeCatastrophe 2019-11-03 23:37:46 +01:00