Commit graph

1118 commits

Author SHA1 Message Date
Techwolf
6df6549c97 Split Catena into CatenaCafe & CatenaManor 2019-12-27 17:16:06 +01:00
Techwolf
1fe966102f Add OzyAndMillie 2019-12-27 16:14:30 +01:00
Techwolf
306a6eca8c Add CynWolf 2019-12-27 16:12:43 +01:00
Techwolf
15c9426a2d Add CommanderKitty 2019-12-27 16:12:17 +01:00
Techwolf
f99839f42a Add BittersweetCandyBowl 2019-12-27 16:11:01 +01:00
Techwolf
48ed091878 Add PoppyOPossum 2019-12-27 16:10:22 +01:00
Techwolf
9aa0845b17 Fix StandStillStaySilent 2019-12-27 16:09:54 +01:00
Techwolf
8831984991 Add MynarskiForest 2019-12-27 16:07:08 +01:00
Techwolf
24573c4793 Fix Shivae and add side comics 2019-12-27 15:59:10 +01:00
Tobias Gruetzmacher
963db7f448 Adopt SmackJeeves to new site design (fixes #144)
Some things got lost on the way:
- Since there is no comprehensive comic directory anymore, removed
  automatic update script. New comics need to be added manually.
- Some authors used the opportunity to move from SmackJeeves somewhere
  else - some of those got new modules (either standalone or ComicFury)
- Abunch of comics just disappeared...
2019-12-26 22:03:18 +01:00
Tobias Gruetzmacher
44af7acdbc Clean up ComicFury a bit
Mostly getting rid of vanished comics, but also cleaning up the matching
expressions a bit.
2019-12-25 23:05:11 +01:00
Techwolf
ab488cbbd6 Add TheCyantianChronicles comics 2019-12-17 01:29:25 +01:00
Techwolf
24ee2e2594 Add AbbysAgency 2019-12-17 01:28:02 +01:00
Techwolf
becc3b98f6 Add AlienDice and AlienDice/Legacy 2019-12-17 01:28:02 +01:00
Techwolf
1def5739b1 Add Tamberlane 2019-12-17 01:28:02 +01:00
Techwolf
05854b6ddf Add DocRat 2019-12-17 01:28:02 +01:00
Techwolf
0d8a803913 Add LittleTales 2019-12-17 01:28:02 +01:00
Techwolf
a3d3ea92db Add NeoCTC 2019-12-17 01:28:02 +01:00
Techwolf
ab366f12d3 Add FreighterTails 2019-12-17 01:28:02 +01:00
Techwolf
85a7adadc9 Add TheGentleWolf 2019-12-17 01:28:02 +01:00
Techwolf
6e125fb05f Merge TracyAndTristan into ComicFury list 2019-12-17 01:28:02 +01:00
Techwolf
48e064cf1b Add ComicFury/Eros 2019-12-17 01:28:02 +01:00
Techwolf
9cca10b0b7 Add Ryugou 2019-12-17 01:28:02 +01:00
Techwolf
478125f621 Fix UrgentTransformationCrisis 2019-12-17 01:28:02 +01:00
Techwolf
56573c41ae Add Anaria 2019-12-17 01:28:02 +01:00
Techwolf
cad90e80e2 Fix SkinDeep 2019-12-17 01:28:02 +01:00
Techwolf
a259a65d83 Add Cloudscratcher 2019-12-17 01:28:02 +01:00
Techwolf
138f6001db Fix Flipside 2019-12-17 01:28:02 +01:00
Techwolf
d370ac5612 Add TheProbabilityBomb 2019-12-17 01:28:02 +01:00
Techwolf
bc87413b22 Add TheOldVictorian 2019-12-17 01:28:02 +01:00
Techwolf
6ed242a7b0 Add OffWhite 2019-12-17 01:28:02 +01:00
Techwolf
b6f2000c0b Fix TheGamerCat 2019-12-17 01:28:02 +01:00
Techwolf
1b8c404a15 Add FoxTails 2019-12-17 01:28:02 +01:00
Techwolf
9eacd96f5f Add Everblue 2019-12-17 01:28:02 +01:00
Techwolf
52b0e15330 Add ErmaFelnaEDF 2019-12-17 01:28:02 +01:00
Techwolf
b131baa561 Add ComicFury/ProfessorAmazingAndTheIncredibleGoldenFox 2019-12-17 01:28:02 +01:00
Techwolf
23afbd1fb7 Fix Misfile, add Misfile/HellHigh 2019-12-17 01:28:02 +01:00
Techwolf
6f47be87f7 Add WildeLife 2019-12-17 01:28:02 +01:00
Techwolf
0b433d5897 Add Wrongside 2019-12-17 01:28:02 +01:00
Techwolf
6a5823b3fe Add StarfireAgency 2019-12-17 01:28:02 +01:00
Techwolf
e62bcb6267 Add Nightshift 2019-12-17 01:28:02 +01:00
Techwolf
8e8d5e5723 Add TracesOfThePast (SFW/NSFW) 2019-12-17 01:28:02 +01:00
Techwolf
57046e23ca Add A&HClub 2019-12-17 01:28:02 +01:00
Techwolf
ae0b702107 Add Bethellium 2019-12-17 01:28:02 +01:00
Techwolf
085e1642fb Add Moonlace 2019-12-17 01:28:02 +01:00
Techwolf
280f4fdbb8 Add CutLoose 2019-12-17 01:28:02 +01:00
Techwolf
81e4942e7c Add Replay 2019-12-17 01:28:02 +01:00
Techwolf
7e6d33ddf5 Fix Lackadaisy 2019-12-17 01:28:02 +01:00
Techwolf
c9e3923442 Fix AlphaLuna 2019-12-17 01:28:02 +01:00
Techwolf
6cfde34663 Fix Altermeta 2019-12-17 01:28:02 +01:00
Techwolf
2916b39c98 Add ApartmentForTwo 2019-12-17 01:28:02 +01:00
Techwolf
ae82096e96 Add QuentynQuinnSpaceRanger 2019-12-17 01:28:02 +01:00
Techwolf
5fb39c5faf Add TalesOfTheQuestor 2019-12-17 01:28:02 +01:00
Techwolf
ff4fa7892d Add QuantumVibe 2019-12-17 01:28:02 +01:00
Techwolf
7d03d3369b Add LastResort 2019-12-17 01:28:02 +01:00
Techwolf
cb360bc983 Add Bloodline 2019-12-17 01:28:02 +01:00
Techwolf
9e52bea334 Add SixPackOfOtters 2019-12-17 01:28:02 +01:00
Techwolf
0648bbadc9 Add Kaspall 2019-12-17 01:28:02 +01:00
Techwolf
379f963442 Add TheClassMenagerie 2019-12-17 01:28:02 +01:00
Techwolf
a6aacf0cc7 Add DMFA side stories
(this also moves all DMFA modules into their own file)
2019-12-17 01:28:02 +01:00
Techwolf
b79f22fb65 Mark KeenSpot/GeneCatlow completed :( 2019-12-17 00:05:47 +01:00
Techwolf
f79d3c9309 Fix GunnerkriggCourt 2019-12-17 00:04:20 +01:00
Tobias Gruetzmacher
835f484673 Simplify ComicsKingdom extraction a bit 2019-12-16 23:47:14 +01:00
littauer
4d369376c0 Add ComicsKingdom.com (aka King Features) (#134)
Note that going back more than about seven days is a paid feature and is untested.
2019-12-16 23:18:04 +01:00
Tobias Gruetzmacher
adb3db3d22 Add some tests for the update check 2019-12-05 22:23:48 +01:00
Tobias Gruetzmacher
f5253c7f45 Return a fallback "version" if dosage is not installed
Additionally, inform the user on how to fix the problem. Thanks to twb
for noticing this.
2019-12-05 21:41:15 +01:00
Tobias Gruetzmacher
7615ee60d1 Switch from pkg_resources to importlib
One dependency less (at least für Python 3.8+) and it should be faster
(not tested).
2019-12-05 21:40:45 +01:00
Tobias Gruetzmacher
4511bab996 Fix xkcd pages where comic is linked 2019-12-05 07:10:49 +01:00
Tobias Gruetzmacher
66f154f074 Add throttling for GoComics (fixes #90)
Since this was the goal of the whole throttling implementation ;)
2019-12-04 00:28:27 +01:00
Tobias Gruetzmacher
a347bebfe3 Add simple host-based throttling 2019-12-04 00:28:27 +01:00
Tobias Gruetzmacher
e5e7dfacd6 Move basic HTTP setup into a new module
We now subclass requests' Session to make further extensions of the HTTP
flow possible.
2019-12-03 23:58:20 +01:00
Tobias Gruetzmacher
d2861d029f Fix "Extra Fabulous Comics" (fixes #129) 2019-12-03 19:50:41 +01:00
Tobias Gruetzmacher
ddba32391b Add BlondeSunrise (fixes #142) 2019-12-03 00:14:57 +01:00
Tobias Gruetzmacher
f5a5106381 Allow combining -n with -c or -a (related to #90)
This allows fetching "all" comics (or catch up until the last existing
one) while setting an upper bound on how many pages to fetch at the same
time.
2019-12-01 23:19:06 +01:00
Jakob Kogler
6fd3282047 Add comic "turnoff" (closes #139) 2019-12-01 21:46:00 +01:00
hkocharyan
31309a26d2 fixed oglaf next and previous tags (#141) 2019-11-19 20:56:54 +01:00
Tobias Gruetzmacher
00d0201c5f Fix a bunch of flake8 issues 2019-11-04 00:16:25 +01:00
Techwolf
255fbfa1b4 Add Evon 2019-11-03 23:51:58 +01:00
Techwolf
b230ef31d8 Add Guardia 2019-11-03 23:51:27 +01:00
Techwolf
70223bd38f Add YouSayItFirst 2019-11-03 23:50:47 +01:00
Techwolf
a5a868c2e7 Add NicoleAndDerek 2019-11-03 23:50:47 +01:00
Techwolf
be6a6722b5 Add UnlikeMinerva 2019-11-03 23:50:47 +01:00
Techwolf
fcdbd563a2 Add HavocInc 2019-11-03 23:44:49 +01:00
Techwolf
a575e5e0f0 Add Dissonance 2019-11-03 23:44:24 +01:00
Techwolf
14a01c3e47 Add OutOfPlacers 2019-11-03 23:43:23 +01:00
Techwolf
edc59a86e3 Add PlushAndBlood 2019-11-03 23:42:46 +01:00
Techwolf
4c7a654dcc Add WhiteNoiseLee 2019-11-03 23:42:25 +01:00
Techwolf
12b048d449 Add Savestate 2019-11-03 23:41:48 +01:00
Techwolf
4a783c11ec Add NotAVillain 2019-11-03 23:41:28 +01:00
Techwolf
013d10a1f2 Add SmackJeeves/FurryExperience 2019-11-03 23:40:58 +01:00
Techwolf
2a7d63b7eb Add CrimsonFlag 2019-11-03 23:39:53 +01:00
Techwolf
e06f31784e Add Supercell 2019-11-03 23:38:12 +01:00
Techwolf
f4e3c09717 Add CollegeCatastrophe 2019-11-03 23:37:46 +01:00
Techwolf
59c68bc447 Add NineToNine 2019-11-03 23:37:33 +01:00
Techwolf
a444798460 Add SwordsAndSausages 2019-11-03 23:37:13 +01:00
Techwolf
99ee4147f7 Add SuburbanJungleRoughHousing 2019-11-03 23:36:50 +01:00
Techwolf
f564989e36 Add SuburbanJungle 2019-11-03 23:36:31 +01:00
Techwolf
8a987d3d97 Add ButImACatPerson 2019-11-03 23:36:02 +01:00
Techwolf
44b65f9aac Add OrderOfTheBlackDog 2019-11-03 23:35:40 +01:00
Techwolf
15a5953120 Add ATaleOfTails 2019-11-03 23:35:06 +01:00
Techwolf
323bfc3a6a Add Dreamkeepers 2019-11-03 23:34:38 +01:00
Techwolf
70e78a87de Add CarryOn 2019-11-03 23:34:04 +01:00
Techwolf
e565b083be Add CavesAndCritters 2019-11-03 23:31:17 +01:00
Techwolf
6d76193a9f Add IslaAukate and IslaAukateColor 2019-11-03 23:29:02 +01:00
Techwolf
dd6e536a55 Add Kaerwyn and BlackTapestries 2019-11-03 23:26:03 +01:00
Techwolf
0eccdf737a Add Housepets 2019-11-03 21:53:13 +01:00
Techwolf
48ebffc756 Add HowToBeAWerewolf 2019-11-03 21:39:52 +01:00
Techwolf
f5b7b067b7 Switch AGirlAndHerFed to parser scraper 2019-11-03 21:37:05 +01:00
Techwolf
ed3acd2d2f Fix TheWhiteboard 2019-11-03 21:35:58 +01:00
Techwolf
b055a8574f Fix DominicDeegan 2019-11-03 21:34:53 +01:00
Techwolf
1b87afad7e Fix GrrlPower 2019-11-03 21:34:18 +01:00
Techwolf
9796f994e3 Add SSDD 2019-11-03 21:33:03 +01:00
Techwolf
6b319fdda8 Fix SabrinaOnline 2019-11-03 21:31:50 +01:00
Techwolf
b2db51c361 Add OriginalLife 2019-11-03 21:22:56 +01:00
Techwolf
016516e984 Switch BetterDays to parser scraper 2019-11-03 21:22:29 +01:00
Techwolf
5ca5da51fc Fix Curtailed 2019-11-03 21:20:23 +01:00
Techwolf
79618e2a2f Add first strip URL for PS238 2019-11-03 21:19:10 +01:00
Techwolf
764a8ce6f6 Fix SlightlyDamned 2019-11-03 21:17:31 +01:00
Tobias Gruetzmacher
e24c0ae557 Simplify voting code
Not sure if I keep this feature, but at least I can now see if anybody
is still using it...
2019-11-03 21:04:34 +01:00
Tobias Gruetzmacher
ac9d8db1e8 Make sure user agent is in all HTTP requests 2019-11-03 20:17:27 +01:00
Mikkel Høgh
0dea216851 Fix missing returns in RSS parsing (#137)
Also added a very basic test for feed parsing.
2019-10-28 16:48:21 +01:00
Tobias Gruetzmacher
328b3cd072 Add new namer "joinPathPartsNamer"
Additionally, switch some comics which benefit from it to the new namer.
This fixes #127.
2019-06-30 20:52:15 +02:00
Mikkel Høgh
b8b488670e New comic: The Rock Cocks (#138) 2019-06-30 19:46:39 +02:00
Mikkel Høgh
f29d14c3b4 Fix Gunnerkrigg Court prevSearch matcher (#135) 2019-06-26 23:25:01 +02:00
Mikkel Høgh
78ac7144b2 Fix Girls with Slingshots matchers (#136)
Domain name and URLs have changed slightly.

Fixes #105.
2019-06-26 23:22:45 +02:00
Tobias Gruetzmacher
1d910a5bbd Remove pbr from runtime 2019-06-19 07:31:34 +02:00
Gervásio Júnior
6c8814fe40 Fix multiple imgs for json flag & ZenPencils bouncer (#133)
When using the JSON output flag, if the page has more than one image,
dictionary indexing cannot be used as list.

For the ZenPencils comic, the bouncer is missing, saving the page url
as the root url.
2019-06-19 07:09:33 +02:00
Arthur Caranta
ffbf494765 Added support for Tripping Over You comic (#130) 2019-04-17 20:28:17 +02:00
Tobias Gruetzmacher
9c4a791853 Repair loader for PyInstaller 3.4 2019-03-08 23:46:50 +01:00
Damjan Košir
78e8f05360 added MonkeyUser 2018-08-28 22:13:48 +12:00
erpbridge
e7410ce26b Update for new LookingForGroup site format (#123)
Site uses a WordPress build, but does not explicitly match
any existing scrapers. Fixes #120.
2018-08-12 23:39:51 +02:00
erpbridge
62d3692d3b Update for ElGoonishShive and ElGoonishShiveNP (#122)
Strip no longer supports ID numbers after May 21 site revamp per Dan Shive. Code here switched to ComicControl. Tested and verified locally.  (fixes #118)
2018-08-10 09:13:43 +02:00
Tobias Gruetzmacher
49ec3cc3fa Fix (and simplify) GoComics expressions (fixes #117) 2018-07-14 11:00:27 +02:00
Tobias Gruetzmacher
6ba1e49bfd Kenneth Reitz’s Code Style™
See http://docs.python-requests.org/en/master/dev/contributing/#kenneth-reitz-s-code-style

Effectively, this removes "visual" indents.
2018-06-29 19:26:17 +02:00
Tobias Gruetzmacher
fbb3a18c91 Enable warnings and fix some of them 2018-05-23 00:54:40 +02:00
Dirk Reiners
050a0dc97c MenageA3 naming fix 2018-04-23 08:07:41 +02:00
Dirk Reiners
cba9edbdec LifeAintNoPontFarm added 2018-04-23 08:06:13 +02:00
Dirk Reiners
01c1b04778 CyanideAndHappiness fix 2018-04-23 07:53:22 +02:00
Dirk Reiners
fbd2ac2246 Handle get_terminal_size() returning 0 (fixes #106) 2018-04-23 07:50:28 +02:00
Peter Janes
2a2ff2d545 GoComics no longer has nav on the comic's home page. 2018-04-06 14:09:13 -04:00
Tobias Gruetzmacher
1fe98d2f7f Use a diferent div class for GoComics (fixes #102). 2018-03-23 00:29:40 +01:00
Tobias Gruetzmacher
2dbd3382f7 Update LeastICouldDo (fixes #99) 2017-12-15 00:00:25 +01:00
Tobias Gruetzmacher
75aa7207ea Some minor fixes to make some modules work again. 2017-11-27 01:04:35 +01:00
Tobias Gruetzmacher
405c4c0b43 Recreate SluggyFreelance module (fixes #96). 2017-11-26 20:23:33 +01:00
Tobias Gruetzmacher
90685d9b0c Only support modern versions of PyCountry. 2017-11-26 19:29:48 +01:00
Damjan Košir
79a2516c61 deathbulge fix 2017-11-17 21:49:47 +13:00
Tobias Gruetzmacher
d88f6aeee3 Replace online tests with mocks.
We want to test our code, not the comic modules.
2017-10-15 14:54:44 +02:00
Tobias Gruetzmacher
f1b83748ed When testing the command line, call main method.
Previously, we were spawning the main binary in a subprocess, which is
fragile and interacts poorly with some testing frameworks...
2017-10-15 14:54:44 +02:00
Tobias Gruetzmacher
ac2ca54570 Remove handlers after director run. 2017-10-15 14:54:44 +02:00
Damjan Košir
24862715d5 realised we have a scraper for CMS MenageA3 uses 2017-10-03 21:47:32 +13:00