Tobias Gruetzmacher
0bdf3dd94b
Allow adding external directories to the plugin package
2020-10-04 22:28:51 +02:00
Tobias Gruetzmacher
3256f9fdc2
Hardcode the "plugins" package name
2020-10-04 22:28:51 +02:00
Tobias Gruetzmacher
9237bd62b2
Convert scraper cache to a class
...
This should make it easier to extend with additional entries.
2020-10-04 22:28:51 +02:00
Tobias Gruetzmacher
5ec0710d26
Enhance test to test timestamp output
2020-10-04 22:14:06 +02:00
Tobias Gruetzmacher
26f63fd994
Remove unused property in Output class
2020-10-04 22:12:34 +02:00
Tobias Gruetzmacher
c86e1ad863
Fix stupid error :D
2020-10-01 18:18:31 +02:00
Tobias Gruetzmacher
020b8497c0
Generate start script for PyInstaller from entry point
2020-10-01 16:13:08 +02:00
Tobias Gruetzmacher
d93fed567c
Distribute PyInstaller hook
...
This uses a feature introduced in PyInstaller 4.0 to register hooks as
entry points and automatically discover them whenever a module is used.
2020-10-01 15:51:09 +02:00
Tobias Gruetzmacher
d0162cfb32
Add a test for the "dosage @" feature
2020-10-01 14:35:33 +02:00
Tobias Gruetzmacher
d06e642b56
Assume developers are using virtualenvs
...
If this is true, we don't have to mess with sys.path or provide a
"convenience" launcher anymore.
2020-10-01 14:11:11 +02:00
Tobias Gruetzmacher
7c2c9c3778
Fix VGCats & switch to HTTPS
2020-09-30 21:37:29 +02:00
Tobias Gruetzmacher
bb71adbe72
Remove VictimsOfTheSystem
...
Domain seems to be gone for some month and archive.org doesn't have
enough to switch.
2020-09-30 21:29:58 +02:00
Tobias Gruetzmacher
23a3e3b101
Switch WastedTalent to ParserScraper
2020-09-30 21:24:01 +02:00
Tobias Gruetzmacher
dfa412c03e
Skip videos for WapsiSquare
2020-09-30 21:17:46 +02:00
Tobias Gruetzmacher
bbe3d9f9be
Remove WebDesignerCOTW
2020-09-30 21:16:55 +02:00
Tobias Gruetzmacher
437afc685d
Add GenshinImpact to Webtoons module
2020-09-30 18:24:33 +02:00
Tobias Gruetzmacher
e4f1f59432
Fix ButtercupFestival
2020-09-29 23:31:38 +02:00
Tobias Gruetzmacher
dc41c318e9
Fix ButterSafe
2020-09-29 23:04:56 +02:00
Tobias Gruetzmacher
f31c0c681d
Fix BusinessCat and mark as endOfLife
2020-09-29 23:00:58 +02:00
Tobias Gruetzmacher
2364e8bab3
Fix Brink and mark as endOfLife
2020-09-29 23:00:53 +02:00
Tobias Gruetzmacher
5afab71e7f
Fix BoredAndEvil
2020-09-29 22:35:09 +02:00
Tobias Gruetzmacher
5863ddb73b
Fix BookOfBiff
2020-09-29 22:27:32 +02:00
Tobias Gruetzmacher
bbac2f99a7
Fix BetweenFailures
2020-09-29 22:22:55 +02:00
Tobias Gruetzmacher
3330162c6b
Fix BetterDays with archive.org
2020-09-29 21:35:41 +02:00
Tobias Gruetzmacher
e98a1601ca
Remove workaround for libxml2 older 2.9.3 (2015)
...
This workaround was written in 2016 while that version was still found
on many systems. Addionally, this workaround needs to be enabled by the
developer, who might not even be aware that they need to enable it for a
specific module. We still throw a warning to the user if running with
such an old libxml version.
2020-09-29 21:16:48 +02:00
Tobias Gruetzmacher
c065a820ed
Fix BadMachinery and mark as endOfLife
2020-09-29 21:01:33 +02:00
Tobias Gruetzmacher
24efafdf96
Fix BMovieComic
2020-09-29 20:30:44 +02:00
Tobias Gruetzmacher
4d8c4e8d2e
Allow proxies for module tests
...
This should make it easier to include geo-blocked comics.
2020-09-29 01:50:02 +02:00
Tobias Gruetzmacher
b6631f5715
Don't install flake8-no-fstring on Python 3.5 :D
2020-09-28 22:52:39 +02:00
Tobias Gruetzmacher
0fe32e7562
Remove unused f-string
...
Since we still want to support Python 3.5 for a bit, we should avoid
f-strings until we finally drop support for that.
2020-09-28 22:19:48 +02:00
Tobias Gruetzmacher
7e040086b6
Try to inform the user about geo-blocks
...
Instead of letting the crawler run into "random" error messages, throw a
specific "geoblocked" exception instead.
2020-09-28 13:11:34 +02:00
Tobias Gruetzmacher
e34a0b539c
Don't rethrow RequestException as IOError
...
Since RequestException already is an IOError, nothing of value is lost.
2020-09-28 12:05:01 +02:00
Tobias Gruetzmacher
8d7fd8b884
Update GoComics modules
...
The usual: GoComics removed some comics, added some and renamed some...
2020-09-28 01:15:07 +02:00
Tobias Gruetzmacher
b090d86c9b
Switch Drowtales to parser scraper (also fixes it)
2020-09-27 20:56:26 +02:00
Tobias Gruetzmacher
5652b9cb23
Don't install some flake8 plugins on Python 3.5
...
They were never available in Python 3.5, so this breaks the CI build.
2020-09-27 20:38:06 +02:00
Tobias Gruetzmacher
a7f9692ffe
Add StalkerXStalker to WebToons module ( fixes #173 )
2020-09-27 19:21:28 +02:00
Tobias Gruetzmacher
ccb4c32c6b
Fix DumbingOfAge
2020-09-27 19:16:34 +02:00
Tobias Gruetzmacher
65fa1f71e5
Move flake8 plugins to development dependencies
...
This makes it easier for developers to run flake8 in their development
virtualenv.
2020-09-27 18:49:46 +02:00
Tobias Gruetzmacher
346b3b4abd
Fix ShipInABottle
2020-09-27 18:34:36 +02:00
Tobias Gruetzmacher
632433d896
Move CrapIDrewOnMyLunchBreak to WebToons
...
Unfortunatly, the original website is broken.
2020-09-27 18:25:33 +02:00
Tobias Gruetzmacher
85c40a942f
Remove StuffNoOneToldMe
2020-09-27 15:50:48 +02:00
Tobias Gruetzmacher
8cc916b292
Fix CynWolf
2020-09-27 15:50:25 +02:00
Tobias Gruetzmacher
3ac8f703bd
Make URL differences non-fatal in module tests
2020-09-26 23:08:00 +02:00
Tobias Gruetzmacher
193b3da801
Repair EarthsongSaga ( fixes #172 )
...
Verified as fetching the complete history right now.
2020-09-26 11:29:45 +02:00
Tobias Gruetzmacher
383e759a0e
Switch Achewood to ParserScraper
2020-09-26 09:42:48 +02:00
Tobias Gruetzmacher
fd779475c1
Fix first comic for Achewood ( fixes #175 )
2020-09-26 09:31:31 +02:00
Tobias Gruetzmacher
ab1217b1c0
Merge pull request #174 from garbled1/newcomics
...
Add 9 new comics
2020-09-15 00:14:33 +02:00
garbled1
598cdd092c
Add TheGlassScientists
2020-09-13 08:28:19 -07:00
garbled1
c870f71715
Add TheBoyWhoFell
2020-09-13 08:18:42 -07:00
garbled1
f223bc09fb
Add TheForgottenOrder
2020-09-13 08:14:52 -07:00
