dmoonfire/dosage
1
0
Fork 0
Code Issues Pull requests Packages Projects Releases Activity
2370 commits 1 branch 0 tags 31 MiB
Commit graph

1582 commits

Author SHA1 Message Date
Tobias Gruetzmacher 4f932803a3
Extend scraper API with a extract_image_urls method 
This is just a light wrapper around fetchUrls, but frees comic modules
from second-guessing for what purpose fetchUrls was called when they are
overriding that API - And yes, some comic modules already got this
wrong, they are now all fixed.
 2023-06-10 15:05:57 +02:00
Techwolf 202e47af50
Clean up lost comics 2023-06-09 15:37:46 +02:00
Techwolf 6719c6ac25
Add MangaDex/UzakiChanWaAsobitai 2023-06-09 15:37:46 +02:00
Techwolf e9b48cfd58
Fix UberQuest 2023-06-09 15:37:46 +02:00
Techwolf 4965e0ce09
Add Shifters/TheBeastWithin 2023-06-09 15:37:46 +02:00
Techwolf 8e416325ac
Add Shifters/OnGossamerWings 2023-06-09 15:37:45 +02:00
Techwolf 61deb8900b
Fix Shifters 2023-06-09 15:37:45 +02:00
Techwolf 22865e0a1b
Add Hellkats 2023-06-09 15:37:45 +02:00
Techwolf 540163b9ee
Fix StarfireAgency 2023-06-09 15:37:45 +02:00
Techwolf ed1124662c
Fix Nightshift 2023-06-09 15:37:45 +02:00
Techwolf cf95aa076a
Add Rainburn 2023-06-09 15:37:45 +02:00
Techwolf 63723bc1f9
Fix FoxDad 2023-06-09 15:37:45 +02:00
Techwolf 734326106d
Fix PvPOnline 2023-06-09 15:37:45 +02:00
Techwolf 5d6321f79e
Fix PlushAndBlood 2023-06-09 15:37:45 +02:00
Techwolf 14180fef14
Add Tapastic/Ginpu 2023-06-09 15:37:45 +02:00
Techwolf 94bfb6e2cf
Add WebToons/CrystalVirusOtherStory 2023-06-09 15:37:45 +02:00
Techwolf f158f5af7c
Fix Weregeek 2023-06-09 15:37:45 +02:00
Techwolf 9c143f3c9c
Fix NonPlayerCharacter 2023-06-09 15:37:45 +02:00
Techwolf 4109adaa2a
Fix AlphaLuna 2023-06-09 15:37:45 +02:00
Techwolf 10733c1512
Add WebToons/WorldsStrongestTroll 2023-06-09 15:37:45 +02:00
Techwolf c296e5102e
Add MangaDex/MyWifeIsFromAThousandYearsAgo 2023-06-09 15:37:45 +02:00
Techwolf e2dd8e2f3c
Add MangaDex/MousouTelepathy 2023-06-09 15:37:45 +02:00
Techwolf b06b746e86
Add Lancer 2023-06-09 15:37:45 +02:00
Techwolf 550aac28de
Add MangaDex/LonelyGirlNiSakaraenai 2023-06-09 15:37:45 +02:00
Techwolf 8287bb6bed
Fix Lackadaisy 2023-06-09 15:37:45 +02:00
Techwolf df133acb06
Fix OhJoySexToy (fixes #255) 2023-06-09 15:37:45 +02:00
Techwolf d604f1adc6
Add ProjectFuture/ZetaTakesATrip 2023-06-09 15:37:45 +02:00
Techwolf 2547fb6282
Add MangaDex/Overgeared 2023-06-09 15:20:27 +02:00
Techwolf 58ddba1a7e
Add ProjectFuture/InnocenceGuiltAndChange 2023-06-09 15:20:27 +02:00
Techwolf 7209d932f4
Add KemonoCafe/CaughtInOrbit 2023-06-09 15:20:27 +02:00
Techwolf c4090bc590
Add MangaDex/AniTomo 2023-06-09 15:20:27 +02:00
Techwolf 0916136e09
add MangaDex/TamingMaster 2023-06-09 15:20:27 +02:00
Techwolf 77d51ce613
Add MangaDex/ImTheMaxLevelNewbie 2023-06-09 15:20:27 +02:00
Techwolf 176495afcb
Add Vreakerz 2023-06-09 15:20:27 +02:00
Techwolf 8814c7c656
Add WebToons/Miez 2023-06-09 14:17:10 +02:00
Techwolf 93f0a36507
Add MangaDex/ArcaneSniper 2023-06-09 14:17:10 +02:00
Techwolf dabf0c9373
Add ComicFury/QueenieAdventure 2023-06-09 14:17:10 +02:00
Techwolf 005e2f126d
Fix ComicFury/Alderwood 2023-06-09 14:17:10 +02:00
Techwolf 13cb80728b
Add WebToons/CatchMeIfYouCan 2023-06-09 14:17:10 +02:00
Techwolf 3404e48889
Add WebToons/NotSoLucky 2023-06-09 14:17:10 +02:00
Techwolf 8ec987411d
Add WebToons/BitterSweetCoffee 2023-06-09 14:17:10 +02:00
Techwolf 536fdba808
Add WebToons/TheSpectrumOfUs 2023-06-09 14:17:10 +02:00
Techwolf 382c395dd5
Add MangaDex/KaikoSaretaAnkokuHeishi30DaiNoSlowNaSecondLife 2023-06-09 14:17:10 +02:00
Techwolf bcdaf8749a
Add MangaDex/KonoKaishaNiSukiNaHitoGaImasu 2023-06-09 14:17:10 +02:00
Techwolf 7c66c60c1c
Add ProjectFuture/TheBountyProject 2023-06-09 14:17:10 +02:00
Techwolf bbaa6bda0c
Add MangaDex/GijiHarem 2023-06-09 14:17:10 +02:00
Techwolf d72df1c5af
Add Inverloch 2023-06-09 14:17:09 +02:00
Tobias Gruetzmacher 35c48766d7
Modernize importlib.resources usage (#270) 
See https://importlib-resources.readthedocs.io/en/latest/using.html#migrating-from-legacy
 2023-06-03 17:51:16 +02:00
Typhonragewind 65f3c8be3c
Add AwkwardZombie (#267) 
Co-authored-by: Tobias Gruetzmacher <tobias-git@23.gs>
 2023-06-01 23:59:11 +02:00
enzomtp c5f87dee83
Add two ComicFury comics (#263) 
* Added PMD: On Borrowed Time
* Added Yet Another PMD Comic

---------

Co-authored-by: Tobias Gruetzmacher <tobias-git@23.gs>
 2023-05-16 10:30:28 +02:00
MrHappy fb9c5f4246
Update LeastICouldDo (fixes #257) (#259) 
Fixed imageSearch

---------

Co-authored-by: Tobias Gruetzmacher <tobias-git@23.gs>
 2023-04-10 21:30:35 +02:00
MrHappy 4c0d6f51a9
Update LookingForGroup (fixes #254) (#258) 
fixed imageSearch

---------

Co-authored-by: Tobias Gruetzmacher <tobias-git@23.gs>
 2023-04-10 21:30:05 +02:00
Jakob (Jack/XDjackieXD) b36bdad51a Add AcesWild (Webtoons) 2023-04-08 15:30:18 +02:00
Tobias Gruetzmacher 1c99de91ae
Fix LookingForGroup 2022-12-27 23:10:34 +01:00
Tobias Gruetzmacher abe15dbffb
Fix LeastICouldDo (fixes ##253) 2022-12-27 23:06:27 +01:00
Tobias Gruetzmacher 9dbde1bdba
Update flake8 & plugins (#251) 
Additionally, this adds some hackery to let flake8 read its config from
pyproject.toml.
 2022-12-11 20:15:09 +01:00
Tobias Gruetzmacher 94aa153b0e
Minor style cleanup in Shivae Studios modules 2022-12-06 01:01:09 +01:00
erpbridge 99ffb200fa
Update for PVP Online (#249, fixes #247) 
* New Domain

Co-authored-by: Tobias Gruetzmacher <tobias-git@23.gs>
 2022-12-06 00:40:29 +01:00
Tobias Gruetzmacher bdae76d12d
Move Exiern to ComicFury 
Fixes #244
 2022-11-26 17:45:23 +01:00
erpbridge 473d551be6
(Re-)Add ControlAltDelete (aka cad-comic) (#245) 
This was removed in 2016 (commit 13a3409), because it was blocking Dosage.

Co-authored-by: Tobias Gruetzmacher <tobias-git@23.gs>
 2022-11-26 16:51:49 +01:00
erpbridge b37a0ddc68
Sluggy Freelance - Changing from HTTP to HTTPS (#246) 2022-11-26 16:47:55 +01:00
Willem Victor fafc407d0c Added BeachWZRD 2022-11-16 20:37:16 +02:00
Tobias Gruetzmacher f00696813c Remove old location for Widdershins 2022-06-06 16:48:39 +02:00
Mark King 1a01806f49
Support Widdershins as it no longer updates GoComics (#225) 
[Widdershins stopped updating on GoComics in December 2020](https://www.gocomics.com/widdershins/2020/12/08).
However, the comic has been [regularly updated since](https://www.widdershinscomic.com/wdshn/may-20th-2022)
on the main comic site. This commit adds a plugin for the main site.
I've verified that it can scrape all comics, including recent ones not
on GoComics.
 2022-06-06 16:46:14 +02:00
Tobias Gruetzmacher bbc21c1050 Fix Wondermark 2022-06-06 16:22:31 +02:00
Tobias Gruetzmacher bd73584ba9 Fix ToonHole 2022-06-06 16:12:53 +02:00
Tobias Gruetzmacher c2c1355426 Fix TheGamerCat 2022-06-06 15:33:25 +02:00
Tobias Gruetzmacher 19865eddf7 Fix StickyDillyBuns 2022-06-06 15:09:58 +02:00
Tobias Gruetzmacher 3030355da1 Add Wolfpac 2022-06-06 15:00:56 +02:00
Tobias Gruetzmacher 1d632904e4 Fix SinFest with an ugly hack 2022-06-06 14:52:40 +02:00
Tobias Gruetzmacher e5c505e643 Fix SailorsunOrg 2022-06-06 14:12:37 +02:00
Tobias Gruetzmacher 67d1ee281b Ignore "usemap" attribute on images 2022-06-06 14:11:07 +02:00
Tobias Gruetzmacher aca51b3a8e Fix LoadingArtist 2022-06-06 13:34:27 +02:00
Tobias Gruetzmacher 334640515e Fix SnafuComics 2022-06-06 13:07:48 +02:00
Tobias Gruetzmacher 8e1e398a8d Deprecate underscore-prefixed parent classes 
This is trying to strike a balance between updating as much existing
classes as possible, but not making the diff too big...
 2022-06-06 12:08:32 +02:00
Tobias Gruetzmacher a640580826 Fix list of old comics 2022-06-06 08:37:29 +02:00
Tobias Gruetzmacher 398d03c44c Add some more comics to the Tapas module 2022-06-06 02:31:08 +02:00
Tobias Gruetzmacher f1e29703bc Print a warning if a Tapas page needs a login 2022-06-06 02:27:22 +02:00
Tobias Gruetzmacher 1d9b74bd66 Rename Tapastic to Tapas 
The site is know just as "Tapas" since longer then Dosage has support
for it. Since the module was merged just recently, this rename shouldn't
affect many users...
 2022-06-06 01:54:22 +02:00
Tobias Gruetzmacher fb4788414b Add some WebToons comics 2022-06-06 01:45:30 +02:00
Tobias Gruetzmacher 62bcc5212e Remove webtoons auto-updater for now 2022-06-06 00:52:33 +02:00
Tobias Gruetzmacher ce16537ce6 Search for spanish comics on ComicsKingdom (fixes #165) 2022-06-06 00:20:12 +02:00
Tobias Gruetzmacher 0d8e1b4a6f Fix basepath prefix removal 
This was a funny bug that has existed for 9 years. It only manifests if
a scraper name starts with the configured basepath... Since the default
basepath is `Comics`, this might manifest if the user wants to fetch
something like `ComicsKingdom/Tiger`. Internally, dosage was removing
the prefix matching the basepath, so we end up with `Kingdom/Tiger`.
This won't cause any problems as long as this substring is still unique
for all supported comics, but if this now matches multiple comics, an
error is thrown...
 2022-06-05 23:55:18 +02:00
Tobias Gruetzmacher 0d8871b253 Update GoComics module 2022-06-05 20:23:56 +02:00
Tobias Gruetzmacher 02bcd6b741 Fix classic CatNine 2022-06-05 18:31:55 +02:00
Tobias Gruetzmacher 095bcf4334 Fix ComicFury modules 
Unfortunatly, many just vanished...
 2022-06-04 11:30:48 +02:00
Tobias Gruetzmacher c467de05e3 Restore standalone DeerMe 
They seem to have moved back from ComicFury to their own hosting...
 2022-06-04 11:12:55 +02:00
Tobias Gruetzmacher 99b72c90be Remove unused multi-match logic 2022-06-04 10:56:25 +02:00
Tobias Gruetzmacher da30ce29bb Add C-Section Comics (fixes #223) 2022-06-03 22:28:21 +02:00
Tobias Gruetzmacher 70beb37fa9 Fix DasLebenIstKeinPonyhof (end of life) 2022-05-31 08:40:49 +02:00
Tobias Gruetzmacher 62ce301ce9 Switch from appdirs to platformdirs 
Additionally, this removes our hack to support XDG directories on
anything but UNIXy platforms. It was pretty brittle to begin with and
probably won't work on Windows at all with platformdirs...
 2022-05-30 01:04:10 +02:00
Tobias Gruetzmacher 4a597ff48f PyInstaller: Make sure dosagelib.data is importable 2022-05-29 00:24:43 +02:00
Tobias Gruetzmacher 839deb03e8 Avoid duplicates when finding plugin modules 
Since PyInstaller added support for iter_modules in release 4.4, our
previous hack just duplicates all modules. If this works as intended, we
can remove our hack in the future.
 2022-05-28 21:05:12 +02:00
Tobias Gruetzmacher 5550217c02 PyInstaller: Make sure data files are included 2022-05-28 20:59:47 +02:00
Tobias Gruetzmacher 9b95171f37 Add some basic type annotations 2022-05-28 19:33:16 +02:00
Tobias Gruetzmacher f3b8ebf0be Clean up some minor warnings 2022-05-28 17:52:42 +02:00
Tobias Gruetzmacher 805befe40c Fix PandyLand using archive.org 2022-05-28 15:46:52 +02:00
Tobias Gruetzmacher ca2c0cd6ed Fix PennyArcade (fixes #213) 
Unfortunatly, images are now split into panels, so some re-assembly
might be required...
 2022-05-27 20:36:02 +02:00
Tobias Gruetzmacher 173568f6a4 Fix Magellan (fixes #216) 2022-05-27 19:38:31 +02:00
Tobias Gruetzmacher 7eb1bf6ff5 Fix MenageA3 (fixes #217) 2022-05-27 19:30:27 +02:00