Commit graph

178 commits

Author SHA1 Message Date
Tobias Gruetzmacher
820471b49b Move exclusion into 2nd stage. 2016-04-17 18:15:30 +02:00
Tobias Gruetzmacher
73e958670d Update ComicFury (again). 2016-04-17 16:19:44 +02:00
Tobias Gruetzmacher
b0481a01f7 Update languages. 2016-04-16 13:14:12 +02:00
Tobias Gruetzmacher
3329027e4b Update ComicFury. 2016-04-16 13:13:47 +02:00
Tobias Gruetzmacher
52515b5fc5 Update GoComics. 2016-04-15 00:26:14 +02:00
Tobias Gruetzmacher
dab5aef094 Refactor update helpers: Remove duplicate code. 2016-04-14 22:22:37 +02:00
Tobias Gruetzmacher
497653c448 Remove make_scraper magic from Arcamax. 2016-04-14 00:17:59 +02:00
Tobias Gruetzmacher
16004e43e4 Use default bounceStarter for site modules. 2016-04-13 01:24:13 +02:00
Tobias Gruetzmacher
9028724a74 Clean up update helper scripts. 2016-04-13 00:52:16 +02:00
Tobias Gruetzmacher
443ab119e9 Refresh GoComics list from online directory. 2016-04-12 00:36:33 +02:00
Tobias Gruetzmacher
0033a8046b Fix creators module. 2016-04-07 00:20:03 +02:00
Tobias Gruetzmacher
926439cd14 Every comic need an url. 2016-04-03 22:03:16 +02:00
Tobias Gruetzmacher
2c6decb7f5 Move WebcomicFactory in its own module.
Also, add an updater script for it.
2016-04-03 21:31:56 +02:00
Tobias Gruetzmacher
a7b6599cd4 Sort ComicFury comics ignoring case. 2016-03-31 23:26:56 +02:00
Tobias Gruetzmacher
cfac0f40f1 Encode JSON cache as UTF-8. 2016-03-31 23:25:53 +02:00
Tobias Gruetzmacher
2f61ecb721 Add build helper for PyInstaller (fixes #22). 2016-03-20 21:42:41 +01:00
Tobias Gruetzmacher
3c4b3fdfc3 Remove more old stuff. 2016-03-20 18:59:42 +01:00
Tobias Gruetzmacher
065184f1db Remove unused helper scripts. 2016-03-20 12:06:58 +01:00
Tobias Gruetzmacher
552f29e5fc Update ComicFury comics. (+871, -245)
- Remove make_scraper magic
- Switch to HTML parser
- Update parsing of comic listing.
2016-03-17 00:44:06 +01:00
Tobias Gruetzmacher
8c4b2aad65 Clean up scriptutil.py.
Having comic module names with more then 50 characters is quite
ridiculous.
2016-03-03 23:49:21 +01:00
Tobias Gruetzmacher
7f7a69818b Remove make_scraper magic from creators module. 2015-11-04 23:43:31 +01:00
Tobias Gruetzmacher
808b624e5f Remove hard dependency on pycountry again.
This basically reverts commit 86b31dc12b.

It now works like this: If the use has pycountry installed, it is used.
If not, Dosage falls back to a small internal list generated from
pycountry by scripts/mklanguages.py.

This means additional work if we ever decide to translate Dosage, since
pycountry already has all the translations for language names...

This fixes #23.
2015-07-11 01:27:39 +02:00
Tobias Gruetzmacher
bf9f45b380 Switch to setuptools and cleanup metadata.
py2exe support is gone for now, will be restored later.
2015-04-22 22:22:03 +02:00
Tobias Gruetzmacher
86b31dc12b Depend on pycountry directly. 2015-04-21 21:56:54 +02:00
Tobias Gruetzmacher
78414cb3d7 Switch from PIL to Pillow, remove workarounds. 2015-04-20 22:46:12 +02:00
Tobias Gruetzmacher
ff21df596b Remove descriptions and genres (closes #9).
Maintaining the descriptions creates quite a bit of overhead (finding
them, copying them, checking if they are still correct) for a minimal
user benefit.

PS: Viewing this diff should be easier in a difftool that shows changes
in a line, for example kdiff3.
2015-04-20 20:29:09 +02:00
Tobias Gruetzmacher
64ad5468b9 Fix update scripts after htmlparser merge. 2015-04-20 19:42:12 +02:00
Tobias Gruetzmacher
e8af5adcb8 Update list of supported GoComics comics. 2015-04-18 02:04:31 +02:00
Tobias Gruetzmacher
50af6c23f5 Remove JSON cache files from repository. 2015-04-18 02:03:46 +02:00
Tobias Gruetzmacher
f0831a1f0f Fix and update ArcaMax (fixes #8). 2015-04-17 21:53:13 +02:00
Bastian Kleineidam
641daa738b Updated list of comics 2014-07-03 17:12:25 +02:00
Bastian Kleineidam
b67717d66e Fix pil install 2014-02-10 22:43:28 +01:00
Bastian Kleineidam
fa0b556869 Fix pil install 2014-02-10 22:31:51 +01:00
Bastian Kleineidam
c7108a9342 Fix pil install 2014-02-10 22:27:01 +01:00
Bastian Kleineidam
4d63920434 Updated copyright. 2014-01-05 16:50:57 +01:00
Bastian Kleineidam
163ac2f534 Add signing certs for windows installer. 2013-12-12 23:29:42 +01:00
Bastian Kleineidam
06306f5b7e Fix travis builds for PIL. 2013-12-10 08:48:32 +01:00
Bastian Kleineidam
48e417c647 Fixed some comics. 2013-11-18 22:01:30 +01:00
Bastian Kleineidam
7760985601 Fix broken comics 2013-11-12 18:33:14 +01:00
Bastian Kleineidam
3e6414e0e5 Updated plugins 2013-11-07 07:28:47 +01:00
Bastian Kleineidam
ef4ae435a5 Fix several comics. 2013-07-18 20:39:53 +02:00
Bastian Kleineidam
8d5ae7b1bb Updated plugins. 2013-07-09 22:21:12 +02:00
Bastian Kleineidam
8559184d69 Updated plugins 2013-07-04 12:22:36 +02:00
Bastian Kleineidam
1c1b0aaf18 Comic fixes. 2013-05-25 23:24:33 +02:00
Bastian Kleineidam
23e6a8923d Improve plugin update. 2013-05-22 22:29:03 +02:00
Bastian Kleineidam
ef878eed7c Updated plugins. 2013-05-22 07:19:16 +02:00
Bastian Kleineidam
63f2ea4758 Add script to create CZB files. 2013-05-01 08:33:04 +02:00
Bastian Kleineidam
d9cd8f3fd6 Ensure a unicode description for keenspot comics. 2013-04-29 20:24:54 +02:00
Bastian Kleineidam
dcacbf0b9a Fix some comics. 2013-04-28 19:58:38 +02:00
Bastian Kleineidam
f2be5e4d73 Updated JSON. 2013-04-26 23:58:03 +02:00
Bastian Kleineidam
871de6a8ce Prefer GoComics over Creators since they have a better naming scheme. 2013-04-25 21:50:45 +02:00
Bastian Kleineidam
e37a80fdc1 Add some descriptions. 2013-04-14 09:02:14 +02:00
Bastian Kleineidam
35c031ca81 Fixed some comics. 2013-04-11 18:27:43 +02:00
Bastian Kleineidam
44c3fb9f16 Remove broken scripted plugins. 2013-04-04 18:30:02 +02:00
Bastian Kleineidam
1fd285af01 Fix failed test script. 2013-04-03 21:20:50 +02:00
Bastian Kleineidam
6303a1cb20 Updated scripted plugins. 2013-04-03 20:27:12 +02:00
Bastian Kleineidam
a2f343226f Remove duplicate dilbert. 2013-03-26 20:02:13 +01:00
Bastian Kleineidam
b25e9e68ec Updated exclusions. 2013-03-26 17:33:15 +01:00
Bastian Kleineidam
9d1f286424 Improved documentation. 2013-03-25 19:47:29 +01:00
Bastian Kleineidam
c99827935b Updated plugins with scripts. 2013-03-25 19:40:38 +01:00
Tobias Gruetzmacher
1314da3ffb Add a script that uses the JSON metadata to create ordered symlinks. 2013-03-24 17:17:38 +01:00
Bastian Kleineidam
d47670231a Add some documentation. 2013-03-13 18:31:50 +01:00
Bastian Kleineidam
e207c8ee47 Improved logging. 2013-03-12 20:47:11 +01:00
Bastian Kleineidam
d1f0f23b4c Check robots.txt, update excluded comic names. 2013-03-12 20:46:57 +01:00
Bastian Kleineidam
681ff68132 Check robots.txt, update excluded comic names. 2013-03-12 20:46:48 +01:00
Bastian Kleineidam
538523f86c Add keenspot. 2013-03-11 22:03:17 +01:00
Bastian Kleineidam
a16bf6c16b Rename keenspot to comicgenesis and enable it. 2013-03-11 21:50:49 +01:00
Bastian Kleineidam
88e28f3923 Fix some comics and add language tag. 2013-03-08 22:33:05 +01:00
Bastian Kleineidam
1cc7d39047 Fix some comics. 2013-03-07 23:08:17 +01:00
Bastian Kleineidam
0215ae82af Fix some comics. 2013-03-07 19:54:18 +01:00
Bastian Kleineidam
23c20bfe32 Fix some comics. 2013-03-07 18:22:24 +01:00
Bastian Kleineidam
bae2a96d8b Added some comic strips and cleanup the scraper code. 2013-03-06 20:00:30 +01:00
Bastian Kleineidam
01177e25f0 Updated generated comic lists. 2013-03-05 19:06:00 +01:00
Bastian Kleineidam
fba7f6e527 Updated comic plugins. 2013-03-01 20:55:55 +01:00
Bastian Kleineidam
254af3c351 Add help entry and set PATH in windows installer. 2013-02-28 21:18:50 +01:00
Bastian Kleineidam
09df20cd1f Fix some comics and increase travis test number. 2013-02-26 06:12:46 +01:00
Bastian Kleineidam
953dc62ffd Fix some comics. 2013-02-23 09:07:44 +01:00
Bastian Kleineidam
2eb7b43dd2 Remove drunkduck awards. 2013-02-21 19:51:10 +01:00
Bastian Kleineidam
725001155a Updated generated comics. 2013-02-20 20:52:23 +01:00
Bastian Kleineidam
91c32515d5 Fix some comics. 2013-02-19 20:58:04 +01:00
Bastian Kleineidam
27a125e5b5 Move test page generation. 2013-02-19 20:25:59 +01:00
Bastian Kleineidam
4f03963b9e Code cleanup. 2013-02-18 20:02:16 +01:00
Bastian Kleineidam
aee2b2de46 Updated travis and test json 2013-02-15 06:50:12 +01:00
Bastian Kleineidam
591df0f814 Updated comic pages and comicfury generator. 2013-02-14 21:28:53 +01:00
Bastian Kleineidam
8a33871df8 Fix some comicfury stuff. 2013-02-13 22:17:39 +01:00
Bastian Kleineidam
2062618f49 Re-add generated json files. 2013-02-13 20:03:17 +01:00
Bastian Kleineidam
d6118c1cbf Add some scriptsutil functions. 2013-02-13 20:02:47 +01:00
Bastian Kleineidam
b0526243bb Add genre to index pages. 2013-02-13 20:02:05 +01:00
Bastian Kleineidam
d3727a3d4e Rename get_scrapers to get_scraperclasses 2013-02-13 20:01:43 +01:00
Bastian Kleineidam
6e0ffa0619 Allow selective update. 2013-02-13 20:00:44 +01:00
Bastian Kleineidam
312d117ff3 Rename get_scrapers to get_scraperclasses 2013-02-13 19:59:13 +01:00
Bastian Kleineidam
6ba226d2e2 Added comicfury comics. 2013-02-13 17:53:36 +01:00
Bastian Kleineidam
7a98cf7599 Updated copyright. 2013-02-13 06:28:35 +01:00
Bastian Kleineidam
ba9ece047d Fix scripts 2013-02-12 21:53:57 +01:00
Bastian Kleineidam
9ec4a44953 Remove universal strips since they are almost all duplicated and the rest is useless. 2013-02-12 20:56:02 +01:00
Bastian Kleineidam
d365b565cd Do not add PlusOne buttons in index page. 2013-02-12 17:55:13 +01:00
Bastian Kleineidam
d3bf550b6f Fix homepage generation. 2013-02-11 19:11:41 +01:00
Bastian Kleineidam
9fa9af639b Remove duplicate comic. 2013-02-10 18:24:21 +01:00
Bastian Kleineidam
1451047877 Rename latestUrl in url 2013-02-05 19:51:46 +01:00
Bastian Kleineidam
7f78bea1af Always have an url attribute in comic scrapers. 2013-02-04 21:00:26 +01:00