dmoonfire/dosage
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Activity
1672 commits 1 branch 0 tags 31 MiB
Commit graph

1066 commits

Author SHA1 Message Date
mbrandis
ccf50cad89 Corrected description. 2013-06-24 22:46:39 +02:00
Bastian Kleineidam
da957ce329 Updated linuxcom 2013-06-24 20:27:43 +02:00
Bastian Kleineidam
36b8dcea04 Merge branch 'patch-2' of https://github.com/mbrandis/dosage into mbrandis-patch-2 2013-06-24 20:23:10 +02:00
Bastian Kleineidam
6bd534eaed Fix OnTheFasttrack 2013-06-24 20:19:33 +02:00
mbrandis
3b0393ccf6 Update s.py 
Added Sherman's Lagoon, namer is not perfect.
 2013-06-23 23:30:57 +03:00
mbrandis
265c03fc82 Update l.py 
Added Linux.com Friday Funnies.
 2013-06-23 22:28:08 +02:00
mbrandis
ef5ac2128b Update o.py 
Please consider adding this comic.
 2013-06-23 22:26:32 +02:00
Bastian Kleineidam
1c1b0aaf18 Comic fixes. 2013-05-25 23:24:33 +02:00
Bastian Kleineidam
66dccef537 Fix keenspot description type. 2013-05-22 22:29:20 +02:00
Bastian Kleineidam
ef878eed7c Updated plugins. 2013-05-22 07:19:16 +02:00
Bastian Kleineidam
b41fdf99ae Fix LookingForGroup. 2013-05-21 18:48:03 +02:00
Bastian Kleineidam
1478f22099 Output fixes. 2013-04-30 20:26:36 +02:00
Bastian Kleineidam
5f6ed7e05d More output stuff. 2013-04-30 07:24:54 +02:00
Bastian Kleineidam
1a6416eb1b Updated wormworld chapter. 2013-04-30 06:42:49 +02:00
Bastian Kleineidam
ebdc1e6359 More unicode output fixes. 2013-04-30 06:41:19 +02:00
Bastian Kleineidam
d6ca5aa7fd SnowFlakes is end-of-life. 2013-04-29 20:31:07 +02:00
Bastian Kleineidam
cec08b86dd DrFun is end-of-life. 2013-04-29 20:29:56 +02:00
Bastian Kleineidam
79273deb23 Correct output encoding. 2013-04-29 20:25:05 +02:00
Bastian Kleineidam
80d7defcd2 Unicode descriptions. 2013-04-29 07:35:56 +02:00
Bastian Kleineidam
459156fc1a Description must be unicode. 2013-04-29 07:27:59 +02:00
Bastian Kleineidam
64bf618b87 xkcd 2013-04-29 07:19:58 +02:00
Bastian Kleineidam
dcacbf0b9a Fix some comics. 2013-04-28 19:58:38 +02:00
Bastian Kleineidam
f9a48e6cb9 Updated scripted comic plugins. 2013-04-27 07:47:17 +02:00
Bastian Kleineidam
8783b53012 Fix GirlGenious strip url. 2013-04-26 19:52:45 +02:00
Bastian Kleineidam
cafa37fcb1 All scrapers must have an URL. 2013-04-26 06:53:05 +02:00
Bastian Kleineidam
05dbc51d3e Detect completed end-of-life comics. 2013-04-25 22:40:06 +02:00
Bastian Kleineidam
871de6a8ce Prefer GoComics over Creators since they have a better naming scheme. 2013-04-25 21:50:45 +02:00
Bastian Kleineidam
4716ecd71d Carciphona description. 2013-04-25 21:50:27 +02:00
Bastian Kleineidam
ba6e0c09a4 Added Unsound. 2013-04-25 21:38:18 +02:00
Bastian Kleineidam
725824f067 Added TwoGuysAndGuy 2013-04-25 21:23:31 +02:00
Bastian Kleineidam
382c4c05ad Added TheDreamlandChronicles 2013-04-25 21:20:48 +02:00
Bastian Kleineidam
8418ea471d Added SabrinaOnline. 2013-04-25 21:14:32 +02:00
Bastian Kleineidam
3e74dc9956 Fix MadamAndEve. 2013-04-25 21:09:42 +02:00
Bastian Kleineidam
c95a447305 Updated docs. 2013-04-25 21:06:20 +02:00
Bastian Kleineidam
6c773e21c7 Added Lackadaisy. 2013-04-25 21:06:12 +02:00
Bastian Kleineidam
1ae674782d Added GirlGenius 2013-04-25 20:58:24 +02:00
Bastian Kleineidam
96fc129fea Add GeneralProtectionFault (disallowed by robots.txt) 2013-04-25 20:54:48 +02:00
Bastian Kleineidam
f20df8b692 Added Curtailed. 2013-04-25 20:46:05 +02:00
Bastian Kleineidam
c114a834dd Added Carciphona 2013-04-25 20:40:15 +02:00
Bastian Kleineidam
51d84131eb Added ARedTailsDream 2013-04-25 20:37:27 +02:00
Bastian Kleineidam
dbdbdd09de Fix SMBC 2013-04-25 20:32:21 +02:00
Bastian Kleineidam
52ee7228ef Fix DorkTower image regex. 2013-04-25 19:01:38 +02:00
Bastian Kleineidam
aca3c959af Improve CtrlAltDel image names. 2013-04-25 19:01:21 +02:00
wummel
1c29f22270 Merge pull request #27 from dromaludaire/master 
Fix some SMBC download links
 2013-04-22 10:40:24 -07:00
Benjamin Sigonneau
f1da47edef [SMBC] Fix regexp, mainly concerns older strips 2013-04-21 22:39:06 +02:00
Sven Hartge
8e34239b27 Fix typo in regex for SandraOnTheRocks. 2013-04-20 19:59:01 +02:00
Sven Hartge
40f2aed8f0 Add Sandra on the Rocks. 2013-04-20 18:51:06 +02:00
Bastian Kleineidam
4988e79e6e Added some descriptions. 2013-04-19 06:31:12 +02:00
Bastian Kleineidam
e37a80fdc1 Add some descriptions. 2013-04-14 09:02:14 +02:00
Bastian Kleineidam
f15f993851 s/baseurl/baseUrl/g 2013-04-13 20:58:00 +02:00
Bastian Kleineidam
c246b41d64 Code formatting. 2013-04-13 08:00:11 +02:00
Bastian Kleineidam
522af89af5 Add some descriptions. 2013-04-13 08:00:03 +02:00
Bastian Kleineidam
3a03554d26 Ensure unicode output to fix encoding errors. 2013-04-12 21:02:31 +02:00
Bastian Kleineidam
35c031ca81 Fixed some comics. 2013-04-11 18:27:43 +02:00
Bastian Kleineidam
6ca4eaa492 Code cleanup. 2013-04-11 18:27:43 +02:00
Bastian Kleineidam
7e593cf7e8 Add firstStripUrls. 2013-04-10 23:57:09 +02:00
Bastian Kleineidam
a0c7f54871 Fix zwarwald 2013-04-10 20:14:43 +02:00
Bastian Kleineidam
fb05c10808 Sort entries. 2013-04-10 18:36:33 +02:00
Bastian Kleineidam
54283775a8 Add ForLackOfABetterComic 2013-04-10 18:20:39 +02:00
Bastian Kleineidam
d00310f017 Add EverydayBlues 2013-04-10 18:20:08 +02:00
Bastian Kleineidam
8b99b59056 Added DamnLol 2013-04-10 18:19:38 +02:00
Bastian Kleineidam
5127d4c895 Use re.escape and add some firstStripUrl. 2013-04-10 18:19:11 +02:00
Bastian Kleineidam
3213eebd75 Added ZenPencils. 2013-04-09 19:38:47 +02:00
Bastian Kleineidam
e040dd0d50 Added Science. 2013-04-09 19:38:16 +02:00
Bastian Kleineidam
68f14971e8 Added RealmOfAtland. 2013-04-09 19:37:47 +02:00
Bastian Kleineidam
f9179e9de5 Added GoblinsComic 2013-04-09 19:37:24 +02:00
Bastian Kleineidam
f71961acbc Added ExtraOrdinary. 2013-04-09 19:36:51 +02:00
Bastian Kleineidam
190ffcd390 Use str() for robotparser. 2013-04-09 19:36:00 +02:00
Bastian Kleineidam
b9dc385ff2 Implemented voting 2013-04-09 19:33:50 +02:00
Bastian Kleineidam
4528281ddd Voting part 2 2013-04-08 21:20:01 +02:00
Bastian Kleineidam
e762f269b7 First part of voting stuff. 2013-04-08 20:19:10 +02:00
Bastian Kleineidam
7584f0b647 Add version update check. 2013-04-08 20:17:02 +02:00
Bastian Kleineidam
781bac0ca2 Feed text content instead of binary to robots.txt parser. 2013-04-07 18:11:29 +02:00
Bastian Kleineidam
bd1d41b83c Write encoded data in binary format. 2013-04-05 19:27:30 +02:00
Bastian Kleineidam
0fbc005377 A Python3 fix. 2013-04-05 18:57:44 +02:00
Bastian Kleineidam
97522bc5ae Use tuples rather than lists. 2013-04-05 18:55:19 +02:00
Bastian Kleineidam
adb31d84af Use HTMLParser.unescape instead of rolling our own function. 2013-04-05 18:53:19 +02:00
Bastian Kleineidam
1c9f64bc27 Better name for Sketchesnatched. 2013-04-05 18:47:51 +02:00
Bastian Kleineidam
9e26640407 Augment SketcheSnatched 2013-04-05 07:31:22 +02:00
Bastian Kleineidam
50b742721b SketcheSnatched 2013-04-05 07:20:50 +02:00
Bastian Kleineidam
3936cfa9ce Another fix. 2013-04-05 06:56:33 +02:00
Bastian Kleineidam
6aa588860d Code cleanup 2013-04-05 06:36:05 +02:00
Bastian Kleineidam
fabe872d1d Fix SnowFlame 2013-04-04 18:32:37 +02:00
Bastian Kleineidam
8150dabfa6 Remove SarahZero 2013-04-04 18:32:29 +02:00
Bastian Kleineidam
5d6e210c98 Fix Curvy 2013-04-04 18:30:27 +02:00
Bastian Kleineidam
b3cbad37bc Remove CaribbeanBlue 2013-04-04 18:30:16 +02:00
Bastian Kleineidam
80c24a10c0 Fix WebDesignerCOTW 2013-04-04 18:30:02 +02:00
Bastian Kleineidam
62af4b875e Fix Precocious 2013-04-04 18:30:02 +02:00
Bastian Kleineidam
421e31c961 Fix Oglaf 2013-04-04 18:30:02 +02:00
Bastian Kleineidam
d794919e73 Fix LasLindas 2013-04-04 18:30:02 +02:00
Bastian Kleineidam
08a3587df6 Fix KatzenfutterGeleespritzer 2013-04-04 18:30:02 +02:00
Bastian Kleineidam
c57226f1c0 Remove GreystoneInn 2013-04-04 18:30:02 +02:00
Bastian Kleineidam
3078c5ec73 Fix ExtraLife and EyeOfRamalach 2013-04-04 18:30:02 +02:00
Bastian Kleineidam
3fd4cfea0d Fix DasLebenIstKeinPonyhof 2013-04-04 18:30:02 +02:00
Bastian Kleineidam
460c5be689 Add POST support to urlopen(). 2013-04-04 18:30:02 +02:00
Bastian Kleineidam
44c3fb9f16 Remove broken scripted plugins. 2013-04-04 18:30:02 +02:00
Bastian Kleineidam
0054ebfe0b Some Python3 fixes. 2013-04-03 20:32:43 +02:00
Bastian Kleineidam
2c0ca04882 Fix warning for scrapers with multiple image patterns. 2013-04-03 20:32:19 +02:00
Bastian Kleineidam
f53a516219 Use output logging instead of print statement. 2013-04-03 20:31:10 +02:00
Bastian Kleineidam
a972729c0d Add WebDesignerCOTW 2013-04-03 20:30:51 +02:00
Bastian Kleineidam
fdab3b7b35 Add StuffNoOneToldMe 2013-04-03 20:30:29 +02:00
Bastian Kleineidam
43255872c3 Added SnowFlakes. 2013-04-03 20:30:16 +02:00
Bastian Kleineidam
6303a1cb20 Updated scripted plugins. 2013-04-03 20:27:12 +02:00
Bastian Kleineidam
f737486754 Fix hagar. 2013-03-26 20:12:26 +01:00
Bastian Kleineidam
a2f343226f Remove duplicate dilbert. 2013-03-26 20:02:13 +01:00
Bastian Kleineidam
1d7f7a8517 Fix genre list 2013-03-26 19:58:22 +01:00
Bastian Kleineidam
141d5113de Fix hagarthehorrible 2013-03-26 19:54:00 +01:00
Bastian Kleineidam
b62f1ba69d Code cleanup. 2013-03-26 17:36:06 +01:00
Bastian Kleineidam
31d95d1d03 Remove DerFlix 2013-03-26 17:35:58 +01:00
Bastian Kleineidam
3dd2daf223 Updated scripted plugins. 2013-03-26 17:35:47 +01:00
Bastian Kleineidam
92150ddbda Add HagarTheHorrible 2013-03-26 17:35:10 +01:00
Bastian Kleineidam
75f3d59e85 Fix Eriadan 2013-03-26 17:34:56 +01:00
Bastian Kleineidam
de3ce2ec95 Fix WormWorldSaga* 2013-03-26 17:34:27 +01:00
Bastian Kleineidam
a3d74c5a0e Fix BratHalla and BrentalFloss 2013-03-26 17:33:51 +01:00
Bastian Kleineidam
10985ae614 Add genre tags. 2013-03-26 17:33:27 +01:00
Bastian Kleineidam
fcdc67ef92 Fix documentation. 2013-03-26 17:29:20 +01:00
Bastian Kleineidam
110a67cda4 Retry failed page content downloads (eg. timeouts). 2013-03-25 19:49:09 +01:00
Bastian Kleineidam
ec33276fd7 Print stacktrace on image errors. 2013-03-25 19:48:47 +01:00
Bastian Kleineidam
1a7dfc02d2 Add Schuelert 2013-03-25 19:48:32 +01:00
Bastian Kleineidam
af10385da1 Add firstStripUrl for KevinAndKell. 2013-03-25 19:48:19 +01:00
Bastian Kleineidam
940a04b499 Fix comic searching. 2013-03-25 19:48:01 +01:00
Bastian Kleineidam
bafe981917 Add DrMcNinja. 2013-03-25 19:47:44 +01:00
Bastian Kleineidam
9d1f286424 Improved documentation. 2013-03-25 19:47:29 +01:00
Bastian Kleineidam
c99827935b Updated plugins with scripts. 2013-03-25 19:40:38 +01:00
Bastian Kleineidam
01c2afc264 Print exception tracebacks. 2013-03-25 19:39:37 +01:00
Tobias Gruetzmacher
a1b5bfb68f Add a simple event consumer to write JSON metadata. 
This drops a file named dosage.json in each comic directory. This is
still not perfect, but something to build upon.
 2013-03-24 16:55:30 +01:00
Tobias Gruetzmacher
0a218c0283 Add event comicPageLink for every previous link. 
This event allows a listener to build connections between pages.
 2013-03-24 16:36:02 +01:00
Bastian Kleineidam
9f08b21a7e Get correct images of gocomic strips. 2013-03-24 14:13:33 +01:00
Bastian Kleineidam
179ba7f49f Add release info. 2013-03-21 19:04:59 +01:00
Bastian Kleineidam
2b98cf0079 CucumberQuest fixes. 2013-03-21 18:38:40 +01:00
Bastian Kleineidam
3f6df92fef Added some comics, fixed some. 2013-03-21 18:33:16 +01:00
Bastian Kleineidam
448e80eaed Added MyCartoons 2013-03-20 21:42:04 +01:00
Bastian Kleineidam
2e3907d942 Add Katzenfuttergeleespritzer and ParallelUniversum 2013-03-20 17:39:49 +01:00
Bastian Kleineidam
3937cfba4b Added SandraAndWooGerman 2013-03-19 20:54:16 +01:00
Bastian Kleineidam
78fb63859c Add DemolitionSquad. 2013-03-19 20:45:59 +01:00
Bastian Kleineidam
17fe58b864 Fix some comics. 2013-03-19 20:45:18 +01:00
Bastian Kleineidam
178d8f80b2 Fix Dilbert image naming. 2013-03-18 18:15:19 +01:00
Bastian Kleineidam
88224fe21a Add DogHouseDiaries, update changelog. 2013-03-15 07:04:19 +01:00
Bastian Kleineidam
6a2f55ddef Dont stop on image regex errors. 2013-03-15 07:03:54 +01:00
Bastian Kleineidam
e88cf514a7 Fixes for FonFlatter 2013-03-13 18:31:58 +01:00
Bastian Kleineidam
e739eb7992 Added CucumberQuest 2013-03-12 21:36:13 +01:00
Bastian Kleineidam
79f0f4b36c Added OrnerBoy 2013-03-12 21:23:26 +01:00
Bastian Kleineidam
502a35166f Added KickInTheHead 2013-03-12 21:16:17 +01:00
Bastian Kleineidam
7c4ac0df7b Add and fix some comics. 2013-03-12 20:49:46 +01:00
Bastian Kleineidam
43f20270d0 Allow a list of regular expressions for image and previous link search. 2013-03-12 20:48:26 +01:00
Bastian Kleineidam
6de26aeeaa Updated keenspot scraper and its comic list. 2013-03-12 20:47:52 +01:00
Bastian Kleineidam
2bf7d16090 Updated comicgenesis comic list. 2013-03-12 20:47:38 +01:00
Bastian Kleineidam
58abcb282d Added GeeksNextDoor. 2013-03-11 22:51:45 +01:00
Bastian Kleineidam
737f1e189d Added FullFrontalNerdity. 2013-03-11 22:45:30 +01:00
Bastian Kleineidam
538523f86c Add keenspot. 2013-03-11 22:03:17 +01:00
Bastian Kleineidam
a16bf6c16b Rename keenspot to comicgenesis and enable it. 2013-03-11 21:50:49 +01:00
Bastian Kleineidam
f0eaba0f69 Reenable comicgenesis comics. 2013-03-11 20:33:56 +01:00
Bastian Kleineidam
950a958e30 Updated for release. [ci skip] 2013-03-11 20:14:27 +01:00
Bastian Kleineidam
7eaf12caf6 Fix LookingForGroup 2013-03-11 19:56:37 +01:00
Bastian Kleineidam
7ee73caf3c Allow multiple event output and improve HTML output. 2013-03-11 17:33:59 +01:00
Bastian Kleineidam
75e576f2de Embed images in html output. 2013-03-09 21:39:43 +01:00
Bastian Kleineidam
8b0a523f77 Page comic listings. 2013-03-09 09:00:50 +01:00
Bastian Kleineidam
5ccf44c36a Embed images in html output. 2013-03-08 22:38:11 +01:00
Bastian Kleineidam
88e28f3923 Fix some comics and add language tag. 2013-03-08 22:33:05 +01:00
Bastian Kleineidam
b368f125bc Fix some comics. 2013-03-08 06:47:00 +01:00
Bastian Kleineidam
4c344765ff Add option to wait before downloading. 2013-03-08 06:46:50 +01:00
Bastian Kleineidam
0ee0822e00 Fix some comics. 2013-03-08 00:06:55 +01:00
Bastian Kleineidam
2bdf0d588d Simplify exception handling. 2013-03-08 00:06:50 +01:00
Bastian Kleineidam
1d7410c038 Added Zwarwald and AhoiPolloi 2013-03-07 23:51:55 +01:00
Bastian Kleineidam
8259a01d64 Fix URLs with no content type header. 2013-03-07 23:08:37 +01:00
Bastian Kleineidam
1cc7d39047 Fix some comics. 2013-03-07 23:08:17 +01:00
Bastian Kleineidam
0215ae82af Fix some comics. 2013-03-07 19:54:18 +01:00
Bastian Kleineidam
e96c68c378 Fix dorktower. 2013-03-07 18:24:12 +01:00
Bastian Kleineidam
7d8786c1d2 Code cleanup. 2013-03-07 18:22:49 +01:00
Bastian Kleineidam
736d9aa8cf Code cleanup. 2013-03-07 18:22:39 +01:00
Bastian Kleineidam
23c20bfe32 Fix some comics. 2013-03-07 18:22:24 +01:00
Bastian Kleineidam
d1e5ad2696 Set proper HTML5 doctype and encoding for HTML output. 2013-03-07 18:21:05 +01:00
Bastian Kleineidam
9f13af7750 Retry empty downloads and don't set a manual modification time. 2013-03-07 18:20:38 +01:00
Bastian Kleineidam
6f2aebe8c0 Updated copyright. 2013-03-07 18:19:50 +01:00
Bastian Kleineidam
106a15b6c3 Add missing attribute. 2013-03-06 20:23:43 +01:00
Bastian Kleineidam
10eb1ff5ec Fix dilbert filenames. 2013-03-06 20:21:20 +01:00
Bastian Kleineidam
d7925ba4a2 Sort comics. 2013-03-06 20:21:10 +01:00
Bastian Kleineidam
bae2a96d8b Added some comic strips and cleanup the scraper code. 2013-03-06 20:00:30 +01:00
Bastian Kleineidam
3a22c05050 Catch WindowsError when initializing colorama. 2013-03-05 21:15:25 +01:00
Bastian Kleineidam
01177e25f0 Updated generated comic lists. 2013-03-05 19:06:00 +01:00
Bastian Kleineidam
c13aa323d8 Code cleanup [ci skip] 2013-03-04 21:44:26 +01:00
Bastian Kleineidam
61a02630b8 Remove duplicate comic entries. 2013-03-04 19:40:10 +01:00
Bastian Kleineidam
4047859c5b Fix BrentalFlossFit 2013-03-04 19:37:26 +01:00
wummel
c0440266cf Merge pull request #12 from TobiX/some-new-comics 
Some new comics
 2013-03-04 10:13:51 -08:00
Bastian Kleineidam
3712799ee0 Add imageUrlModifier() for scrapers. 2013-03-04 19:10:27 +01:00
Bastian Kleineidam
44d696c4af Flush file contents to disk and check for empty files. 2013-03-04 19:10:26 +01:00
Bastian Kleineidam
60b160bcdf Prevent double slash in support url 2013-03-04 19:10:26 +01:00
Tobias Gruetzmacher
fc3fab8500 Add Namesake. 2013-03-03 22:41:11 +01:00
Tobias Gruetzmacher
bf13b13ab6 Add StickyDillyBuns. 
One of the Pixie Trix Comix.
 2013-03-03 22:03:27 +01:00
Tobias Gruetzmacher
1af8a99594 Added MenageA3 (ma3comics.com). 
One of the Pixie Trix Comix.
 2013-03-03 21:52:08 +01:00
Tobias Gruetzmacher
d668f5fc1e Add DangerouslyChloe. 
One of the Pixie Trix Comix.
 2013-03-03 21:31:44 +01:00
Tobias Gruetzmacher
4036ce06ef Add MagickChicks. 
One of the Pixie Trix Comix.
 2013-03-03 20:50:21 +01:00
Tobias Gruetzmacher
af57e018a1 Add ShadowGirls. 2013-03-03 18:59:16 +01:00
Tobias Gruetzmacher
5c85e9a2f2 Add BrentalFloss. 
"Flossed in Time" does not work ATM since there are errors in the image
URL.
 2013-03-03 18:58:21 +01:00
Tobias Gruetzmacher
89f1170ff4 Add AlphaLuna and AlphaLuna/Spanish. 2013-03-03 15:58:40 +01:00
Bastian Kleineidam
fba7f6e527 Updated comic plugins. 2013-03-01 20:55:55 +01:00
Bastian Kleineidam
d7daf67e08 Fix some comics. 2013-02-27 19:40:54 +01:00
Bastian Kleineidam
09df20cd1f Fix some comics and increase travis test number. 2013-02-26 06:12:46 +01:00
Bastian Kleineidam
41c954b309 Another try on URL quoting. 2013-02-23 09:08:08 +01:00
Bastian Kleineidam
953dc62ffd Fix some comics. 2013-02-23 09:07:44 +01:00
Bastian Kleineidam
ec6e59e53c Fix Chucklebrain 2013-02-22 20:29:05 +01:00
Bastian Kleineidam
6793aecbd3 Fix OneQuestion. 2013-02-22 20:23:47 +01:00
Bastian Kleineidam
889056b8e3 Fix PicPakDog 2013-02-22 19:43:33 +01:00
Bastian Kleineidam
2eb7b43dd2 Remove drunkduck awards. 2013-02-21 19:51:10 +01:00
Bastian Kleineidam
f36ed46d6a Fix tests which hit the first URL. 2013-02-21 19:48:21 +01:00
Bastian Kleineidam
d0c3492cc7 Catch robots.txt errors. 2013-02-21 19:48:04 +01:00
Bastian Kleineidam
b453c442c2 Fix some comics. 2013-02-21 19:47:37 +01:00
Bastian Kleineidam
1a84431456 Add Caggage 2013-02-21 19:47:21 +01:00
Bastian Kleineidam
292c58633c Fix AstronomyPOTD 2013-02-20 20:52:37 +01:00
Bastian Kleineidam
725001155a Updated generated comics. 2013-02-20 20:52:23 +01:00
Bastian Kleineidam
ae0e9feea1 Remember skipped URLs. 2013-02-20 20:51:39 +01:00
Bastian Kleineidam
91c32515d5 Fix some comics. 2013-02-19 20:58:04 +01:00
Bastian Kleineidam
8e2a01f19f Fix some comics. 2013-02-18 20:55:54 +01:00
Bastian Kleineidam
79795115f0 Do not sort module lists. 2013-02-18 20:40:35 +01:00
Bastian Kleineidam
be1694592e Do not stream page content URLs. 2013-02-18 20:38:59 +01:00
Bastian Kleineidam
96edb60e01 Fix some comics. 2013-02-18 20:38:44 +01:00
Bastian Kleineidam
17f1988197 Fix Catalyst 2013-02-18 20:03:54 +01:00
Bastian Kleineidam
270510bdc5 Fix AstronomyPOTD 2013-02-18 20:03:42 +01:00
Bastian Kleineidam
6155b022a6 Allow selected strips without images. 2013-02-18 20:03:27 +01:00
Bastian Kleineidam
4f03963b9e Code cleanup. 2013-02-18 20:02:16 +01:00
Bastian Kleineidam
c4191158ec Sort scrapers only when listing them. 2013-02-18 20:01:50 +01:00
Bastian Kleineidam
dc9334cca9 Fix scraperclass function. Closes issue #7. 2013-02-18 19:59:16 +01:00
Bastian Kleineidam
495b6d006d Fix some comics. 2013-02-16 14:54:08 +01:00
Bastian Kleineidam
a99fbbcf45 Fix ASofterWorld 2013-02-16 14:18:43 +01:00
Bastian Kleineidam
da9eee3bc0 Updated copyright. 2013-02-15 18:32:36 +01:00
Bastian Kleineidam
deae84d8fa Updated comicfury. 2013-02-14 21:28:34 +01:00
Bastian Kleineidam
40de445d8c Allow multiple comic name matches. 2013-02-13 22:18:05 +01:00
Bastian Kleineidam
8a33871df8 Fix some comicfury stuff. 2013-02-13 22:17:39 +01:00
Bastian Kleineidam
93c48fb7e2 Make _BasicScraper hashable. 2013-02-13 20:00:16 +01:00
Bastian Kleineidam
23a1acd398 Add firstStripUrl to scrapers. 2013-02-13 19:59:59 +01:00
Bastian Kleineidam
312d117ff3 Rename get_scrapers to get_scraperclasses 2013-02-13 19:59:13 +01:00
Bastian Kleineidam
96bf9ef523 Recognize internal server errors. 2013-02-13 17:54:10 +01:00
Bastian Kleineidam
752bf1c6ef Updated plugins. 2013-02-13 17:53:25 +01:00
Bastian Kleineidam
e3722c1220 Add SandraAndWoo, SupernormalStep 2013-02-13 17:53:11 +01:00
Bastian Kleineidam
c422a23e27 Add ManlyGuysDoingManlyThings 2013-02-13 17:52:49 +01:00
Bastian Kleineidam
7da45ffe11 Fix LasLindas 2013-02-13 17:52:32 +01:00
Bastian Kleineidam
f16e860f1e Only cache robots.txt URL on memoize. 2013-02-13 17:52:07 +01:00
Bastian Kleineidam
7a98cf7599 Updated copyright. 2013-02-13 06:28:35 +01:00
Bastian Kleineidam
67af7bd115 Fix GUComics 2013-02-13 06:27:46 +01:00
Bastian Kleineidam
e38a766db3 Updated generated plugins. 2013-02-12 21:54:56 +01:00
Bastian Kleineidam
49ddcecb72 Fix Petitesymphony. 2013-02-12 21:14:57 +01:00
Bastian Kleineidam
093c2dcddc Fix EyeOfRamalach 2013-02-12 21:14:44 +01:00
Bastian Kleineidam
7375fa042f Fix AlienShores 2013-02-12 21:14:32 +01:00
Bastian Kleineidam
9ec4a44953 Remove universal strips since they are almost all duplicated and the rest is useless. 2013-02-12 20:56:02 +01:00
Bastian Kleineidam
10f6a1caa1 Correct path quoting. 2013-02-12 17:55:33 +01:00
Bastian Kleineidam
ebfc6cba70 Fix LookingForGroup. 2013-02-12 17:55:13 +01:00
Bastian Kleineidam
6d0fffd825 Always use connection pooling. 2013-02-12 17:55:13 +01:00
Bastian Kleineidam
82ada5fba0 Updated copyright. 2013-02-11 19:54:50 +01:00
Bastian Kleineidam
a35c54525d Work around a bug in python requests. 2013-02-11 19:52:59 +01:00
Bastian Kleineidam
14f0a6fe78 Do not prefetch content with requests >= 1.0 2013-02-11 19:45:21 +01:00
Bastian Kleineidam
67836942d8 Simplify the fetchUrl code. 2013-02-11 19:43:46 +01:00
Bastian Kleineidam
3f0816efe2 Updated copyright 2013-02-10 18:25:21 +01:00
Bastian Kleineidam
9fa9af639b Remove duplicate comic. 2013-02-10 18:24:21 +01:00
Bastian Kleineidam
1c24fca199 Updated comic from generated lists. 2013-02-10 15:07:21 +01:00
wummel
a61c4b4096 Merge pull request #6 from TobiX/for-upstream-2013-02-08 
Fix for Spinnerette, 2 new comics
 2013-02-09 23:03:45 -08:00
Bastian Kleineidam
e9b63210f9 Add encoding, inline images and guid tags to RSS output. 2013-02-10 08:00:32 +01:00
Bastian Kleineidam
77f3d152c0 Fix imageSearch pattern. 2013-02-08 21:03:23 +01:00
Tobias Gruetzmacher
e67b86c32f Add ParadigmShift. 
The file names for this are a bit inconsistent...
 2013-02-07 23:57:34 +01:00
Tobias Gruetzmacher
4b6d7c54af Add SkinDeep. 
Filenames for this are all over the place :(
 2013-02-07 23:57:34 +01:00
Tobias Gruetzmacher
b32dc6fd40 Fix Spinnerette. 
The old expression was matching "Previous issue" first and skipping all
comics.
 2013-02-07 23:57:34 +01:00
Bastian Kleineidam
419ae5fbcf Raise ValueError when HTML file already exists. 2013-02-07 20:48:03 +01:00
Bastian Kleineidam
1a0cd1ee6b Print HTTP client headers. 2013-02-07 18:28:56 +01:00
Bastian Kleineidam
e16b86d768 Allow debug level to be set. 2013-02-07 18:28:40 +01:00
Bastian Kleineidam
68d58640e8 Added some comics. 2013-02-06 22:27:40 +01:00
Bastian Kleineidam
c19cb93a14 Added some comics. 2013-02-06 22:08:36 +01:00
Bastian Kleineidam
137e30b3ac Added Nedroid comic strip. 2013-02-06 07:03:29 +01:00
Bastian Kleineidam
052e510085 Added HijinksEnsue comic strip. 2013-02-06 06:58:06 +01:00
Bastian Kleineidam
af9d8e90f0 Add missing url variable. 2013-02-06 06:36:50 +01:00
Bastian Kleineidam
a90875f018 Updated copyright. 2013-02-05 19:52:10 +01:00
Bastian Kleineidam
f18b5d5542 Fix Arcamax comics. 2013-02-05 19:51:55 +01:00
Bastian Kleineidam
1451047877 Rename latestUrl in url 2013-02-05 19:51:46 +01:00
Bastian Kleineidam
7f78bea1af Always have an url attribute in comic scrapers. 2013-02-04 21:00:26 +01:00
Bastian Kleineidam
77b8daf2f9 Add Spinnerette comic. 2013-01-29 21:52:26 +01:00
Bastian Kleineidam
4a63f5d561 Add GrrlPower comic. 2013-01-29 21:42:10 +01:00
Bastian Kleineidam
f727a0132f Add VampireCheerleader comic. 2013-01-29 21:23:59 +01:00
Bastian Kleineidam
a96b527f98 Add SequentialArt comic. 2013-01-29 21:23:32 +01:00
Bastian Kleineidam
8b04602c7b Fix GunnerkrigCourt 2013-01-29 19:00:29 +01:00
Bastian Kleineidam
4ab5b67f2e Improve comic strip message. 2013-01-29 18:51:35 +01:00
Bastian Kleineidam
0095f17b4e Updated copyright. 2013-01-28 18:52:26 +01:00
Bastian Kleineidam
e6d35c6494 Updated comic lists. 2013-01-28 06:53:12 +01:00
Bastian Kleineidam
73700e66f0 Cleanup 2013-01-24 21:42:27 +01:00
Bastian Kleineidam
4b35d332dc Fix DrFun image regex. 2013-01-24 07:53:47 +01:00
Bastian Kleineidam
51d0176f53 Fix CyanideAndHappiness image regex - really. 2013-01-23 21:53:34 +01:00
Bastian Kleineidam
399cda21e5 Fix CyanideAndHappiness image regex. 2013-01-23 21:35:36 +01:00
Bastian Kleineidam
f1356a9ff8 Fix URL norming, See issue #2. 2013-01-23 21:16:22 +01:00
Bastian Kleineidam
9ad4477d1f Retrieve more than one strip in index mode. 2013-01-23 20:21:52 +01:00
Bastian Kleineidam
95e1fbbe55 Fix LeastICouldDo. See issue #1. 2013-01-23 20:01:18 +01:00
Bastian Kleineidam
6477e570e1 Fix UnboundLocalError on indexed retrieval. See bug #4 2013-01-23 19:51:08 +01:00
Bastian Kleineidam
0e438b864e Add comic strips from Arcamax. 2013-01-23 19:34:11 +01:00
Bastian Kleineidam
d54d787af1 Better image filename for CyanideAndHappiness 2013-01-23 19:33:10 +01:00
Bastian Kleineidam
5479627d86 Updated copyright. 2013-01-09 22:21:19 +01:00
Bastian Kleineidam
39c83b8968 Truncate generated comic names. 2013-01-09 22:20:03 +01:00
Bastian Kleineidam
0da595963c Added AmazingSuperPowers comic. 2012-12-28 05:41:26 +01:00
Bastian Kleineidam
ad5c7667f1 Add PandyLand comic. 2012-12-28 05:37:08 +01:00
Bastian Kleineidam
a59b984414 Updated generated comic modules. 2012-12-19 20:43:32 +01:00
Bastian Kleineidam
6a2f57b132 Support requests module >= 1.0 2012-12-19 20:43:18 +01:00
Bastian Kleineidam
5f9e5ae3ca Various comics are fixed. 2012-12-13 21:05:27 +01:00
Bastian Kleineidam
de1b80fa4d Fix .zip file module loading. 2012-12-12 23:27:03 +01:00
Bastian Kleineidam
fcbace28b4 Load modules from .zip file. 2012-12-12 23:22:36 +01:00
Bastian Kleineidam
8d92a8f334 Updated colorama and info level of file messages. 2012-12-12 22:00:17 +01:00
Bastian Kleineidam
e5a04931d3 Various fixes and additions. 2012-12-12 17:41:29 +01:00
Bastian Kleineidam
6c0ad90c15 Cleanup 2012-12-09 20:15:22 +01:00
Bastian Kleineidam
3a3a800798 Make output thread-safe. 2012-12-09 18:12:41 +01:00
Bastian Kleineidam
75de0bc662 Added two more comics. 2012-12-09 18:12:21 +01:00
Bastian Kleineidam
5c34baa663 Capitalize comic names. 2012-12-09 07:51:49 +01:00
Bastian Kleineidam
0d9e1b4ef6 Added comics. 2012-12-08 21:30:51 +01:00
Bastian Kleineidam
4def4b81bd Add cookie feature. 2012-12-08 21:30:23 +01:00
Bastian Kleineidam
faba7b0bca Fix more comics. 2012-12-08 00:45:18 +01:00
Bastian Kleineidam
1b74e304c0 Updated comics. 2012-12-05 22:36:16 +01:00
Bastian Kleineidam
e5d9002f09 Fix more comics. 2012-12-05 21:52:52 +01:00
Bastian Kleineidam
387dff79a9 Fix comics. 2012-12-04 07:02:40 +01:00
Bastian Kleineidam
45df462a47 Fix some comics. 2012-12-02 18:35:06 +01:00
Bastian Kleineidam
bcae1b018c Add comic excludes in scripts. 2012-11-29 06:46:58 +01:00
Bastian Kleineidam
451fd982d9 Add comic scripts, add fixes and other stuff. 2012-11-28 18:15:12 +01:00
Bastian Kleineidam
a52e5ae575 Add more comics. 2012-11-26 19:41:25 +01:00
Bastian Kleineidam
0556ffd30a Fix comics, improve tests, use python-requests. 2012-11-26 18:44:31 +01:00
Bastian Kleineidam
d4eee7719d Dynamic type generation helpers. 2012-11-26 07:14:02 +01:00
Bastian Kleineidam
4528894c05 Fix some comics. 2012-11-26 07:13:32 +01:00
Bastian Kleineidam
7e91c83753 Improved comic test. 2012-11-25 07:56:46 +01:00
Bastian Kleineidam
958a788550 Fix some comics. 2012-11-21 21:57:26 +01:00
Bastian Kleineidam
54eaadf4fc Updated documentation and fix some comics. 2012-11-20 18:53:53 +01:00
Bastian Kleineidam
64d9fd6ac2 Require python 2.7, use importlib. 2012-11-19 21:20:50 +01:00
Bastian Kleineidam
7dbd14f934 Fix syntax errors. 2012-11-19 21:20:34 +01:00
Bastian Kleineidam
7e39b291dc Fix some comics 2012-11-14 20:23:30 +01:00
Bastian Kleineidam
31e7ddbd7c Fix some comics. 2012-11-14 06:22:08 +01:00
Bastian Kleineidam
eba2f0089d Fix some comics. 2012-11-13 19:12:28 +01:00
Bastian Kleineidam
5006ed7f40 Rename imageUrl to stripUrl. 2012-11-13 19:10:19 +01:00
Bastian Kleineidam
e4600df1bd Fix some comics. 2012-11-13 06:51:54 +01:00
Bastian Kleineidam
30a28cdb3e Fix some comics. 2012-11-12 18:59:19 +01:00
Bastian Kleineidam
a5108dfb45 Fix copyright. 2012-10-12 22:15:40 +02:00
Bastian Kleineidam
1f1a5f2b3c Improve error message. 2012-10-12 22:10:26 +02:00
Bastian Kleineidam
7a70cd79ca Fix event handling. 2012-10-12 22:07:50 +02:00
Bastian Kleineidam
7bf54255f0 Fix some comics 2012-10-12 21:47:57 +02:00
Bastian Kleineidam
b3e51ddc93 Simplify tagre regex. 2012-10-12 21:47:41 +02:00
Bastian Kleineidam
9c032c9006 Match before and after a tag. 2012-10-12 21:11:44 +02:00
Bastian Kleineidam
67939b3d71 Fix comics. 2012-10-11 21:32:15 +02:00
Bastian Kleineidam
da2b13822d Remove stray print statement. 2012-10-11 19:58:10 +02:00
Bastian Kleineidam
06008d4266 Fix indexed retrieval. 2012-10-11 19:53:37 +02:00
Bastian Kleineidam
78f44e9d9c Improve URL retrieval. 2012-10-11 19:53:10 +02:00
Bastian Kleineidam
65d881eee5 Code cleanup. 2012-10-11 19:52:52 +02:00
Bastian Kleineidam
c0ad053647 Prevent empty URL matching. 2012-10-11 18:16:29 +02:00
Bastian Kleineidam
21de295168 Remove progress stuff. 2012-10-11 18:08:59 +02:00
Bastian Kleineidam
3d96adc3ff Remove progress stuff. 2012-10-11 18:08:18 +02:00
Bastian Kleineidam
194d1e28b1 Add more documentation. 2012-10-11 18:02:29 +02:00
Bastian Kleineidam
4470e13b1a Fix some comics. 2012-10-11 17:39:38 +02:00
Bastian Kleineidam
979c97901b Fix tagre tests. 2012-10-11 17:02:40 +02:00
Bastian Kleineidam
ecfc88faf1 Fix comics. 2012-10-11 16:06:45 +02:00
Bastian Kleineidam
db1df21b58 Fix comic filename. 2012-10-11 15:58:54 +02:00
Bastian Kleineidam
17a40d4fda Make tagre quote configurable. 2012-10-11 15:43:29 +02:00
Bastian Kleineidam
9d30a7004e Only warn about missing images. 2012-10-11 15:17:08 +02:00
Bastian Kleineidam
a7036beef7 Sort loaded plugins. 2012-10-11 14:45:06 +02:00
Bastian Kleineidam
30a64ab1e5 Remove unused imports. 2012-10-11 14:17:37 +02:00
Bastian Kleineidam
c707aa893d A lot of refactoring. 2012-10-11 12:03:12 +02:00
Bastian Kleineidam
c1dc5892c8 Only import colorama on windows systems. 2012-10-01 18:01:56 +02:00
Bastian Kleineidam
a53e1f63bc Improve console size guessing. 2012-09-27 21:59:11 +02:00
Bastian Kleineidam
86e3aa6c1a Add Fredo And Pidjin 2012-09-27 21:55:16 +02:00
Bastian Kleineidam
3ab526f7d8 Fix 2012-09-27 21:54:56 +02:00
Bastian Kleineidam
f3365f6a5e Code cleanup. 2012-09-27 21:24:28 +02:00
Bastian Kleineidam
1333be7225 HTTP improvements. 2012-09-26 16:52:45 +02:00
Bastian Kleineidam
cc2a8df98f Document some functions. 2012-09-26 16:47:39 +02:00
Bastian Kleineidam
4a53639e79 Use tagre matching function. 2012-09-26 14:42:28 +02:00
Bastian Kleineidam
58c4cffcc8 Match end bracket in tagre function. 2012-09-26 14:42:05 +02:00
Bastian Kleineidam
e79649a9ad Fix AGirlAndHerFed. 2012-09-24 20:52:08 +02:00
Bastian Kleineidam
a17782428b Updated copyright for all source files. 2012-06-20 22:41:04 +02:00
Bastian Kleineidam
c9082aee42 Improved terminal functions. 2012-06-20 22:33:26 +02:00
Bastian Kleineidam
f91fb80a39 Initial commit to Github. 2012-06-20 21:58:13 +02:00