dmoonfire/dosage
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Activity
2241 commits 1 branch 0 tags 31 MiB
Commit graph

1500 commits

Author SHA1 Message Date
Manabi
475739ea60 Fixing DogHouseDiaries 2015-04-15 12:56:03 -04:00
Manabi
c0619e8dca Fixing DogHouseDiaries 2015-04-15 12:51:45 -04:00
Manabi
2b98a9023e Added Peanuts Begins & Wizard of Id Classics 2015-04-13 22:26:12 -04:00
Tobias Gruetzmacher
974752951b Fix xkcd (closes #3), remove adult tag (fixes wummel#85). 2015-04-12 20:06:34 +02:00
Tobias Gruetzmacher
5934f03453 Merge branch 'htmlparser' - I think it's ready. 
This closes pull request #70.
 2015-04-01 22:13:55 +02:00
Tobias Gruetzmacher
614c25e278 Fix coding style. 2015-03-22 17:13:53 +01:00
Tobias Gruetzmacher
e94e2ae432 Merge pull request #95 from serenitas50/master 
Added comic Beetlebum (http://blog.beetlebum.de/).
 2015-03-22 17:04:36 +01:00
Tobias Gruetzmacher
b5ed4c56b6 Merge pull request #94 from Manabi/master 
Added definition for Drive comic

Conflicts:
	dosagelib/plugins/g.py
 2015-03-22 16:34:07 +01:00
Tobias Gruetzmacher
b5368b366a Merge Gaia(German), SandraAndWoo(German) into common base. 
This also fixes #97 by correcting the imageSearch regex.
 2015-02-04 19:41:52 +01:00
Manabi
f85464ccb2 Fixed unclosed ' error 
Lines 293/294 should have been one line, this is now fixed.
 2015-02-02 04:35:49 -05:00
Manabi
190f53ee4d Fixing name of GunnkriggCourt 
Existing name was missing a g.
 2015-02-02 04:24:32 -05:00
Serenitas50
94004846cd Added comic Beetlebum (http://blog.beetlebum.de/). 2015-01-31 22:07:35 -02:00
Manabi
a5b0d0c5de Added definition for Drive comic 2015-01-26 04:21:24 -05:00
Dirk Reiners
b710d3fa81 Merge branch 'master' of https://github.com/wummel/dosage 2015-01-16 13:24:48 -06:00
Dirk Reiners
c6f0dd6117 PiledHigherAndDeeper: Fix for new website format 2015-01-16 12:06:17 -06:00
Dirk Reiners
e25270c866 Dilbert: Fix for new websitre format 2015-01-16 12:05:53 -06:00
Dirk Reiners
3724eba835 Cyanide And Happiness: Fix for new website format 2015-01-16 12:05:36 -06:00
Tobias Gruetzmacher
f8531eca57 Move SinFest back to KeenSpot namespace. 2015-01-16 00:16:28 +01:00
Tobias Gruetzmacher
4733153d01 Merge pull request #87 from rpglover64/master 
Update SinFest to work with new website.
 2015-01-16 00:15:04 +01:00
Alex Rozenshteyn
a0506b22f0 Update ZenPencils URL. 2014-12-16 13:51:52 -05:00
Alex Rozenshteyn
51996e45ed Update SinFest to work with new website. 2014-12-16 12:01:54 -05:00
Tobias Gruetzmacher
2c1ff889fa Fix scope in HTML output. 2014-12-10 00:57:17 +01:00
Tobias Gruetzmacher
b7bc16650a Merge branch 'carlosefonseca/master' 2014-12-10 00:07:21 +01:00
Tobias Gruetzmacher
5af4f45505 Merge branch 'zac9/patch-2' 2014-12-10 00:03:08 +01:00
Tobias Gruetzmacher
32265c99d7 Merge branch 'zac9/patch-1' 2014-12-10 00:00:51 +01:00
Carlos Fonseca
04cc07a466 Added comic Nimona 2014-12-08 13:28:37 +00:00
mbrandis
25cf4888ae - Adapted ShermansLagoon 
- Better version of OnTheFastTrack
 2014-11-14 20:37:06 +01:00
mbrandis
c63f927e5c - Modified OnTheFasttrack adapting the new API. 2014-11-14 20:09:42 +01:00
mbrandis
cd48801b0d - Added next and previous day at end of page. 2014-11-14 15:39:42 +01:00
Dirk Reiners
fda654b5e0 Some fixes... 
AbstruseGoose: fixed prev
Carciphona: fixed latest
Curtailed: fixed image and prev (moved to WP)
DorkTower: fixed image search
GrrlPower: fixed site name issue
MadamAndEve: archive not updated in a long time, but current strip is.
Works, but needs to be run daily.
PennyArcade: fixed namer
PvPonline: fixed prev
 2014-10-24 16:42:32 -05:00
Dirk Reiners
77a5e09c10 Minor fix for using pathes to pick comics 2014-10-24 16:39:40 -05:00
Tobias Gruetzmacher
6769e1eb36 Add StrongFemaleProtagonist. 
This uses the _ParserScraper and CSS selectors.
 2014-10-13 23:39:50 +02:00
Tobias Gruetzmacher
1d52d6a152 Add support for CSS selectors to HTML parser. 
Each comic module author can decide if she wants to use CSS or XPath,
not a mix of both. Using CSS needs the cssselect python module and the
module gets disabled if it is unavailable.
 2014-10-13 22:43:06 +02:00
Tobias Gruetzmacher
17bc454132 Bugfix: Don't assume RE patterns in base class. 2014-10-13 22:29:47 +02:00
Tobias Gruetzmacher
e92a3fb3a1 New feature: Comic modules ca be "disabled". 
This is modeled parallel to the "adult" feature, except the user can't
override it via the command line. Each comic module can override the
classmethod getDisabledReasons and give the user a reason why this
module is disabled. The user can see the reason in the comic list (-l or
--singlelist) and the comic module refuses to run, showing the same
message.

This is currently used to disable modules that use the _ParserScraper if
the LXML python module is missing.
 2014-10-13 21:43:46 +02:00
Tobias Gruetzmacher
d495d95ee0 Refactor: Move repeated check into its own function. 2014-10-13 21:29:54 +02:00
Tobias Gruetzmacher
3235b8b312 Pass unicode strings to lxml. 
This reverts commit fcde86e9c0 & some
more. This lets python-requests do all the encoding stuff and leaves
LXML with (hopefully) clean unicode HTML to parse.
 2014-10-13 19:39:48 +02:00
zac9
6ca200419a Update s.py 2014-09-28 19:48:26 -07:00
zac9
5b7ab5a711 Update o.py 2014-09-28 19:41:29 -07:00
zac9
491b5457b2 Added comic ShotgunShuffle 2014-09-28 06:29:02 -07:00
Bastian Kleineidam
731291979d Fixed RedMeat. 2014-09-22 22:14:31 +02:00
Bastian Kleineidam
e43694c156 Don't crash on multiple HTML output runs per day. 2014-09-22 22:00:16 +02:00
Bastian Kleineidam
e87f5993b8 Merge branch 'master' into htmlparser 2014-08-07 18:10:15 +02:00
Tobias Gruetzmacher
08175d28c9 Fix Ruthe (see #73). 2014-07-31 21:27:49 +02:00
Tobias Gruetzmacher
ca2d722d39 Fix DieFruehreifen (closes #73). 2014-07-31 21:18:15 +02:00
Tobias Gruetzmacher
6c7fb176b1 Add Blade Kitten as an example for the new parser. 2014-07-26 11:28:43 +02:00
Tobias Gruetzmacher
f9f0b75d7c Create new HTML parser based scraper class. 2014-07-26 11:28:43 +02:00
Tobias Gruetzmacher
fcde86e9c0 Change getPageContent to (optionally) return raw text. 
This allows LXML to do its own "magic" encoding detection
 2014-07-26 11:28:43 +02:00
Tobias Gruetzmacher
0e03eca8f0 Move all regular expression operation into the new class. 
- Move fetchUrls, fetchUrl and fetchText.
- Move base URL handling.
 2014-07-26 11:28:43 +02:00
Tobias Gruetzmacher
fde1fdced6 Fix some typos. 2014-07-26 11:28:43 +02:00
Tobias Gruetzmacher
2567bd4e57 Convert starters and other helpers to new interface. 
This allows those starters to work with future scrapers.
 2014-07-26 11:28:43 +02:00
Tobias Gruetzmacher
4265053846 Refactor: Move regualar expression scraping into a new class. 
- This also makes "<base href>" handling an internal detail of the regular
  expression scraper, future scrapers might not need that or handle it in
  another way.
 2014-07-26 11:28:43 +02:00
Bastian Kleineidam
3a929ceea6 Allow comic text to be optional. Patch from TobiX 2014-07-24 20:49:57 +02:00
Bastian Kleineidam
950dd2932c Remove stray print statement. 2014-07-21 20:20:15 +02:00
Tobias Gruetzmacher
ea5d533e30 Fix index lookups for SnowFlame and SnowFlakes. 2014-07-19 13:23:42 +02:00
Bastian Kleineidam
4d49d4394b Fix doc 2014-07-03 18:42:06 +02:00
Bastian Kleineidam
f194e430bc TheThinHLine: fetch bigger images and name image files from sequence number. 2014-07-03 18:41:25 +02:00
Bastian Kleineidam
4845a4ccc1 Merge branch 'master' of github.com:wummel/dosage 2014-07-03 17:12:42 +02:00
Bastian Kleineidam
641daa738b Updated list of comics 2014-07-03 17:12:25 +02:00
Bastian Kleineidam
93fe5d5987 Minor useragent refactoring 2014-07-03 17:12:25 +02:00
Bastian Kleineidam
4c2a339e25 Fix some comics. 2014-07-02 19:51:53 +02:00
Luc Fouin
cb76198da7 added the thin H line, fixes #67 2014-07-02 17:14:33 +02:00
Luc Fouin
763f9b02a2 added the thin H line 2014-07-02 17:11:33 +02:00
Bastian Kleineidam
b03ba158ef Fixed LookingForGroup 2014-07-01 23:44:01 +02:00
Bastian Kleineidam
3485e2ac54 Added Whomp. 2014-06-24 20:48:49 +02:00
wummel
a0086bfcd8 Merge pull request #63 from sehrgut/master 
Updated GirlGenius to new markup
 2014-06-24 20:40:15 +02:00
Peter B
8f1c864ec3 Added Safely Endangered 2014-06-17 01:05:11 -04:00
Keith Beckman
236b840363 Updated GirlGenius to new markup 
GG markup has changed, so I fixed the prevSearch regex to find the
"previous" button on the redesigned page.

As well, I set multipleImagesPerStrip to true, since there are quite a
few comics with multiple images that were being discarded.
 2014-06-13 16:43:40 -04:00
Bastian Kleineidam
68afeaf82d Make appname lowercase. 2014-06-09 13:24:58 +02:00
Bastian Kleineidam
00e424aed0 Fix zenpencils. 2014-06-08 13:40:42 +02:00
Bastian Kleineidam
687d27d534 Stripping should be done in normaliseUrl. 2014-06-08 10:12:33 +02:00
Bastian Kleineidam
c528fd1822 Merge branch 'master' of github.com:wummel/dosage 2014-06-08 10:07:36 +02:00
Bastian Kleineidam
0ee5c08771 Match zoom image for GoComics pages. 2014-06-08 10:06:34 +02:00
Peter B
78954da9d7 fix StandStillStaySilent, strip urls when downloading 2014-06-04 01:58:16 -04:00
Peter B
71ed9ad69d fixed foul language 2014-06-04 01:35:40 -04:00
Bastian Kleineidam
62a3a55b82 Fixed LoadingArtist 2014-03-26 19:59:42 +01:00
Bastian Kleineidam
813e6876fc Add missing @classmethod 2014-03-26 19:59:42 +01:00
Bastian Kleineidam
c2cf58560e Remove unused import. 2014-03-26 19:59:42 +01:00
Bastian Kleineidam
4bb31953ad Fix PennyArcade 2014-03-26 19:59:42 +01:00
Freestila
0faf4a722b Update o.py 
Removed procedure for "I am over 18" button, sicne this button no longer exists
 2014-03-05 09:28:34 +01:00
Bastian Kleineidam
348dd5e6c0 Add documentation 2014-03-04 20:53:19 +01:00
Bastian Kleineidam
3108c9124a Fix thread import for py3 2014-03-04 20:50:34 +01:00
Bastian Kleineidam
18972d3830 Remove old waitSeconds parameter. 2014-03-04 18:38:46 +01:00
Bastian Kleineidam
15ef59262a Make threads interruptable. 2014-03-04 18:38:46 +01:00
Tobias Gruetzmacher
33801376f9 Fix indentation. 2014-02-27 22:31:21 +01:00
Tobias Gruetzmacher
1bcac66c03 Mark MonsieurLeChien as french. 2014-02-27 22:30:02 +01:00
Tobias Gruetzmacher
8e2ba15410 Merge pull request #60 from Freestila/master 
Added comics - looks good
 2014-02-27 22:24:57 +01:00
Luc Fouin
da9f518a7a add french commit M. Le Chien 2014-02-27 17:45:29 +01:00
Freestila
53ebb51b10 Added comic DungeonsAndDenizens 2014-02-27 15:08:07 +01:00
Freestila
b8fefb37c0 Added comic Underling 2014-02-20 12:54:40 +01:00
Freestila
3d19d45e81 Added wait 1 sek because of permanent Timeout / connection pool exceed from server 2014-02-20 12:54:13 +01:00
Freestila
67c31284f1 Added comic GrimTales from Down Below 2014-02-18 21:12:29 +01:00
Freestila
de0bb1c9d5 Added comic "The Landscaper" 2014-02-18 21:00:43 +01:00
Freestila
96f61542ee Added comic "Die Fruehreifen" 2014-02-18 21:00:19 +01:00
Peter B
b44b751efa Fixed EvilInc comics. Closes #58 2014-02-14 19:33:13 -05:00
Bastian Kleineidam
f50ef910be Skip CyanideAndHappiness videos 2014-02-10 21:58:26 +01:00
Bastian Kleineidam
875e431edc Provide page data in shouldSkipUrl() function 2014-02-10 21:58:09 +01:00
Bastian Kleineidam
73e1af7aba Fixed FredoAndPidjin 2014-02-06 19:57:56 +01:00
Peter B
d86442efed Added Oh Joy Sex Toy. 2014-01-30 22:45:50 -05:00
Peter B
add63d6d6c Added The Gentleman's Armchair Comic. 2014-01-30 22:32:46 -05:00
Tobias Gruetzmacher
44ef1831bf Sluggy Freelance has some pages with multiple comics. 
See for example SluggyFreelance:010422
 2014-01-28 19:08:39 +01:00
wummel
6b8854e7b2 Merge pull request #55 from Lugoues/upstream 
Added MrLovenstein Comic
 2014-01-26 05:49:50 -08:00
Bastian Kleineidam
cc5ee572fb Fix some comics 2014-01-24 23:17:21 +01:00
Peter B
66f6b08163 Added MrLovenstein Comic 2014-01-23 20:23:24 -05:00
Bastian Kleineidam
1a56fbb3dd Fix DemolitionSquad 2014-01-20 19:01:47 +01:00
Bastian Kleineidam
8b0f149c2b Updated copyright 2014-01-19 13:16:22 +01:00
Peter B
740bcb72ce Added Eat That Toast 2014-01-12 19:08:02 -05:00
Peter B
124cf99665 Added Poorly Drawn lines replacing GoComic's version. 2014-01-12 19:08:02 -05:00
Bastian Kleineidam
e738454cb1 Correct drunkduck disablement comment. 2014-01-11 20:04:52 +01:00
Peter B
d0031b65c8 Added "Stand Still. Stay Silent." comic. 2014-01-08 11:08:19 -05:00
Bastian Kleineidam
69bffc9c92 Fix invalid description. 2014-01-06 16:25:42 +01:00
Bastian Kleineidam
264a20a4db Disable disallowed drunkduck comics. 2014-01-06 09:58:24 +01:00
Bastian Kleineidam
3f4be55332 Merge branch 'upstream' of https://github.com/Lugoues/dosage into Lugoues-upstream 2014-01-06 09:38:25 +01:00
Bastian Kleineidam
d98c2a52dd Skip phdcomic video URL. 2014-01-06 08:20:58 +01:00
Peter B
ceca4ba102 Added FoulLanguage Comic 2014-01-06 00:34:37 -05:00
Peter B
1de57ea1fe added Camp Comic 2014-01-05 23:09:19 -05:00
Bastian Kleineidam
ef17268ace Fix comic list output. 2014-01-05 17:37:13 +01:00
Bastian Kleineidam
5fe48d013a Increase wait interval. 2014-01-05 17:14:19 +01:00
Bastian Kleineidam
4d63920434 Updated copyright. 2014-01-05 16:50:57 +01:00
Bastian Kleineidam
b6c913e2d5 Wait some time between requests. 2014-01-05 16:23:45 +01:00
Bastian Kleineidam
1affe58370 Use thread name in log output. 2014-01-05 16:17:34 +01:00
Bastian Kleineidam
bb18295798 Use realpath to detect symlinked instances. 2014-01-05 11:16:57 +01:00
Bastian Kleineidam
d9edeb1343 Limit cyanideandhappiness filename length 2014-01-05 11:08:15 +01:00
Bastian Kleineidam
9172aba146 Remove stray print 2014-01-05 10:50:25 +01:00
Bastian Kleineidam
1f38895681 Ensure only on instance of dosage is running to prevent accedental DoS on sites with multiple comics. 2014-01-05 10:36:22 +01:00
Bastian Kleineidam
732b50811d Only ensure the maximum width. 2013-12-22 13:38:29 +01:00
Bastian Kleineidam
f488935072 Fix AbstruseGoose and QuestionabelContent. 2013-12-22 08:01:58 +01:00
Bastian Kleineidam
a1a773dd52 Fix loader in frozen executables. 2013-12-18 20:55:23 +01:00
Bastian Kleineidam
5c5aa166c7 Fix gocomic image matcher 2013-12-12 22:54:03 +01:00
Bastian Kleineidam
799d3040f0 Refactoring 2013-12-11 17:54:39 +01:00
Bastian Kleineidam
f23aa86a2c Get larger Gocomic images. 2013-12-11 17:53:52 +01:00
Bastian Kleineidam
b5d973e2d4 Only resize really big images. 2013-12-11 00:01:29 +01:00
Bastian Kleineidam
5ad423c15e Limit image size also in HTML. 2013-12-10 19:59:19 +01:00
Bastian Kleineidam
c3078ed855 Added EdmundFinney, Gaia, GaiaGerman, InternetWebcomic, 
NotInventedHere, RedsPlanet, RomanticallyApocalyptic,
  ScandinaviaAndTheWorld, TheGamerCat, Weregeek
 2013-12-10 19:50:21 +01:00
Damjan Košir
4e40f02642 added comic Gaia in German 2013-12-10 18:02:20 +13:00
Damjan Košir
4e5717be57 added comic Gaia 2013-12-10 17:08:15 +13:00
Damjan Košir
f48b22b512 added comic Not Invented Here 2013-12-10 16:40:44 +13:00
Damjan Košir
e181b287c9 added comic Romantically Apocalyptic 2013-12-10 16:39:30 +13:00
Damjan Košir
58b62dbad3 added comic Scandinavia and the World 2013-12-10 16:37:35 +13:00
Damjan Košir
5982e27c7b added comic Red's Planet 2013-12-10 16:34:47 +13:00
Damjan Košir
4f47792dee added comic The Gamer Cat 2013-12-10 16:33:07 +13:00
Damjan Košir
b53ca04ee7 added comic Internet Webcomic 2013-12-10 16:32:16 +13:00
Damjan Košir
f095f6309e added comic Edmund Finney's Quest to Find the Meaning of Life 2013-12-10 16:31:03 +13:00
Bastian Kleineidam
67c2203e7e Ensure maxium aspect ratio in RSS images. 2013-12-08 15:55:39 +01:00
Bastian Kleineidam
df9a381ae4 Document getfp() function. 2013-12-08 11:46:26 +01:00
Bastian Kleineidam
03fff069ee Apply same file checks files as for image files. 2013-12-05 18:29:15 +01:00
Bastian Kleineidam
599672acbf Fix xkcd text regex. Closes #46 2013-12-05 18:29:15 +01:00
Bastian Kleineidam
7343932a5a Strip whitespace from image text. 2013-12-04 18:07:13 +01:00
wummel
0378c9d855 Merge pull request #45 from Lugoues/master 
Store alt text from AbstruseGoose
 2013-12-04 09:01:50 -08:00
Bastian Kleineidam
c583e8717e Store large xkcd images. 2013-12-04 17:56:54 +01:00
Bastian Kleineidam
0e5c59133c Provide HTML page data for image URL modifier function. 2013-12-04 17:54:55 +01:00
Peter B
36dcadc7d4 Store alt text from AbstruseGoose 2013-12-03 21:56:54 -05:00
Bastian Kleineidam
3c5424c2ef Add text in RSS and HTML output. 2013-11-29 20:32:54 +01:00
Bastian Kleineidam
142c418dc0 Store alt text from xkcd comics. 2013-11-29 20:27:11 +01:00
Bastian Kleineidam
0eaf9a3139 Add text search in comic strips. 2013-11-29 20:26:49 +01:00
Bastian Kleineidam
468b34034b cyanideandhappiness skip URL 2013-11-29 18:31:34 +01:00
Bastian Kleineidam
9514a8eeae Fixed ForLackOfABetterComic 2013-11-27 20:49:35 +01:00
Bastian Kleineidam
7d05b666da Updated RSS link name 2013-11-25 21:20:48 +01:00
Bastian Kleineidam
01085d56c2 Regenerated. 2013-11-24 12:19:54 +01:00
Bastian Kleineidam
48e417c647 Fixed some comics. 2013-11-18 22:01:30 +01:00
Bastian Kleineidam
f6fc604745 Fix GoComics image URL. 2013-11-14 21:30:51 +01:00
Bastian Kleineidam
44f8c81111 Updated from edits. 2013-11-12 20:13:58 +01:00
Bastian Kleineidam
7760985601 Fix broken comics 2013-11-12 18:33:14 +01:00
Bastian Kleineidam
45a5ef9064 Removed AetheriaEpics 2013-11-07 21:23:15 +01:00
Bastian Kleineidam
f74b18c2e5 Remove unused import. 2013-11-07 21:22:49 +01:00
Bastian Kleineidam
ca17332942 Call self.starter() on indexed comics since it might set cookies. 2013-11-07 20:48:10 +01:00
Bastian Kleineidam
74cca6bac3 Fixed oglaf comic skipping. 2013-11-07 20:47:31 +01:00
Bastian Kleineidam
1f282147dc Fix drunkduck comics. 2013-11-07 17:12:38 +01:00
Bastian Kleineidam
3e6414e0e5 Updated plugins 2013-11-07 07:28:47 +01:00
Bastian Kleineidam
86257c8364 Remove duplicate variable 2013-08-28 20:50:07 +02:00
Faldrian
93318c1d0c Added DarthsAndDroids 2013-08-19 20:14:47 +02:00
Bastian Kleineidam
ef4ae435a5 Fix several comics. 2013-07-18 20:39:53 +02:00
Bastian Kleineidam
eb4ee1a251 Add EatLiver and JimBenton 2013-07-16 18:01:44 +02:00
Bastian Kleineidam
934546954b Added MarriedToTheSea, NatalieDee 2013-07-10 18:43:53 +02:00
Bastian Kleineidam
d5172074d5 Fix some comics. 2013-07-09 22:21:17 +02:00
Bastian Kleineidam
8d5ae7b1bb Updated plugins. 2013-07-09 22:21:12 +02:00
Bastian Kleineidam
38f2e9e625 Fix typo. 2013-07-04 21:00:06 +02:00
wummel
dc6c90dbf3 Merge pull request #36 from pataluc/master 
Added Go Get A Roomie
 2013-07-04 11:56:31 -07:00
Bastian Kleineidam
327cb35aee Add dosagelib.__version__ 2013-07-04 20:55:43 +02:00
Bastian Kleineidam
02132893b2 Fix shermanslagoon namer. 2013-07-04 20:20:26 +02:00
Bastian Kleineidam
f78d28fba8 Merge branch 'master' of https://github.com/mbrandis/dosage into mbrandis-master 2013-07-04 20:03:11 +02:00
Bastian Kleineidam
8559184d69 Updated plugins 2013-07-04 12:22:36 +02:00
Bastian Kleineidam
a27ab5460b Add ICanBarelyDraw 2013-07-04 12:22:20 +02:00
Luc Fouin
495b1149bd added GoGetARoomie 2013-07-04 11:08:16 +02:00
mbrandis
ccf50cad89 Corrected description. 2013-06-24 22:46:39 +02:00
Bastian Kleineidam
da957ce329 Updated linuxcom 2013-06-24 20:27:43 +02:00
Bastian Kleineidam
36b8dcea04 Merge branch 'patch-2' of https://github.com/mbrandis/dosage into mbrandis-patch-2 2013-06-24 20:23:10 +02:00
Bastian Kleineidam
6bd534eaed Fix OnTheFasttrack 2013-06-24 20:19:33 +02:00
mbrandis
3b0393ccf6 Update s.py 
Added Sherman's Lagoon, namer is not perfect.
 2013-06-23 23:30:57 +03:00
mbrandis
265c03fc82 Update l.py 
Added Linux.com Friday Funnies.
 2013-06-23 22:28:08 +02:00
mbrandis
ef5ac2128b Update o.py 
Please consider adding this comic.
 2013-06-23 22:26:32 +02:00
Bastian Kleineidam
1c1b0aaf18 Comic fixes. 2013-05-25 23:24:33 +02:00
Bastian Kleineidam
66dccef537 Fix keenspot description type. 2013-05-22 22:29:20 +02:00
Bastian Kleineidam
ef878eed7c Updated plugins. 2013-05-22 07:19:16 +02:00
Bastian Kleineidam
b41fdf99ae Fix LookingForGroup. 2013-05-21 18:48:03 +02:00
Bastian Kleineidam
1478f22099 Output fixes. 2013-04-30 20:26:36 +02:00
Bastian Kleineidam
5f6ed7e05d More output stuff. 2013-04-30 07:24:54 +02:00
Bastian Kleineidam
1a6416eb1b Updated wormworld chapter. 2013-04-30 06:42:49 +02:00
Bastian Kleineidam
ebdc1e6359 More unicode output fixes. 2013-04-30 06:41:19 +02:00
Bastian Kleineidam
d6ca5aa7fd SnowFlakes is end-of-life. 2013-04-29 20:31:07 +02:00
Bastian Kleineidam
cec08b86dd DrFun is end-of-life. 2013-04-29 20:29:56 +02:00
Bastian Kleineidam
79273deb23 Correct output encoding. 2013-04-29 20:25:05 +02:00
Bastian Kleineidam
80d7defcd2 Unicode descriptions. 2013-04-29 07:35:56 +02:00
Bastian Kleineidam
459156fc1a Description must be unicode. 2013-04-29 07:27:59 +02:00
Bastian Kleineidam
64bf618b87 xkcd 2013-04-29 07:19:58 +02:00
Bastian Kleineidam
dcacbf0b9a Fix some comics. 2013-04-28 19:58:38 +02:00
Bastian Kleineidam
f9a48e6cb9 Updated scripted comic plugins. 2013-04-27 07:47:17 +02:00
Bastian Kleineidam
8783b53012 Fix GirlGenious strip url. 2013-04-26 19:52:45 +02:00
Bastian Kleineidam
cafa37fcb1 All scrapers must have an URL. 2013-04-26 06:53:05 +02:00
Bastian Kleineidam
05dbc51d3e Detect completed end-of-life comics. 2013-04-25 22:40:06 +02:00
Bastian Kleineidam
871de6a8ce Prefer GoComics over Creators since they have a better naming scheme. 2013-04-25 21:50:45 +02:00
Bastian Kleineidam
4716ecd71d Carciphona description. 2013-04-25 21:50:27 +02:00
Bastian Kleineidam
ba6e0c09a4 Added Unsound. 2013-04-25 21:38:18 +02:00
Bastian Kleineidam
725824f067 Added TwoGuysAndGuy 2013-04-25 21:23:31 +02:00
Bastian Kleineidam
382c4c05ad Added TheDreamlandChronicles 2013-04-25 21:20:48 +02:00
Bastian Kleineidam
8418ea471d Added SabrinaOnline. 2013-04-25 21:14:32 +02:00
Bastian Kleineidam
3e74dc9956 Fix MadamAndEve. 2013-04-25 21:09:42 +02:00
Bastian Kleineidam
c95a447305 Updated docs. 2013-04-25 21:06:20 +02:00
Bastian Kleineidam
6c773e21c7 Added Lackadaisy. 2013-04-25 21:06:12 +02:00
Bastian Kleineidam
1ae674782d Added GirlGenius 2013-04-25 20:58:24 +02:00
Bastian Kleineidam
96fc129fea Add GeneralProtectionFault (disallowed by robots.txt) 2013-04-25 20:54:48 +02:00
Bastian Kleineidam
f20df8b692 Added Curtailed. 2013-04-25 20:46:05 +02:00
Bastian Kleineidam
c114a834dd Added Carciphona 2013-04-25 20:40:15 +02:00
Bastian Kleineidam
51d84131eb Added ARedTailsDream 2013-04-25 20:37:27 +02:00
Bastian Kleineidam
dbdbdd09de Fix SMBC 2013-04-25 20:32:21 +02:00
Bastian Kleineidam
52ee7228ef Fix DorkTower image regex. 2013-04-25 19:01:38 +02:00
Bastian Kleineidam
aca3c959af Improve CtrlAltDel image names. 2013-04-25 19:01:21 +02:00
wummel
1c29f22270 Merge pull request #27 from dromaludaire/master 
Fix some SMBC download links
 2013-04-22 10:40:24 -07:00
Benjamin Sigonneau
f1da47edef [SMBC] Fix regexp, mainly concerns older strips 2013-04-21 22:39:06 +02:00
Sven Hartge
8e34239b27 Fix typo in regex for SandraOnTheRocks. 2013-04-20 19:59:01 +02:00
Sven Hartge
40f2aed8f0 Add Sandra on the Rocks. 2013-04-20 18:51:06 +02:00
Bastian Kleineidam
4988e79e6e Added some descriptions. 2013-04-19 06:31:12 +02:00
Bastian Kleineidam
e37a80fdc1 Add some descriptions. 2013-04-14 09:02:14 +02:00
Bastian Kleineidam
f15f993851 s/baseurl/baseUrl/g 2013-04-13 20:58:00 +02:00
Bastian Kleineidam
c246b41d64 Code formatting. 2013-04-13 08:00:11 +02:00
Bastian Kleineidam
522af89af5 Add some descriptions. 2013-04-13 08:00:03 +02:00
Bastian Kleineidam
3a03554d26 Ensure unicode output to fix encoding errors. 2013-04-12 21:02:31 +02:00
Bastian Kleineidam
35c031ca81 Fixed some comics. 2013-04-11 18:27:43 +02:00
Bastian Kleineidam
6ca4eaa492 Code cleanup. 2013-04-11 18:27:43 +02:00
Bastian Kleineidam
7e593cf7e8 Add firstStripUrls. 2013-04-10 23:57:09 +02:00
Bastian Kleineidam
a0c7f54871 Fix zwarwald 2013-04-10 20:14:43 +02:00
Bastian Kleineidam
fb05c10808 Sort entries. 2013-04-10 18:36:33 +02:00
Bastian Kleineidam
54283775a8 Add ForLackOfABetterComic 2013-04-10 18:20:39 +02:00
Bastian Kleineidam
d00310f017 Add EverydayBlues 2013-04-10 18:20:08 +02:00
Bastian Kleineidam
8b99b59056 Added DamnLol 2013-04-10 18:19:38 +02:00
Bastian Kleineidam
5127d4c895 Use re.escape and add some firstStripUrl. 2013-04-10 18:19:11 +02:00
Bastian Kleineidam
3213eebd75 Added ZenPencils. 2013-04-09 19:38:47 +02:00
Bastian Kleineidam
e040dd0d50 Added Science. 2013-04-09 19:38:16 +02:00
Bastian Kleineidam
68f14971e8 Added RealmOfAtland. 2013-04-09 19:37:47 +02:00
Bastian Kleineidam
f9179e9de5 Added GoblinsComic 2013-04-09 19:37:24 +02:00
Bastian Kleineidam
f71961acbc Added ExtraOrdinary. 2013-04-09 19:36:51 +02:00
Bastian Kleineidam
190ffcd390 Use str() for robotparser. 2013-04-09 19:36:00 +02:00
Bastian Kleineidam
b9dc385ff2 Implemented voting 2013-04-09 19:33:50 +02:00
Bastian Kleineidam
4528281ddd Voting part 2 2013-04-08 21:20:01 +02:00
Bastian Kleineidam
e762f269b7 First part of voting stuff. 2013-04-08 20:19:10 +02:00
Bastian Kleineidam
7584f0b647 Add version update check. 2013-04-08 20:17:02 +02:00
Bastian Kleineidam
781bac0ca2 Feed text content instead of binary to robots.txt parser. 2013-04-07 18:11:29 +02:00
Bastian Kleineidam
bd1d41b83c Write encoded data in binary format. 2013-04-05 19:27:30 +02:00
Bastian Kleineidam
0fbc005377 A Python3 fix. 2013-04-05 18:57:44 +02:00
Bastian Kleineidam
97522bc5ae Use tuples rather than lists. 2013-04-05 18:55:19 +02:00
Bastian Kleineidam
adb31d84af Use HTMLParser.unescape instead of rolling our own function. 2013-04-05 18:53:19 +02:00
Bastian Kleineidam
1c9f64bc27 Better name for Sketchesnatched. 2013-04-05 18:47:51 +02:00
Bastian Kleineidam
9e26640407 Augment SketcheSnatched 2013-04-05 07:31:22 +02:00
Bastian Kleineidam
50b742721b SketcheSnatched 2013-04-05 07:20:50 +02:00
Bastian Kleineidam
3936cfa9ce Another fix. 2013-04-05 06:56:33 +02:00
Bastian Kleineidam
6aa588860d Code cleanup 2013-04-05 06:36:05 +02:00
Bastian Kleineidam
fabe872d1d Fix SnowFlame 2013-04-04 18:32:37 +02:00
Bastian Kleineidam
8150dabfa6 Remove SarahZero 2013-04-04 18:32:29 +02:00
Bastian Kleineidam
5d6e210c98 Fix Curvy 2013-04-04 18:30:27 +02:00
Bastian Kleineidam
b3cbad37bc Remove CaribbeanBlue 2013-04-04 18:30:16 +02:00
Bastian Kleineidam
80c24a10c0 Fix WebDesignerCOTW 2013-04-04 18:30:02 +02:00
Bastian Kleineidam
62af4b875e Fix Precocious 2013-04-04 18:30:02 +02:00
Bastian Kleineidam
421e31c961 Fix Oglaf 2013-04-04 18:30:02 +02:00
Bastian Kleineidam
d794919e73 Fix LasLindas 2013-04-04 18:30:02 +02:00
Bastian Kleineidam
08a3587df6 Fix KatzenfutterGeleespritzer 2013-04-04 18:30:02 +02:00
Bastian Kleineidam
c57226f1c0 Remove GreystoneInn 2013-04-04 18:30:02 +02:00
Bastian Kleineidam
3078c5ec73 Fix ExtraLife and EyeOfRamalach 2013-04-04 18:30:02 +02:00
Bastian Kleineidam
3fd4cfea0d Fix DasLebenIstKeinPonyhof 2013-04-04 18:30:02 +02:00
Bastian Kleineidam
460c5be689 Add POST support to urlopen(). 2013-04-04 18:30:02 +02:00
Bastian Kleineidam
44c3fb9f16 Remove broken scripted plugins. 2013-04-04 18:30:02 +02:00
Bastian Kleineidam
0054ebfe0b Some Python3 fixes. 2013-04-03 20:32:43 +02:00
Bastian Kleineidam
2c0ca04882 Fix warning for scrapers with multiple image patterns. 2013-04-03 20:32:19 +02:00
Bastian Kleineidam
f53a516219 Use output logging instead of print statement. 2013-04-03 20:31:10 +02:00
Bastian Kleineidam
a972729c0d Add WebDesignerCOTW 2013-04-03 20:30:51 +02:00
Bastian Kleineidam
fdab3b7b35 Add StuffNoOneToldMe 2013-04-03 20:30:29 +02:00
Bastian Kleineidam
43255872c3 Added SnowFlakes. 2013-04-03 20:30:16 +02:00
Bastian Kleineidam
6303a1cb20 Updated scripted plugins. 2013-04-03 20:27:12 +02:00
Bastian Kleineidam
f737486754 Fix hagar. 2013-03-26 20:12:26 +01:00
Bastian Kleineidam
a2f343226f Remove duplicate dilbert. 2013-03-26 20:02:13 +01:00
Bastian Kleineidam
1d7f7a8517 Fix genre list 2013-03-26 19:58:22 +01:00
Bastian Kleineidam
141d5113de Fix hagarthehorrible 2013-03-26 19:54:00 +01:00
Bastian Kleineidam
b62f1ba69d Code cleanup. 2013-03-26 17:36:06 +01:00
Bastian Kleineidam
31d95d1d03 Remove DerFlix 2013-03-26 17:35:58 +01:00
Bastian Kleineidam
3dd2daf223 Updated scripted plugins. 2013-03-26 17:35:47 +01:00
Bastian Kleineidam
92150ddbda Add HagarTheHorrible 2013-03-26 17:35:10 +01:00
Bastian Kleineidam
75f3d59e85 Fix Eriadan 2013-03-26 17:34:56 +01:00
Bastian Kleineidam
de3ce2ec95 Fix WormWorldSaga* 2013-03-26 17:34:27 +01:00
Bastian Kleineidam
a3d74c5a0e Fix BratHalla and BrentalFloss 2013-03-26 17:33:51 +01:00
Bastian Kleineidam
10985ae614 Add genre tags. 2013-03-26 17:33:27 +01:00
Bastian Kleineidam
fcdc67ef92 Fix documentation. 2013-03-26 17:29:20 +01:00
Bastian Kleineidam
110a67cda4 Retry failed page content downloads (eg. timeouts). 2013-03-25 19:49:09 +01:00
Bastian Kleineidam
ec33276fd7 Print stacktrace on image errors. 2013-03-25 19:48:47 +01:00
Bastian Kleineidam
1a7dfc02d2 Add Schuelert 2013-03-25 19:48:32 +01:00
Bastian Kleineidam
af10385da1 Add firstStripUrl for KevinAndKell. 2013-03-25 19:48:19 +01:00
Bastian Kleineidam
940a04b499 Fix comic searching. 2013-03-25 19:48:01 +01:00
Bastian Kleineidam
bafe981917 Add DrMcNinja. 2013-03-25 19:47:44 +01:00
Bastian Kleineidam
9d1f286424 Improved documentation. 2013-03-25 19:47:29 +01:00
Bastian Kleineidam
c99827935b Updated plugins with scripts. 2013-03-25 19:40:38 +01:00
Bastian Kleineidam
01c2afc264 Print exception tracebacks. 2013-03-25 19:39:37 +01:00
Tobias Gruetzmacher
a1b5bfb68f Add a simple event consumer to write JSON metadata. 
This drops a file named dosage.json in each comic directory. This is
still not perfect, but something to build upon.
 2013-03-24 16:55:30 +01:00
Tobias Gruetzmacher
0a218c0283 Add event comicPageLink for every previous link. 
This event allows a listener to build connections between pages.
 2013-03-24 16:36:02 +01:00
Bastian Kleineidam
9f08b21a7e Get correct images of gocomic strips. 2013-03-24 14:13:33 +01:00
Bastian Kleineidam
179ba7f49f Add release info. 2013-03-21 19:04:59 +01:00
Bastian Kleineidam
2b98cf0079 CucumberQuest fixes. 2013-03-21 18:38:40 +01:00
Bastian Kleineidam
3f6df92fef Added some comics, fixed some. 2013-03-21 18:33:16 +01:00
Bastian Kleineidam
448e80eaed Added MyCartoons 2013-03-20 21:42:04 +01:00
Bastian Kleineidam
2e3907d942 Add Katzenfuttergeleespritzer and ParallelUniversum 2013-03-20 17:39:49 +01:00
Bastian Kleineidam
3937cfba4b Added SandraAndWooGerman 2013-03-19 20:54:16 +01:00
Bastian Kleineidam
78fb63859c Add DemolitionSquad. 2013-03-19 20:45:59 +01:00
Bastian Kleineidam
17fe58b864 Fix some comics. 2013-03-19 20:45:18 +01:00
Bastian Kleineidam
178d8f80b2 Fix Dilbert image naming. 2013-03-18 18:15:19 +01:00
Bastian Kleineidam
88224fe21a Add DogHouseDiaries, update changelog. 2013-03-15 07:04:19 +01:00
Bastian Kleineidam
6a2f55ddef Dont stop on image regex errors. 2013-03-15 07:03:54 +01:00
Bastian Kleineidam
e88cf514a7 Fixes for FonFlatter 2013-03-13 18:31:58 +01:00
Bastian Kleineidam
e739eb7992 Added CucumberQuest 2013-03-12 21:36:13 +01:00
Bastian Kleineidam
79f0f4b36c Added OrnerBoy 2013-03-12 21:23:26 +01:00
Bastian Kleineidam
502a35166f Added KickInTheHead 2013-03-12 21:16:17 +01:00
Bastian Kleineidam
7c4ac0df7b Add and fix some comics. 2013-03-12 20:49:46 +01:00
Bastian Kleineidam
43f20270d0 Allow a list of regular expressions for image and previous link search. 2013-03-12 20:48:26 +01:00
Bastian Kleineidam
6de26aeeaa Updated keenspot scraper and its comic list. 2013-03-12 20:47:52 +01:00
Bastian Kleineidam
2bf7d16090 Updated comicgenesis comic list. 2013-03-12 20:47:38 +01:00
Bastian Kleineidam
58abcb282d Added GeeksNextDoor. 2013-03-11 22:51:45 +01:00
Bastian Kleineidam
737f1e189d Added FullFrontalNerdity. 2013-03-11 22:45:30 +01:00
Bastian Kleineidam
538523f86c Add keenspot. 2013-03-11 22:03:17 +01:00
Bastian Kleineidam
a16bf6c16b Rename keenspot to comicgenesis and enable it. 2013-03-11 21:50:49 +01:00
Bastian Kleineidam
f0eaba0f69 Reenable comicgenesis comics. 2013-03-11 20:33:56 +01:00
Bastian Kleineidam
950a958e30 Updated for release. [ci skip] 2013-03-11 20:14:27 +01:00
Bastian Kleineidam
7eaf12caf6 Fix LookingForGroup 2013-03-11 19:56:37 +01:00
Bastian Kleineidam
7ee73caf3c Allow multiple event output and improve HTML output. 2013-03-11 17:33:59 +01:00
Bastian Kleineidam
75e576f2de Embed images in html output. 2013-03-09 21:39:43 +01:00
Bastian Kleineidam
8b0a523f77 Page comic listings. 2013-03-09 09:00:50 +01:00
Bastian Kleineidam
5ccf44c36a Embed images in html output. 2013-03-08 22:38:11 +01:00
Bastian Kleineidam
88e28f3923 Fix some comics and add language tag. 2013-03-08 22:33:05 +01:00
Bastian Kleineidam
b368f125bc Fix some comics. 2013-03-08 06:47:00 +01:00
Bastian Kleineidam
4c344765ff Add option to wait before downloading. 2013-03-08 06:46:50 +01:00
Bastian Kleineidam
0ee0822e00 Fix some comics. 2013-03-08 00:06:55 +01:00
Bastian Kleineidam
2bdf0d588d Simplify exception handling. 2013-03-08 00:06:50 +01:00
Bastian Kleineidam
1d7410c038 Added Zwarwald and AhoiPolloi 2013-03-07 23:51:55 +01:00
Bastian Kleineidam
8259a01d64 Fix URLs with no content type header. 2013-03-07 23:08:37 +01:00
Bastian Kleineidam
1cc7d39047 Fix some comics. 2013-03-07 23:08:17 +01:00
Bastian Kleineidam
0215ae82af Fix some comics. 2013-03-07 19:54:18 +01:00
Bastian Kleineidam
e96c68c378 Fix dorktower. 2013-03-07 18:24:12 +01:00
Bastian Kleineidam
7d8786c1d2 Code cleanup. 2013-03-07 18:22:49 +01:00
Bastian Kleineidam
736d9aa8cf Code cleanup. 2013-03-07 18:22:39 +01:00
Bastian Kleineidam
23c20bfe32 Fix some comics. 2013-03-07 18:22:24 +01:00
Bastian Kleineidam
d1e5ad2696 Set proper HTML5 doctype and encoding for HTML output. 2013-03-07 18:21:05 +01:00
Bastian Kleineidam
9f13af7750 Retry empty downloads and don't set a manual modification time. 2013-03-07 18:20:38 +01:00
Bastian Kleineidam
6f2aebe8c0 Updated copyright. 2013-03-07 18:19:50 +01:00
Bastian Kleineidam
106a15b6c3 Add missing attribute. 2013-03-06 20:23:43 +01:00
Bastian Kleineidam
10eb1ff5ec Fix dilbert filenames. 2013-03-06 20:21:20 +01:00
Bastian Kleineidam
d7925ba4a2 Sort comics. 2013-03-06 20:21:10 +01:00
Bastian Kleineidam
bae2a96d8b Added some comic strips and cleanup the scraper code. 2013-03-06 20:00:30 +01:00
Bastian Kleineidam
3a22c05050 Catch WindowsError when initializing colorama. 2013-03-05 21:15:25 +01:00
Bastian Kleineidam
01177e25f0 Updated generated comic lists. 2013-03-05 19:06:00 +01:00
Bastian Kleineidam
c13aa323d8 Code cleanup [ci skip] 2013-03-04 21:44:26 +01:00
Bastian Kleineidam
61a02630b8 Remove duplicate comic entries. 2013-03-04 19:40:10 +01:00
Bastian Kleineidam
4047859c5b Fix BrentalFlossFit 2013-03-04 19:37:26 +01:00
wummel
c0440266cf Merge pull request #12 from TobiX/some-new-comics 
Some new comics
 2013-03-04 10:13:51 -08:00
Bastian Kleineidam
3712799ee0 Add imageUrlModifier() for scrapers. 2013-03-04 19:10:27 +01:00
Bastian Kleineidam
44d696c4af Flush file contents to disk and check for empty files. 2013-03-04 19:10:26 +01:00
Bastian Kleineidam
60b160bcdf Prevent double slash in support url 2013-03-04 19:10:26 +01:00
Tobias Gruetzmacher
fc3fab8500 Add Namesake. 2013-03-03 22:41:11 +01:00
Tobias Gruetzmacher
bf13b13ab6 Add StickyDillyBuns. 
One of the Pixie Trix Comix.
 2013-03-03 22:03:27 +01:00
Tobias Gruetzmacher
1af8a99594 Added MenageA3 (ma3comics.com). 
One of the Pixie Trix Comix.
 2013-03-03 21:52:08 +01:00
Tobias Gruetzmacher
d668f5fc1e Add DangerouslyChloe. 
One of the Pixie Trix Comix.
 2013-03-03 21:31:44 +01:00
Tobias Gruetzmacher
4036ce06ef Add MagickChicks. 
One of the Pixie Trix Comix.
 2013-03-03 20:50:21 +01:00
Tobias Gruetzmacher
af57e018a1 Add ShadowGirls. 2013-03-03 18:59:16 +01:00
Tobias Gruetzmacher
5c85e9a2f2 Add BrentalFloss. 
"Flossed in Time" does not work ATM since there are errors in the image
URL.
 2013-03-03 18:58:21 +01:00
Tobias Gruetzmacher
89f1170ff4 Add AlphaLuna and AlphaLuna/Spanish. 2013-03-03 15:58:40 +01:00
Bastian Kleineidam
fba7f6e527 Updated comic plugins. 2013-03-01 20:55:55 +01:00
Bastian Kleineidam
d7daf67e08 Fix some comics. 2013-02-27 19:40:54 +01:00
Bastian Kleineidam
09df20cd1f Fix some comics and increase travis test number. 2013-02-26 06:12:46 +01:00
Bastian Kleineidam
41c954b309 Another try on URL quoting. 2013-02-23 09:08:08 +01:00
Bastian Kleineidam
953dc62ffd Fix some comics. 2013-02-23 09:07:44 +01:00
Bastian Kleineidam
ec6e59e53c Fix Chucklebrain 2013-02-22 20:29:05 +01:00
Bastian Kleineidam
6793aecbd3 Fix OneQuestion. 2013-02-22 20:23:47 +01:00
Bastian Kleineidam
889056b8e3 Fix PicPakDog 2013-02-22 19:43:33 +01:00
Bastian Kleineidam
2eb7b43dd2 Remove drunkduck awards. 2013-02-21 19:51:10 +01:00
Bastian Kleineidam
f36ed46d6a Fix tests which hit the first URL. 2013-02-21 19:48:21 +01:00
Bastian Kleineidam
d0c3492cc7 Catch robots.txt errors. 2013-02-21 19:48:04 +01:00
Bastian Kleineidam
b453c442c2 Fix some comics. 2013-02-21 19:47:37 +01:00
Bastian Kleineidam
1a84431456 Add Caggage 2013-02-21 19:47:21 +01:00
Bastian Kleineidam
292c58633c Fix AstronomyPOTD 2013-02-20 20:52:37 +01:00
Bastian Kleineidam
725001155a Updated generated comics. 2013-02-20 20:52:23 +01:00
Bastian Kleineidam
ae0e9feea1 Remember skipped URLs. 2013-02-20 20:51:39 +01:00
Bastian Kleineidam
91c32515d5 Fix some comics. 2013-02-19 20:58:04 +01:00
Bastian Kleineidam
8e2a01f19f Fix some comics. 2013-02-18 20:55:54 +01:00
Bastian Kleineidam
79795115f0 Do not sort module lists. 2013-02-18 20:40:35 +01:00
Bastian Kleineidam
be1694592e Do not stream page content URLs. 2013-02-18 20:38:59 +01:00
Bastian Kleineidam
96edb60e01 Fix some comics. 2013-02-18 20:38:44 +01:00
Bastian Kleineidam
17f1988197 Fix Catalyst 2013-02-18 20:03:54 +01:00
Bastian Kleineidam
270510bdc5 Fix AstronomyPOTD 2013-02-18 20:03:42 +01:00
Bastian Kleineidam
6155b022a6 Allow selected strips without images. 2013-02-18 20:03:27 +01:00
Bastian Kleineidam
4f03963b9e Code cleanup. 2013-02-18 20:02:16 +01:00
Bastian Kleineidam
c4191158ec Sort scrapers only when listing them. 2013-02-18 20:01:50 +01:00
Bastian Kleineidam
dc9334cca9 Fix scraperclass function. Closes issue #7. 2013-02-18 19:59:16 +01:00
Bastian Kleineidam
495b6d006d Fix some comics. 2013-02-16 14:54:08 +01:00
Bastian Kleineidam
a99fbbcf45 Fix ASofterWorld 2013-02-16 14:18:43 +01:00
Bastian Kleineidam
da9eee3bc0 Updated copyright. 2013-02-15 18:32:36 +01:00
Bastian Kleineidam
deae84d8fa Updated comicfury. 2013-02-14 21:28:34 +01:00
Bastian Kleineidam
40de445d8c Allow multiple comic name matches. 2013-02-13 22:18:05 +01:00
Bastian Kleineidam
8a33871df8 Fix some comicfury stuff. 2013-02-13 22:17:39 +01:00
Bastian Kleineidam
93c48fb7e2 Make _BasicScraper hashable. 2013-02-13 20:00:16 +01:00
Bastian Kleineidam
23a1acd398 Add firstStripUrl to scrapers. 2013-02-13 19:59:59 +01:00
Bastian Kleineidam
312d117ff3 Rename get_scrapers to get_scraperclasses 2013-02-13 19:59:13 +01:00
Bastian Kleineidam
96bf9ef523 Recognize internal server errors. 2013-02-13 17:54:10 +01:00
Bastian Kleineidam
752bf1c6ef Updated plugins. 2013-02-13 17:53:25 +01:00
Bastian Kleineidam
e3722c1220 Add SandraAndWoo, SupernormalStep 2013-02-13 17:53:11 +01:00
Bastian Kleineidam
c422a23e27 Add ManlyGuysDoingManlyThings 2013-02-13 17:52:49 +01:00
Bastian Kleineidam
7da45ffe11 Fix LasLindas 2013-02-13 17:52:32 +01:00
Bastian Kleineidam
f16e860f1e Only cache robots.txt URL on memoize. 2013-02-13 17:52:07 +01:00
Bastian Kleineidam
7a98cf7599 Updated copyright. 2013-02-13 06:28:35 +01:00
Bastian Kleineidam
67af7bd115 Fix GUComics 2013-02-13 06:27:46 +01:00
Bastian Kleineidam
e38a766db3 Updated generated plugins. 2013-02-12 21:54:56 +01:00
Bastian Kleineidam
49ddcecb72 Fix Petitesymphony. 2013-02-12 21:14:57 +01:00
Bastian Kleineidam
093c2dcddc Fix EyeOfRamalach 2013-02-12 21:14:44 +01:00
Bastian Kleineidam
7375fa042f Fix AlienShores 2013-02-12 21:14:32 +01:00
Bastian Kleineidam
9ec4a44953 Remove universal strips since they are almost all duplicated and the rest is useless. 2013-02-12 20:56:02 +01:00
Bastian Kleineidam
10f6a1caa1 Correct path quoting. 2013-02-12 17:55:33 +01:00
Bastian Kleineidam
ebfc6cba70 Fix LookingForGroup. 2013-02-12 17:55:13 +01:00
Bastian Kleineidam
6d0fffd825 Always use connection pooling. 2013-02-12 17:55:13 +01:00
Bastian Kleineidam
82ada5fba0 Updated copyright. 2013-02-11 19:54:50 +01:00
Bastian Kleineidam
a35c54525d Work around a bug in python requests. 2013-02-11 19:52:59 +01:00
Bastian Kleineidam
14f0a6fe78 Do not prefetch content with requests >= 1.0 2013-02-11 19:45:21 +01:00
Bastian Kleineidam
67836942d8 Simplify the fetchUrl code. 2013-02-11 19:43:46 +01:00
Bastian Kleineidam
3f0816efe2 Updated copyright 2013-02-10 18:25:21 +01:00
Bastian Kleineidam
9fa9af639b Remove duplicate comic. 2013-02-10 18:24:21 +01:00
Bastian Kleineidam
1c24fca199 Updated comic from generated lists. 2013-02-10 15:07:21 +01:00
wummel
a61c4b4096 Merge pull request #6 from TobiX/for-upstream-2013-02-08 
Fix for Spinnerette, 2 new comics
 2013-02-09 23:03:45 -08:00
Bastian Kleineidam
e9b63210f9 Add encoding, inline images and guid tags to RSS output. 2013-02-10 08:00:32 +01:00
Bastian Kleineidam
77f3d152c0 Fix imageSearch pattern. 2013-02-08 21:03:23 +01:00
Tobias Gruetzmacher
e67b86c32f Add ParadigmShift. 
The file names for this are a bit inconsistent...
 2013-02-07 23:57:34 +01:00
Tobias Gruetzmacher
4b6d7c54af Add SkinDeep. 
Filenames for this are all over the place :(
 2013-02-07 23:57:34 +01:00
Tobias Gruetzmacher
b32dc6fd40 Fix Spinnerette. 
The old expression was matching "Previous issue" first and skipping all
comics.
 2013-02-07 23:57:34 +01:00
Bastian Kleineidam
419ae5fbcf Raise ValueError when HTML file already exists. 2013-02-07 20:48:03 +01:00
Bastian Kleineidam
1a0cd1ee6b Print HTTP client headers. 2013-02-07 18:28:56 +01:00
Bastian Kleineidam
e16b86d768 Allow debug level to be set. 2013-02-07 18:28:40 +01:00
Bastian Kleineidam
68d58640e8 Added some comics. 2013-02-06 22:27:40 +01:00
Bastian Kleineidam
c19cb93a14 Added some comics. 2013-02-06 22:08:36 +01:00
Bastian Kleineidam
137e30b3ac Added Nedroid comic strip. 2013-02-06 07:03:29 +01:00
Bastian Kleineidam
052e510085 Added HijinksEnsue comic strip. 2013-02-06 06:58:06 +01:00
Bastian Kleineidam
af9d8e90f0 Add missing url variable. 2013-02-06 06:36:50 +01:00
Bastian Kleineidam
a90875f018 Updated copyright. 2013-02-05 19:52:10 +01:00
Bastian Kleineidam
f18b5d5542 Fix Arcamax comics. 2013-02-05 19:51:55 +01:00
Bastian Kleineidam
1451047877 Rename latestUrl in url 2013-02-05 19:51:46 +01:00
Bastian Kleineidam
7f78bea1af Always have an url attribute in comic scrapers. 2013-02-04 21:00:26 +01:00
Bastian Kleineidam
77b8daf2f9 Add Spinnerette comic. 2013-01-29 21:52:26 +01:00
Bastian Kleineidam
4a63f5d561 Add GrrlPower comic. 2013-01-29 21:42:10 +01:00
Bastian Kleineidam
f727a0132f Add VampireCheerleader comic. 2013-01-29 21:23:59 +01:00
Bastian Kleineidam
a96b527f98 Add SequentialArt comic. 2013-01-29 21:23:32 +01:00
Bastian Kleineidam
8b04602c7b Fix GunnerkrigCourt 2013-01-29 19:00:29 +01:00
Bastian Kleineidam
4ab5b67f2e Improve comic strip message. 2013-01-29 18:51:35 +01:00
Bastian Kleineidam
0095f17b4e Updated copyright. 2013-01-28 18:52:26 +01:00
Bastian Kleineidam
e6d35c6494 Updated comic lists. 2013-01-28 06:53:12 +01:00
Bastian Kleineidam
73700e66f0 Cleanup 2013-01-24 21:42:27 +01:00
Bastian Kleineidam
4b35d332dc Fix DrFun image regex. 2013-01-24 07:53:47 +01:00
Bastian Kleineidam
51d0176f53 Fix CyanideAndHappiness image regex - really. 2013-01-23 21:53:34 +01:00
Bastian Kleineidam
399cda21e5 Fix CyanideAndHappiness image regex. 2013-01-23 21:35:36 +01:00
Bastian Kleineidam
f1356a9ff8 Fix URL norming, See issue #2. 2013-01-23 21:16:22 +01:00
Bastian Kleineidam
9ad4477d1f Retrieve more than one strip in index mode. 2013-01-23 20:21:52 +01:00
Bastian Kleineidam
95e1fbbe55 Fix LeastICouldDo. See issue #1. 2013-01-23 20:01:18 +01:00
Bastian Kleineidam
6477e570e1 Fix UnboundLocalError on indexed retrieval. See bug #4 2013-01-23 19:51:08 +01:00
Bastian Kleineidam
0e438b864e Add comic strips from Arcamax. 2013-01-23 19:34:11 +01:00
Bastian Kleineidam
d54d787af1 Better image filename for CyanideAndHappiness 2013-01-23 19:33:10 +01:00
Bastian Kleineidam
5479627d86 Updated copyright. 2013-01-09 22:21:19 +01:00
Bastian Kleineidam
39c83b8968 Truncate generated comic names. 2013-01-09 22:20:03 +01:00
Bastian Kleineidam
0da595963c Added AmazingSuperPowers comic. 2012-12-28 05:41:26 +01:00
Bastian Kleineidam
ad5c7667f1 Add PandyLand comic. 2012-12-28 05:37:08 +01:00
Bastian Kleineidam
a59b984414 Updated generated comic modules. 2012-12-19 20:43:32 +01:00
Bastian Kleineidam
6a2f57b132 Support requests module >= 1.0 2012-12-19 20:43:18 +01:00
Bastian Kleineidam
5f9e5ae3ca Various comics are fixed. 2012-12-13 21:05:27 +01:00
Bastian Kleineidam
de1b80fa4d Fix .zip file module loading. 2012-12-12 23:27:03 +01:00
Bastian Kleineidam
fcbace28b4 Load modules from .zip file. 2012-12-12 23:22:36 +01:00
Bastian Kleineidam
8d92a8f334 Updated colorama and info level of file messages. 2012-12-12 22:00:17 +01:00
Bastian Kleineidam
e5a04931d3 Various fixes and additions. 2012-12-12 17:41:29 +01:00
Bastian Kleineidam
6c0ad90c15 Cleanup 2012-12-09 20:15:22 +01:00
Bastian Kleineidam
3a3a800798 Make output thread-safe. 2012-12-09 18:12:41 +01:00
Bastian Kleineidam
75de0bc662 Added two more comics. 2012-12-09 18:12:21 +01:00
Bastian Kleineidam
5c34baa663 Capitalize comic names. 2012-12-09 07:51:49 +01:00
Bastian Kleineidam
0d9e1b4ef6 Added comics. 2012-12-08 21:30:51 +01:00
Bastian Kleineidam
4def4b81bd Add cookie feature. 2012-12-08 21:30:23 +01:00
Bastian Kleineidam
faba7b0bca Fix more comics. 2012-12-08 00:45:18 +01:00
Bastian Kleineidam
1b74e304c0 Updated comics. 2012-12-05 22:36:16 +01:00
Bastian Kleineidam
e5d9002f09 Fix more comics. 2012-12-05 21:52:52 +01:00
Bastian Kleineidam
387dff79a9 Fix comics. 2012-12-04 07:02:40 +01:00
Bastian Kleineidam
45df462a47 Fix some comics. 2012-12-02 18:35:06 +01:00
Bastian Kleineidam
bcae1b018c Add comic excludes in scripts. 2012-11-29 06:46:58 +01:00
Bastian Kleineidam
451fd982d9 Add comic scripts, add fixes and other stuff. 2012-11-28 18:15:12 +01:00
Bastian Kleineidam
a52e5ae575 Add more comics. 2012-11-26 19:41:25 +01:00
Bastian Kleineidam
0556ffd30a Fix comics, improve tests, use python-requests. 2012-11-26 18:44:31 +01:00
Bastian Kleineidam
d4eee7719d Dynamic type generation helpers. 2012-11-26 07:14:02 +01:00
Bastian Kleineidam
4528894c05 Fix some comics. 2012-11-26 07:13:32 +01:00
Bastian Kleineidam
7e91c83753 Improved comic test. 2012-11-25 07:56:46 +01:00
Bastian Kleineidam
958a788550 Fix some comics. 2012-11-21 21:57:26 +01:00
Bastian Kleineidam
54eaadf4fc Updated documentation and fix some comics. 2012-11-20 18:53:53 +01:00
Bastian Kleineidam
64d9fd6ac2 Require python 2.7, use importlib. 2012-11-19 21:20:50 +01:00
Bastian Kleineidam
7dbd14f934 Fix syntax errors. 2012-11-19 21:20:34 +01:00
Bastian Kleineidam
7e39b291dc Fix some comics 2012-11-14 20:23:30 +01:00
Bastian Kleineidam
31e7ddbd7c Fix some comics. 2012-11-14 06:22:08 +01:00
Bastian Kleineidam
eba2f0089d Fix some comics. 2012-11-13 19:12:28 +01:00
Bastian Kleineidam
5006ed7f40 Rename imageUrl to stripUrl. 2012-11-13 19:10:19 +01:00
Bastian Kleineidam
e4600df1bd Fix some comics. 2012-11-13 06:51:54 +01:00
Bastian Kleineidam
30a28cdb3e Fix some comics. 2012-11-12 18:59:19 +01:00
Bastian Kleineidam
a5108dfb45 Fix copyright. 2012-10-12 22:15:40 +02:00
Bastian Kleineidam
1f1a5f2b3c Improve error message. 2012-10-12 22:10:26 +02:00
Bastian Kleineidam
7a70cd79ca Fix event handling. 2012-10-12 22:07:50 +02:00
Bastian Kleineidam
7bf54255f0 Fix some comics 2012-10-12 21:47:57 +02:00
Bastian Kleineidam
b3e51ddc93 Simplify tagre regex. 2012-10-12 21:47:41 +02:00
Bastian Kleineidam
9c032c9006 Match before and after a tag. 2012-10-12 21:11:44 +02:00
Bastian Kleineidam
67939b3d71 Fix comics. 2012-10-11 21:32:15 +02:00
Bastian Kleineidam
da2b13822d Remove stray print statement. 2012-10-11 19:58:10 +02:00
Bastian Kleineidam
06008d4266 Fix indexed retrieval. 2012-10-11 19:53:37 +02:00
Bastian Kleineidam
78f44e9d9c Improve URL retrieval. 2012-10-11 19:53:10 +02:00
Bastian Kleineidam
65d881eee5 Code cleanup. 2012-10-11 19:52:52 +02:00
Bastian Kleineidam
c0ad053647 Prevent empty URL matching. 2012-10-11 18:16:29 +02:00
Bastian Kleineidam
21de295168 Remove progress stuff. 2012-10-11 18:08:59 +02:00
Bastian Kleineidam
3d96adc3ff Remove progress stuff. 2012-10-11 18:08:18 +02:00
Bastian Kleineidam
194d1e28b1 Add more documentation. 2012-10-11 18:02:29 +02:00
Bastian Kleineidam
4470e13b1a Fix some comics. 2012-10-11 17:39:38 +02:00
Bastian Kleineidam
979c97901b Fix tagre tests. 2012-10-11 17:02:40 +02:00
Bastian Kleineidam
ecfc88faf1 Fix comics. 2012-10-11 16:06:45 +02:00
Bastian Kleineidam
db1df21b58 Fix comic filename. 2012-10-11 15:58:54 +02:00
Bastian Kleineidam
17a40d4fda Make tagre quote configurable. 2012-10-11 15:43:29 +02:00
Bastian Kleineidam
9d30a7004e Only warn about missing images. 2012-10-11 15:17:08 +02:00
Bastian Kleineidam
a7036beef7 Sort loaded plugins. 2012-10-11 14:45:06 +02:00
Bastian Kleineidam
30a64ab1e5 Remove unused imports. 2012-10-11 14:17:37 +02:00
Bastian Kleineidam
c707aa893d A lot of refactoring. 2012-10-11 12:03:12 +02:00
Bastian Kleineidam
c1dc5892c8 Only import colorama on windows systems. 2012-10-01 18:01:56 +02:00
Bastian Kleineidam
a53e1f63bc Improve console size guessing. 2012-09-27 21:59:11 +02:00
Bastian Kleineidam
86e3aa6c1a Add Fredo And Pidjin 2012-09-27 21:55:16 +02:00
Bastian Kleineidam
3ab526f7d8 Fix 2012-09-27 21:54:56 +02:00
Bastian Kleineidam
f3365f6a5e Code cleanup. 2012-09-27 21:24:28 +02:00
Bastian Kleineidam
1333be7225 HTTP improvements. 2012-09-26 16:52:45 +02:00
Bastian Kleineidam
cc2a8df98f Document some functions. 2012-09-26 16:47:39 +02:00
Bastian Kleineidam
4a53639e79 Use tagre matching function. 2012-09-26 14:42:28 +02:00
Bastian Kleineidam
58c4cffcc8 Match end bracket in tagre function. 2012-09-26 14:42:05 +02:00
Bastian Kleineidam
e79649a9ad Fix AGirlAndHerFed. 2012-09-24 20:52:08 +02:00
Bastian Kleineidam
a17782428b Updated copyright for all source files. 2012-06-20 22:41:04 +02:00
Bastian Kleineidam
c9082aee42 Improved terminal functions. 2012-06-20 22:33:26 +02:00
Bastian Kleineidam
f91fb80a39 Initial commit to Github. 2012-06-20 21:58:13 +02:00