View Single Post
Posts: 31 | Thanked: 0 times | Joined on Aug 2007 @ Amsterdam
#11
Originally Posted by Dom Queron View Post
Using wget it is easily possible to mirror d20srd.org to your n800, giving you access to all important d20 documentation locally. This is quite useful as a player or dm alike as information on every topic (spells, feats, rules, monsters, etc.) can be reached in about 2-3 clicks instead of checking through several books.

There a bunch of 'issues' one needs to take care off to successfully mirror the page, easily fixed by wget options:

- convert links for local viewing -k
- ensure to set the user agent to mozilla or IE 5+ --user-agent="Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322; .NET CLR 2.0.50727)"
- tell wget to mirror 4 levels deep -r 4
- tell wget to ignore any files ending on .cgi (the page uses links embedded in the source and only visible to tools like wget to a blacklist cgi that bans your IP from accessing the server if your client demands the file) -R "cgi"
- use the random wait function when mirroring the page. --random-wait

The whole package has about 70 megs of data, so make sure to save to mmc if you don't boot from an large enough mmc partition.

enjoy
I agree, the d20SRD is an amazing local resource.

The remote mirroring works of course, but you could (like me) support the project for $15 a year - which allows you to download a zip of the site optimized for local access. Wholesale mirroring actually costs them bandwidth. Its not much IMHO, and it pays to keep it maintained. http://www.d20srd.org/subscribe.htm

With subscription you also get a local javascript based search engine and the other javascript tools. I've already posted to the support forum to address the issues i've been having, so will get even better

Last edited by gotanga; 2007-08-28 at 20:22.