Links for noncrawl
noncrawl-0.1.tar.gz
http://creativecommons.org/licenses/by-sa/3.0/
http://docs.python.org/library/fnmatch.html
http://docs.python.org/library/re.html
http://metanohi.org/projects/noncrawl/
mailto:ns@metanohi.org