whitters's Bookmarks About Robots exclusion standard

Help on Robots.txt

by whitters 2009-11-02 05:02 robot exclusion rules · robots

http://forums.oscommerce.com/index.php?showtopic=126617 - cached - mail it - history

Nikita The Spider - A Robot Exclusion Rules Parser for Python

by whitters 2009-11-02 04:46 robot exclusion rules · robots · robots.txt · protocol · crawlers

http://nikitathespider.com/python/rerp/ - cached - mail it - history

Robots exclusion standard - Wikipedia, the free encyclopedia

by whitters 2009-07-04 09:17 robot exclusion rules · robots.txt · robots · crawlers · standards

http://en.wikipedia.org/wiki/Robots_exclusion_standard - cached - mail it - history

Introduction to "robots.txt"

by whitters 2009-06-13 17:20 robot exclusion rules · robots.txt · robots · protocol · web-server

http://www.javascriptkit.com/howto/robots.shtml - cached - mail it - history

The Web Robots Pages

by whitters 2009-06-08 05:18 robot exclusion rules · robots · robots.txt · protocol

http://www.robotstxt.org/orig.html - cached - mail it - history

Guidelines, Patterns, and Code for End-to-End Java Applications

Recommended directory/folder layout for developing and deploying Java applications. Includes webapp recommendations and multi-webapp projects.

by whitters 2006-06-09 08:33 java · j2ee · standard · development · project · structure · layout · webapp · deployment · guidelines

http://java.sun.com/blueprints/code/projectconventions.html - cached - mail it - history