# http://info.webcrawler.com/mak/projects/robots/robots.html User-agent: * # just a test side here: # Disallow: / # of no interest: Disallow: /icons/ # only local use: Disallow: /doc/