# $Id: robots.txt,v 1.12 2002/10/23 19:16:19 kapil Exp $ # # This is a file retrieved by webwalkers a.k.a. spiders that # conform to a defacto standard. # See # # The webmaster for this site is # Format is: # User-agent: # Disallow: | # Flag Date By Reason # $l1- 19950130 epc finally understood what the file was for! # $L2= 19960909 epc fixed url since mak moved to Webcrawler... # $L3= 19970811 epc drop /Stretch # $L4= 19991102 krusch fixed User-agent capitalization and contact info # $L5= 20010327 krusch Updated disallow rules # ----------------------------------------------------------------------------- User-agent: * Disallow: /Admin Disallow: /admin Disallow: /design Disallow: /cgi-bin Disallow: /restricted Disallow: /_private Disallow: /auth Disallow: /photo Disallow: /poem Disallow: /portrait Disallow: /thumbnails