# robots.txt for http://www.thought.org/ User-agent: *.php User-agent: *.shtml User-agent: *.html User-agent: Mediapartners-Google* Allow: /Graphics/ Allow: /urllist.txt Allow: /prose/ Disallow: /RCS/ Disallow: /cgi-bin/