# robots.txt for http://www.dinodatabase.com/ # exclude some access-controlled areas User-agent: Mediapartners-Google* Disallow: User-agent: * Disallow: /cgi-bin/ Disallow: /stats/ Disallow: /db/ Disallow: /inc/ Disallow: /java/ Disallow: /wave/