# robots.txt for http://www.math.uu.se/ # see for an explanation. #To be continued User-agent: * # We ask spiders to avoid Disallow: /cgi-bin/ # Script files Disallow: /momspider/ # Results from MOMspider Disallow: /~grenholm/bullen/ # Only temporary stuff Disallow: /old/ # Old stuff Disallow: /stats/ # Old statistics Disallow: /reports/ # New statistics Disallow: /LinkScan/ # Link scan program Disallow: /studie/old/ # Old studie stuff Disallow: /graduate/ # Inaccurate graduate stuff Disallow: /internt/ # Intern information Disallow: /errordocs/ # Felmeddelanden Disallow: /inform/old_info/ # Old information messages Disallow: /webmaster/ # Webmaster tools etc. Disallow: /utils/ Disallow: /icalendar/