# /robots.txt file for http://automation.tkk.fi User-agent: Slurp Disallow: /edu/ Crawl-delay: 1200 User-agent: msnbot Disallow: /edu/ Crawl-delay: 1200 User-agent: * Disallow: /edu/