# Robots.txt file from http://www.searchengineworld.com # # All robots will spider the domain User-agent: * Disallow: /_OLD/ Disallow: /test/ Disallow: /test2/ Disallow: /test3/ Disallow: /test/newsite/ Disallow: 1.swf/ Disallow: 2.swf/ Disallow: /collaboration/ Disallow: /collaboration2/