############################### # # robots.txt file for the DEIS website # # addresses all robots by using wild card * # User-agent: * # list folders robots are not allowed to index Disallow: /admin/ Disallow: /Connections/ Disallow: /CourseBuilder/ Disallow: /css/ Disallow: /deis-archive/ Disallow: /ec2k/ Disallow: /ec2k_original/ Disallow: /ec2k_test/ Disallow: /extra/ Disallow: /images/ Disallow: /include/ Disallow: /library/ Disallow: /metatraffic2/ Disallow: /templates/ Disallow: /templates/ Disallow: /test/ Disallow: /spectrum2/ Disallow: /spectrum3/ # # list specific files robots are not allowed to index # Disallow: /error_404.asp # # End of robots.txt file # ###############################