# All robots will spider the domain User-agent: * Disallow: /audio/ Disallow: /banners/ Disallow: /Scripts/ Disallow: /team_logos/ Disallow: /img/ Disallow: /cgi-bin/ Disallow: parse2.php User-agent: spider Disallow: /