User-agent: * # directed to all spiders, not just Scooter Disallow: /cgi-bin/ Disallow: /_private/ Disallow: /__cruiser__ Disallow: /bastard Disallow: /cgi-local Disallow: /conf Disallow: /mpc Disallow: /pub Disallow: /stats Disallow: /etc