# All robots will spider the domain User-agent: * Disallow: /cgi-bin/ Disallow: /icons/ Disallow: /cache/ Disallow: /search/ Disallow: /images/ Disallow: /thumbs/ Disallow: /thumbnails/ Disallow: /photogalleries/ Disallow: /galleries/ Disallow: /pics/ Disallow: /mania/