User-agent: * Disallow: /web_users/ Disallow: /anon_ftp/ Allow: /subdomains/ Disallow: /httpsdocs/ Disallow: /cgi-bin/ Disallow: /private/ Disallow: /vault_scripts/ Allow: / Allow: /error_docs/ Disallow: /statistics/ Allow: /httpdocs/