User-agent: * Disallow: /cgi-bin/ Disallow: /sitefiles/js/ Disallow: /sitefiles/pages/