# See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file User-agent: * Disallow: / User-agent: Googlebot Allow: / Disallow: /internal User-agent: bingbot Allow: / Disallow: /internal