Sitemap: <sitemap.txt>
User-agent: *
Disallow: /cbi/
Disallow: /shortie/
Disallow: /dbaseload/
Disallow: /archive/
Disallow: /test/
Disallow: /reports/