User-agent: rogerbot Disallow: /Search Crawl-delay: 10 User-agent: * Disallow: /sitecore Disallow: /Sitecore Disallow: /SITECORE Disallow: /sitecore_files/ Disallow: /sitecore modules/ Disallow: /App_Browsers/ Disallow: /App_config/ Disallow: /App_Data/ Disallow: /temp/ Disallow: /upload/ Disallow: /xsl/ Disallow: /Search Disallow: /mba2/no-index Sitemap: https://www.mba.com/sitemap.xml