User-agent: Googlebot Disallow: /assets/ User-agent: MSNbot Disallow: /assets/ User-Agent: bingbot Disallow: / Crawl-Delay: 200