User-agent: Slurp
Crawl-delay: 3
Allow: /