User-agent: Slurp
Crawl-delay: 0.5
User-agent: msnbot
Crawl-delay: 60
User-agent: baiduspider
Crawl-delay: 1
User-agent: *

Allow: /