User-agent: twiceler
Crawl-delay: 20
User-Agent: gigabot
Crawl-Delay: 20
User-agent: ia_archiver
Crawl-delay: 20
User-agent: Baiduspider
Crawl-delay: 20