User-Agent: * Disallow: /cgi-bin/ Disallow: /*.gif$ Disallow: /*.GIF$ Disallow: /*.jpg$ Disallow: /*.JPG$ Disallow: /*.jpeg$ Disallow: /*.JPEG$ Disallow: /*.mid$ Disallow: /*.MID$ Disallow: /*.wav$ Disallow: /*.WAV$ Disallow: /*.mp3$ Disallow: /*.MP3$ User-Agent: MJ12bot Crawl-Delay: 5 User-agent: baiduspider Crawl-Delay: 300 User-agent: Baiduspider+ Crawl-Delay: 300 User-agent: naverbot Crawl-Delay: 300 User-agent: yeti Crawl-Delay: 300 User-agent: Yetibot Crawl-Delay: 300