User-agent: Zao User-agent: WebVac User-agent: Openbot User-agent: Pita User-agent: Stanford User-agent: Jetbot User-agent: Stanford Spiderboys User-agent: Stanford CompSciClub User-agent: Stanford CompClub User-agent: dumbot User-agent: Hatena Antenna User-agent: grub-client User-agent: grub User-agent: larbin User-agent: b2w/0.1 User-agent: Copernic User-agent: NetMechanic User-agent: Googlebot-Image User-agent: URL_Spider_Pro User-agent: CherryPicker User-agent: EmailCollector User-agent: EmailSiphon User-agent: WebBandit User-agent: EmailWolf User-agent: ExtractorPro User-agent: CopyRightCheck User-agent: Crescent User-agent: SiteSnagger User-agent: ProWebWalker User-agent: CheeseBot User-agent: LNSpiderguy User-agent: Telesoft User-agent: Website Quester User-agent: WebZip/4.0 User-agent: WebStripper User-agent: WebSauger User-agent: WebCopier User-agent: NetAnts User-agent: Mister PiX User-agent: WebAuto User-agent: TheNomad User-agent: WWW-Collector-E User-agent: RMA User-agent: lUser-agent: RMA User-agent: libWeb/clsHTTP User-agent: asterias User-agent: httplib User-agent: turingos User-agent: spanner User-agent: psbot User-agent: freefind User-agent: BecomeBot User-agent: ichiro@nttr.co.jp User-agent: Baiduspider User-agent: Yandex User-agent: moget User-agent: ichiro User-agent: NaverBot User-agent: Yeti User-agent: Baiduspider-video User-agent: Baiduspider-image User-agent: sogou spider User-agent: YoudaoBot User-agent: ExaBot User-agent: AhrefsBot User-agent: MJ12bot Disallow: / User-agent:* Crawl-delay: 3