# NO access (Goo, Griffon, Hämähäkki, Ingrid, Kvasir, Lisa, NetScoop, ODiN, Openfind, kensaku.jp) User-agent: moget User-agent: griffon User-agent: Hämähäkki User-agent: INGRID/0.1 User-agent: solbot User-agent: Voyager/0.0 User-agent: NetScoop User-agent: Valkyrie libwww-perl User-agent: openbot User-agent: suke Disallow: / # NO access (e-collector, CMC/0.01) User-agent: ecollector User-agent: CMC/0.01 Disallow: / # PARTIAL access (newscan, Legs) User-agent: newscan-online User-agent: legs Disallow: /cgi-bin/ # PARTIAL access (All Spiders) User-agent: *