User-Agent: * Allow: / User-Agent: Mediapartners-Google Allow: / User-Agent: Googlebot Allow: / User-Agent: Adsbot-Google Allow: / User-Agent: GOOGLEBOT Allow: / User-Agent: Googlebot/2.1 Allow: / User-Agent: Googlebot/2.0 beta Allow: / User-Agent: Googlebot/2.1 Allow: / User-Agent: Googlebot/2.0 Allow: / User-Agent: Googlebot/1.0 Allow: / User-Agent: Googlebot/2.1w Allow: / User-Agent: Googlebot-w/2.1 Allow: / User-Agent: Googlebot/2.1 (+http://www.googlebot.com/bot.html) Allow: / User-Agent: Googlebot/2.0 beta (googlebot(at)googlebot.com) Allow: / User-Agent: Googlebot/2.1 (+http://googlebot.com/bot.html) Allow: / User-Agent: Googlebot/2.0 (+http://googlebot.com/bot.html) Allow: / User-Agent: 0.1_hseo(at)cs.rutgers.edu=Rutgers.edu Allow: / User-Agent: 192.comAgent=192.com Allow: / User-Agent: 4anything.com=4Anything.com Allow: / User-Agent: abot/0.1=Abot.com Allow: / User-Agent: abot/0.1 (abot; http://www.abot.com; abot@abot.com)=Abot.com Allow: / User-Agent: abcdatos_botlink=Abcdatos.com Allow: / User-Agent: About=About.com Allow: / User-Agent: Ack=Ackerm.com Allow: / User-Agent: Acoon=Acoon.de Allow: / User-Agent: Acorn=Acorn Search Allow: / User-Agent: ActiveWorlds/3.xx=ActiveWorlds.com Allow: / User-Agent: admin@crawler.de=Crawler.deadmin@crawler.de=Crawler.de Allow: / User-Agent: ADSARobot=ADSARobot Allow: / User-Agent: AESOP=AESOP.com Allow: / User-Agent: AESOP_com_SpiderMan=Aesop.com Allow: / User-Agent: Agadine=Agada.de Allow: / User-Agent: Agent-admin/=Daum.net Allow: / User-Agent: AgentName/0.1 libwww-perl/5.48=LinkoMatic.com Link Checker Allow: / User-Agent: ah-ha.com crawler=Ah-ha.com Allow: / User-Agent: AIBOT=21Seek.com Allow: / User-Agent: AIBOT/2.1=21Seek.com Allow: / User-Agent: aipbot=NameProtect.com Allow: / User-Agent: aipbot/1.0=NameProtect.com Allow: / User-Agent: aipbot/1.0 (aipbot; http://www.aipbot.com; aipbot@aipbot.com)=NameProtect.com Allow: / User-Agent: Aladin=Aladin.de Allow: / User-Agent: Aladin/3.324=Aladin.de Allow: / User-Agent: Aleksika=Aleksika.com Allow: / User-Agent: Aleksika Spider/1.0=Aleksika.de Allow: / User-Agent: ALink=ALink Link Checker Allow: / User-Agent: AlkalineBOT=AlkalineBOT Allow: / User-Agent: AlkalineBOT/1.3=Vestris.com Allow: / User-Agent: Allesklar=Allesklar.de Allow: / User-Agent: Allesklar/0.1 libwww-perl/5.46=Allesklar.de Allow: / User-Agent: AltaVista=AltaVista.com Allow: / User-Agent: AltaVista-Intranet=Altavista.co.uk Allow: / User-Agent: AMeta=AMeta Link Checker Allow: / User-Agent: Amfibi=Amfibi.com Allow: / User-Agent: AmfibiBOT=Amfibi.com Allow: / User-Agent: Amibot=Amidalla.com Allow: / User-Agent: Amiga-AWeb/3.4.167SE=AWeb.com Allow: / User-Agent: amzn_assoc=Amazon.com Allow: / User-Agent: amzn_assocamzn_assoc=Amazon Allow: / User-Agent: AnnoMille=Annomille.it Allow: / User-Agent: AnswerBus=AnswerBus.com Allow: / User-Agent: AnswerChase=AnswerChase.com Allow: / User-Agent: AnswerChase PROve x.0=AnswerChase.com Allow: / User-Agent: AnswerChase x.0=AnwserChase.com Allow: / User-Agent: Antibot=AntiSeach.net Allow: / User-Agent: antibot-V1.1.5/i586-linux-2.2=AntiSeach.net Allow: / User-Agent: AnzwersCrawl=Yahoo!7 Answers Allow: / User-Agent: AnzwersCrawl/2.0=Anzwers Allow: / User-Agent: Apexoo=Apexoo.com Allow: / User-Agent: Aport=Aport.ru Allow: / User-Agent: appie=Walhello.com Allow: / User-Agent: appie 1.1=Walhello.com Allow: / User-Agent: Arachnoidea=Euroseek.com CONTENT Allow: / User-Agent: arachnoidea@euroseek.net=Euroseek.net Allow: / User-Agent: Aranha=Girafa.com Allow: / User-Agent: ArchitectSpider=Excite.com Allow: / User-Agent: ArchitextSpider=excite.com Allow: / User-Agent: archive.org=Archive.org Allow: / User-Agent: archive.org_bot=Archive.org Allow: / User-Agent: archive_org=Archive.org Allow: / User-Agent: Arikus_Spider=Arikus.com Allow: / User-Agent: ASAHA=Asaha.com Allow: / User-Agent: Asahina=Asahina Bot Allow: / User-Agent: ask jeeves=Ask Jeeves Allow: / User-Agent: ask.24x.info=Ask.24x.info Allow: / User-Agent: AskAboutOil=AskAboutOil.com Allow: / User-Agent: Asked=Asked.jp Allow: / User-Agent: ASPSearch URL Checker= ASPSearch Link Checker Allow: / User-Agent: ASPSeek=ASPSeek.org Allow: / User-Agent: ASPSeek/1.2.5=ASPSeek.org Allow: / User-Agent: ASPseek/1.2.9d=ASPSeek.com Allow: / User-Agent: ASPSeek/1.2.x=ASPSeek.org Allow: / User-Agent: ASPSeek/1.2.xa=ASPSeek.org Allow: / User-Agent: ASPseek/1.2.xx=ASPseek.org Allow: / User-Agent: ASPSeek/1.2.xxpre=ASPSeek.org Allow: / User-Agent: Asterias=SingingFish.com Allow: / User-Agent: asterias/2.0=SingingFish.com Allow: / User-Agent: Atlocal=Local.com Allow: / User-Agent: AtlocalBot=Atlocal.com Allow: / User-Agent: AtlocalBot/1.1 +(http://www.atlocal.com/local-web-site-owner.html)=Atlocal.com Allow: / User-Agent: Atomz=Atomz.com Allow: / User-Agent: Atomz/1.0=Atomz.com Allow: / User-Agent: atSpider/1.0=atSpider Email Extractor Allow: / User-Agent: Augurfind=Augurnet.ch Allow: / User-Agent: augurnfind V-1.x=Augurnet.ch Allow: / User-Agent: autoemailspider=Auto Email Extractor Allow: / User-Agent: autohttp=Elsop.com Allow: / User-Agent: AV Fetch 1.0=Altavista.com Allow: / User-Agent: AVSearch=Altavista.com Allow: / User-Agent: AVSearch-1.0(peter.turney@nrc.ca)=NRC-CNRC.gc.ca Allow: / User-Agent: AVSearch-3.0=Altavista.com Allow: / User-Agent: AVSearch-3.0(AltaVista/AVC)=AltaVista.com Allow: / User-Agent: Axadine=Axada.de Allow: / User-Agent: axadine/ (Axadine Crawler; http://www.axada.de/; )=Axada.de Allow: / User-Agent: AxmoRobot=Axmo.com Allow: / User-Agent: BaboomBot=Baboom.us Allow: / User-Agent: BaiDuSpider=Baidu.com Allow: / User-Agent: Baiduspider+=Baidu.com Allow: / User-Agent: Balihoo=Balihoo.comBalihoo=Balihoo.com Allow: / User-Agent: BanBots/1.2=Banbots.com Allow: / User-Agent: BarraHomeCrawler=BarraHome.com Allow: / User-Agent: Bdcindexer=Business.com Allow: / User-Agent: bdcindexer_2.6.2=Business.com Allow: / User-Agent: BDFetch=Brandimensions.com Allow: / User-Agent: BDNcentral Crawler v2.3=Bdncentral.com Allow: / User-Agent: Beautybot=Cosmoty.de Allow: / User-Agent: beautybot/1.0=Cosmoty.com beautybot/1.0=Cosmoty.com Allow: / User-Agent: BebopBot=APassion4Jazz.net Allow: / User-Agent: BecomeBot=Become.com Allow: / User-Agent: BeebwareDirectory/v0.01=Beepware.co.uk Link Checker Allow: / User-Agent: Big Brother=Big Brother Link Checker Allow: / User-Agent: crawler@alexa.com=Alexa.com Allow: / User-Agent: crawler@brainbot.com=Brainbot.com Allow: / User-Agent: crawler@fast.no=Alltheweb.com Allow: / User-Agent: CrawlerBoy=Pinpoint.com Allow: / User-Agent: CrawlerBoy Pinpoint.com=Pinpoint.com Allow: / User-Agent: Crawllybot=Crawlly.com Allow: / User-Agent: CreativeCommons=CreativeCommons.com Allow: / User-Agent: CreativeCommons/0.06-dev= CreativeCommons.org Allow: / User-Agent: Crescent Internet ToolPak HTTP OLE Control v.1.0=Crescent Email Extractor Allow: / User-Agent: CrocCrawler= CrocCrawler.com Allow: / User-Agent: CSE HTML Validator= CSE HTML Link Checker Allow: / User-Agent: CurryGuide SiteScan 1.1=CurryGuide Link Checker Allow: / User-Agent: Custom Spider www.bisnisseek.com=Bisnisseek.com Allow: / User-Agent: CydralSpider=Cydral.com Allow: / User-Agent: DaAdLe.com ROBOT=daadle.com Allow: / User-Agent: DaAdLe.com ROBOT/=Daadle.com Allow: / User-Agent: DataFountains=Infomine.ucr.edu Allow: / User-Agent: DataparkSearch=DataParkSearch.org Allow: / User-Agent: DataparkSearch/4.xx=DataparkSearch.com Allow: / User-Agent: DataSpear=DataSpear.com Allow: / User-Agent: DaviesBot=Wholeweb.net Allow: / User-Agent: DaviesBot/1.7=Wholeweb.net Allow: / User-Agent: dbDig=Prairielandconsulting.com Allow: / User-Agent: DBrowse 1.4b=DBrowse Bot Allow: / User-Agent: DeepIndex=DeepIndex.com Allow: / User-Agent: DeepIndexer.ca=DeepIndex.com Allow: / User-Agent: deepweb=Deepweb.com Allow: / User-Agent: Demo Bot DOT 16b= Btopenworld.com Allow: / User-Agent: dev-spider2.searchpsider.com=SearchSpider.com Allow: / User-Agent: DiaGem/=Skyrocket.gr.jp Allow: / User-Agent: Diamond=SearchScout.com Allow: / User-Agent: Diamond/1.0=Searchscout.com Allow: / User-Agent: Digger=Diggit.com Allow: / User-Agent: Digger/1.0 JDK/1.3.0rc3=Diggit.com Allow: / User-Agent: Digimarc WebReader=Digimarc.com Allow: / User-Agent: DigOut4U=Arisem.com Allow: / User-Agent: DIIbot=Digital-Integrity.com Allow: / User-Agent: DIIbot/1.2=Digital-Integrity.com Allow: / User-Agent: DISCo Watchman= DISCo Watchman Link Checker Allow: / User-Agent: DittoSpyder=Ditto.com Allow: / User-Agent: dloader(NaverRobot)=naver.com Allow: / User-Agent: DoCoMo=Nttdocomo.co.jp Allow: / User-Agent: DoctorHTML= DoctorHTML Link Checker Allow: / User-Agent: DreamCatcher=Idaji.com Allow: / User-Agent: Drecombot=Drecom.co.jp Allow: / User-Agent: DRKSpider= DRKSpider Link Checker Allow: / User-Agent: dtSearchSpider=Dtsearch.com Allow: / User-Agent: Dumbot=DumbFind.com Allow: / User-Agent: e-SocietyRobot=yama.info.waseda.ac.jp Allow: / User-Agent: EARTHCOM=EarthCom.com Allow: / User-Agent: EARTHCOM.info/1.4beta=Earthcom.info Allow: / User-Agent: EasyDL=Keywen.com Allow: / User-Agent: EasyDL/3.02=Keywen.com Allow: / User-Agent: EasyDL/3.03=Keywen.com Allow: / User-Agent: EasyDL/3.04=Keywen.com Allow: / User-Agent: EasyDL/3.xx=Keywen.com Allow: / User-Agent: EasyDL/3.xx http://keywen.com/Encyclopedia/Bot=Keywen.com Allow: / User-Agent: eBot=Elchron.cz Allow: / User-Agent: EchO!=Echo.fr Allow: / User-Agent: EchO!/2.0=Voila.com Allow: / User-Agent: egothor/3.0a=Xdefine.com Allow: / User-Agent: EgotoBot/4.8=Egoto.com Allow: / User-Agent: ejupiter=ejupiter.com Allow: / User-Agent: EldoS TimelyWeb/3.x=TimelyWeb Link Checker Allow: / User-Agent: elfbot=uChoose.de Allow: / User-Agent: Email Extractor=Email Extractor Allow: / User-Agent: EmailSiphon= EmailSiphon Extractor Allow: / User-Agent: EmailWolf=EmailWolf Extractor Allow: / User-Agent: EmailWolf 1.00=EmailWolf Extractor Allow: / User-Agent: EMPAS=EMPAS.com Allow: / User-Agent: Enterprise_Search=Innerprise.net Allow: / User-Agent: Enterprise_Search/1.0=Innerprise.net Allow: / User-Agent: Enterprise_Search/1.0.xxx=Innerprise.net Allow: / User-Agent: Envolk=Envolk.com Allow: / User-Agent: erik@malfunction.org=Malfunction.org Allow: / User-Agent: EroCrawler=Erocrawler.com Allow: / User-Agent: ES.NET_Crawler=Innerprise.net Allow: / User-Agent: ES.NET_Crawler/2.0=Innerprise.net Allow: / User-Agent: eseek-larbin_2.6.2=Exactseek.com Allow: / User-Agent: ESISmartSpider=Travel-Finder.com Allow: / User-Agent: eStyleSearch 4=e-styleisp.ru Allow: / User-Agent: EuripBot=Eurip.com Allow: / User-Agent: EvaalSE=Evaal.com Allow: / User-Agent: Eventax=Eventax.de Allow: / User-Agent: Everest-Vulcan=Vulcan.com Allow: / User-Agent: Exabot=Exabot.com Allow: / User-Agent: ExactSeek=ExactSeek.com Allow: / User-Agent: ExactSeek Crawler/0.1=Exactseek.com Allow: / User-Agent: exactseek-crawler-2.63=Exactseek.com Allow: / User-Agent: Exalead NG/MimeLive Client=Exabot.com Allow: / User-Agent: Excalibur Internet Spider V6.5.4=Excalib.com Allow: / User-Agent: excite=Excite.comExecrawl=Execrawl.com Allow: / User-Agent: ExperimentalHenrytheMiragoRobot=Mirago.co.uk Allow: / User-Agent: EyeCatcher=Download-tipp.de Allow: / User-Agent: EyeCatcher (Download-tipp.de)/1.0=Download-tipp.de Allow: / User-Agent: EZResult=Ezresults.com Allow: / User-Agent: Fast Crawler Gold Edition=Alltheweb.com Allow: / User-Agent: FAST Enterprise Crawler=AllTheWeb.com Allow: / User-Agent: FAST Enterprise Crawler 6=Alltheweb.com Allow: / User-Agent: FAST-WebCrawler/2.2.6=Altheweb.com Allow: / User-Agent: FAST-WebCrawler/2.2.7=Altheweb.com Allow: / User-Agent: FastCrawler 3.0.1 (crawler@1klik.dk)=Alltheweb.com Allow: / User-Agent: =favo.eu=Favo.eu Allow: / User-Agent: FavOrg=FavOrg Link Checker Allow: / User-Agent: Favorites Sweeper=Favorites Sweeper Link Checker Allow: / User-Agent: Faxobot=Faxo.com Allow: / User-Agent: Faxobot/1.0=FaXo.com Allow: / User-Agent: Feed Seeker Bot=MyNewFavoriteThing.com Allow: / User-Agent: Feed24.com=Feed24.com Allow: / User-Agent: Feedfetcher-Google=Google RSS Bot Allow: / User-Agent: Feedster Crawler=Feedster.com Allow: / User-Agent: Felix=Mixcat.com Allow: / User-Agent: Felix - Mixcat Crawler=Mixcat.com Allow: / User-Agent: FFC Trap Door Spider=Frequentfinders.com Allow: / User-Agent: fido/1.0 Harvest/1.4.pl2=Planet Search Allow: / User-Agent: Filangy=Filangy.com Allow: / User-Agent: FinaleRobot=expressus.com Allow: / User-Agent: FindAnISP.com=FindAnISP.com Allow: / User-Agent: FindAnISP.com_ISP_Finder_v99a=FindAnISP.com Allow: / User-Agent: Findexa= Findexa.no Allow: / User-Agent: Findexa Crawler=Findexa.no Allow: / User-Agent: FineBot=Finesearch.com Allow: / User-Agent: Firefly=Fireball.de Allow: / User-Agent: Firefly/1.0=Fireball.de Allow: / User-Agent: Flapbot=Flaptor.com Allow: / User-Agent: Flatlandbot=FlatlandIndustries.com Allow: / User-Agent: FlickBot 2.0 RPT-HTTPClient/0.3-3=DivX.com Allow: / User-Agent: Fluffy the spider=SearchHippo.com Allow: / User-Agent: Flunky=Metacarta.com Allow: / User-Agent: FocusedSampler/1.0=Almaden.IBM.com Allow: / User-Agent: Fooky.com=Fooky.com Allow: / User-Agent: Francis=Neomo.de Allow: / User-Agent: Franklin Locator 1.8=Franklin Spam Bot Allow: / User-Agent: FreeFind=FreeFind.com Allow: / User-Agent: FreeFind.com-SiteSearchEngine/1.0=Freefind.com Allow: / User-Agent: FreshLinks.exe= FreshLinks Link Checker Allow: / User-Agent: FreshNotes=FreshNotes.com Allow: / User-Agent: Funnel Web Profiler=Funnel Web Profiler Link Checker Allow: / User-Agent: FuseBulb=FuseBulb.com Allow: / User-Agent: FyberSearch=Fybersearch.com Allow: / User-Agent: FyberSpider=Fybersearch.com Allow: / User-Agent: Gagglebot=Gagglebot Allow: / User-Agent: GAIS Robot=Seed.net.tw Allow: / User-Agent: GAIS Robot/1.0B2=Seed.net.tw Allow: / User-Agent: Gaisbot=Gais.cs.ccu.edu.tw Allow: / User-Agent: Gaisbot/3.0=Seed.net.tw Allow: / User-Agent: Gaisbot/3.0+=Seed.net.tw Allow: / User-Agent: GalaxyBot=Galaxy.com Allow: / User-Agent: GalaxyBot/1.0=Galaxy.com Allow: / User-Agent: Gallent Search Spider=Gallent.co.uk Allow: / User-Agent: Gamekitbot=GameKit.de Allow: / User-Agent: GammaSpider=GammaSite.com Allow: / User-Agent: GammaSpider/1.0=Gammasite.com Allow: / User-Agent: gazz=Unknown Allow: / User-Agent: gazz/1.0=Infobee.ne.jp Allow: / User-Agent: gazz@nttrd.com=Infobee.ne.jp Allow: / User-Agent: Geckobot=Geckobot.com Allow: / User-Agent: GenCrawler=Gendoor.com Allow: / User-Agent: generic_crawler/01.0217/=Cmu.edu Allow: / User-Agent: genieBot=GenieKnows.com Allow: / User-Agent: GentleSpider=Research.att.com Allow: / User-Agent: GeonaBot=Geona.com Allow: / User-Agent: GeonaBot 1.0=Geona Link Checker Allow: / User-Agent: GigaBaz=Brainbot.com Allow: / User-Agent: GigaBazVStheWeb=Brainbot.com Allow: / User-Agent: GigaBlast=Gigablast.com Allow: / User-Agent: Gigabot=Gigablast.com Allow: / User-Agent: Gigabot/1.0=Gigablast.com Allow: / User-Agent: GigabotSiteSearch/2.0=Gigablast.com Allow: / User-Agent: GigabotSiteSearch/2.0 (sitesearch.gigablast.com)=Gigablast.com Allow: / User-Agent: Giskard=oralco.com Allow: / User-Agent: GNODSPIDER=Gnod.net Allow: / User-Agent: Goblin=GoGuides.org Allow: / User-Agent: Goblin/0.9 (http://www.goguides.org/)=Goguides.org Allow: / User-Agent: Goblin/0.9.x=Goguides.org Allow: / User-Agent: Goblin/0.9.x (http://www.goguides.org/goblin-info.html)=Goguides.org Allow: / User-Agent: GoForIt=GoForIt.com Allow: / User-Agent: GoForIt.com=Goforit.com Allow: / User-Agent: gonzo1=Suchen.de Allow: / User-Agent: Goofer/0.2=Wanadoo.fr Allow: / User-Agent: Google=Google.com Allow: / User-Agent: Googlebot=Google.com Allow: / User-Agent: Googlebot-Image/1.0=Google.com Image Bot Allow: / User-Agent: Googlebot/1.0=Google.com Allow: / User-Agent: Googlebot/2.1=Google.com Allow: / User-Agent: Googlebot/Test=Google.com Allow: / User-Agent: googlebot@googlebot.com=Google.com Allow: / User-Agent: Gooru-WebSpider=Gooru.pl Allow: / User-Agent: GrigorBot=Grigor.biz Allow: / User-Agent: GrigorBot 0.8=Grigor.biz Allow: / User-Agent: Gromit=Austlii.edu.au Allow: / User-Agent: grub crawler(http://www.grub.org)=Grub.com Allow: / User-Agent: grub-client=Grub.org Allow: / User-Agent: Gulliver/1.2=Northernlight.com Allow: / User-Agent: Gulper Web Bot=Gulper Bot Allow: / User-Agent: Gulper Web Bot 0.2.4=Gulper Bot Allow: / User-Agent: GurujiBot=Guruji.com Allow: / User-Agent: HappyFunBot=HappyFunSearch.com Allow: / User-Agent: Harvest-NG=Yahoo.com Allow: / User-Agent: Haste/0.12=Haste Site Monitoring Allow: / User-Agent: Hatena Antenna/0.4=a.hatena.ne.jp Allow: / User-Agent: Hatena Antenna/0.4 (http://a.hatena.ne.jp/help#robot)=a.hatena.ne.jp Allow: / User-Agent: Hatena RSS=R.Hatena.ne.jp Allow: / User-Agent: Helix=SiteSearch.ca Allow: / User-Agent: HenriLeRobotMirago=Mirago.fr Allow: / User-Agent: HenrytheMirago=Mirago.co.uk Allow: / User-Agent: HenrytheMiragoRobot=Mirago.co.uk Allow: / User-Agent: Hippias=Hippias.Evansville.edu Allow: / User-Agent: Hippias/0.9 Beta= Hippias Bot Allow: / User-Agent: Hitwise Spider=Hitwise.com Allow: / User-Agent: holmes=Morfeo.cz Allow: / User-Agent: holmes/3.9=Szukaj.onet.pl Allow: / User-Agent: holmes/x.x=Morfeo.centrum.cz Allow: / User-Agent: Homerbot=Homerweb.com Allow: / User-Agent: Homerbot: www.homerweb.com=Homerweb.com Allow: / User-Agent: Honda-Search=Honda-Search.com Allow: / User-Agent: htdig/3.1=Htdig.org Allow: / User-Agent: htdig/3.1.6 (http://computerorgs.com)=Computerorgs.com Allow: / User-Agent: http://Ask.24x.Info/ (http://narres.it/)=Narres.it Allow: / User-Agent: http://www.abcdatos.com/botlink/=Abcdatos.com Allow: / User-Agent: http://www.almaden.ibm.com=Almaden.IBM.com Allow: / User-Agent: http://www.istarthere.com=Istarthere.com Allow: / User-Agent: http://www.monogol.de=Monogol.de Allow: / User-Agent: http://www.trendtech.dk/spider.asp=Trendtech.dk Allow: / User-Agent: Hubater=Hubat.com Allow: / User-Agent: i1searchbot=i1search.com Allow: / User-Agent: IAArchiver-1.0=Archive.org Allow: / User-Agent: ia_archiver=Archive.org Allow: / User-Agent: ia_archiver/1.6=Archive.org Allow: / User-Agent: Kinja=Kinja.com Allow: / User-Agent: KIT-Fireball=Fireball.de Allow: / User-Agent: Kuloko=Kuloko.com Allow: / User-Agent: kulturarw3=KB.se Allow: / User-Agent: kulturarw3/0.1=National Library of Sweden Allow: / User-Agent: Lambda LinkCheck= Lambda Link Checker Allow: / User-Agent: LapozzBot=Lapozz.com Allow: / User-Agent: libWeb/clsHTTP -- hiongun@kt.co.kr=KT.co.kr Allow: / User-Agent: libwww-perl=client sites Allow: / User-Agent: Lincoln State Web Browser=Spam Bot Allow: / User-Agent: Link Valet Online= Link Valet Online Link Checker Allow: / User-Agent: LinkAlarm= LinkAlarm Link Checker Allow: / User-Agent: Linkbot= Linkbot Link Checker Allow: / User-Agent: linknzbot=Linknz.co.nz Allow: / User-Agent: Mariner/5.1b= Kolibri.de Allow: / User-Agent: Mariner/5.1b [de] (Win95; I;Kolibri gncwebbot)=Kolibri.de Allow: / User-Agent: Martini=Looksmart.com Allow: / User-Agent: marvin-team@webseek.de=Webseek.de Allow: / User-Agent: MaSagool=Sagool.jp Allow: / User-Agent: MasterSeek=MasterSeek.com Allow: / User-Agent: Mata Hari/2.00=Lexibot.com Allow: / User-Agent: Matrix S.p.A. - FAST Enterprise Crawler 6=Alice.it Allow: / User-Agent: Maxomobot=Maxomo.com Allow: / User-Agent: MediaCrawler=MediaCrawler.de Allow: / User-Agent: MediaCrawler-1.0=Mediacrawler.de Allow: / User-Agent: Megite=Megite.com Allow: / User-Agent: Mercator=Altavista.com Allow: / User-Agent: Metaeuro=MetaEuro.com Allow: / User-Agent: MetaGer-LinkChecker=Metager.de Link Checker Allow: / User-Agent: MetagerBot=Metager.de Allow: / User-Agent: Metaspinner=Meta-Spinner.de Allow: / User-Agent: Metaspinner/0.01=Meta-Spinner.de Allow: / User-Agent: Metatagsdir=MetaTagsDir.com Allow: / User-Agent: MicroBaz=BrainBot.com Allow: / User-Agent: Minibot=Minibot Allow: / User-Agent: MiracleAlphaTest=Nec.co.jp Allow: / User-Agent: Missauga Locate 1.0.0=Missauga Spam Bot Allow: / User-Agent: Missigua Locator 1.9=Missigua Spam Bot Allow: / User-Agent: Misterbot=MisterBot.fr Allow: / User-Agent: Misterbot-Nutch/0.7.1=Misterbot.fr Allow: / User-Agent: Miva=Miva.com Allow: / User-Agent: Miva (AlgoFeedback@miva.com)=Miva.com Allow: / User-Agent: MJ12bot=Majestic12.co.uk Allow: / User-Agent: MnogoSearch=mnoGoSearch.org Allow: / User-Agent: MnogoSearch/3.2.xx=mNoGoSearch.org Allow: / User-Agent: moget=goo.ne.jp moget=goo.ne.jp Allow: / User-Agent: moget/2.0=Goo.ne.jp Allow: / User-Agent: Mole2=intags.de Allow: / User-Agent: Mole2/1.0=Intags.de Allow: / User-Agent: Morning Paper= Morning Paper Link Checker Allow: / User-Agent: Morris=Mixcat.com Allow: / User-Agent: Mouse-House/7.4=Spidermonkey.ca Allow: / User-Agent: MoveAnnouncer= MoveAnnouncer Link Checker Allow: / User-Agent: mozDex/=Mozdex.com Allow: / User-Agent: mozDex/0.04-dev=Mozdex.com Allow: / User-Agent: Mozilla (Mozilla@somewhere.com)=Somewhere.com Allow: / User-Agent: Mozilla/2.0 (compatible; Ask Jeeves)=Ask Jeeves Allow: / User-Agent: Mozilla/2.0 (compatible; EZResult -- Internet Search Engine)=DirectHit.com Allow: / User-Agent: Mozilla/3.0 (compatible; MuscatFerret/1.5.4; claude@euroferret.com)=Euroferret.com Allow: / User-Agent: Mozilla/3.0 (compatible; MuscatFerret/1.5; olly@muscat.co.uk)=Euroferret.com Allow: / User-Agent: Mozilla/3.0 (compatible; MuscatFerret/1.6.x; claude@euroferret.com)=Euroferret.com Allow: / User-Agent: Mozilla/3.01 (Compatible; Links2Go Similarity Engine)=Links2go.com Allow: / User-Agent: Mozilla/4.0 (compatible; FastCrawler3, support-fastcrawler3@fast.no)=AllTheWeb.com Allow: / User-Agent: Szukacz=Szukacz.pl Allow: / User-Agent: tags2dir=Tags2Dir.com Allow: / User-Agent: Talkro Web-Shot=Daumsoft.com Allow: / User-Agent: targetblaster.com/0.9k=Targetblaster.com Link Checker Allow: / User-Agent: TaWWWantula=TaWWWantula Allow: / User-Agent: TCDBOT=TCD.ie Allow: / User-Agent: TECOMAC-Crawler=Arexera.de Allow: / User-Agent: Tecomi Bot=Tecomi.com Allow: / User-Agent: Teoma=Ask.com Allow: / User-Agent: teoma_admin@hawkholdings.com=Teoma.com Allow: / User-Agent: teoma_agent1=Teoma.com Allow: / User-Agent: TeraCrawl=TeraCrawl Allow: / User-Agent: Teradex_Mapper=Mapper.teradex.com Allow: / User-Agent: TerrawizBot=Guruji.com Allow: / User-Agent: The Informant=The Informant Allow: / User-Agent: The Intraformant=The Intraformant Link Checker Allow: / User-Agent: TheSuBot=TheSuBot.de Allow: / User-Agent: TheSuBot/0.1=TheSuBot.de Allow: / User-Agent: TheSuBot/0.1 (www.thesubot.de)=TheSuBot.de Allow: / User-Agent: thumbshots-de=Thumbshots.de Allow: / User-Agent: thumbshots-de-Bot=ThumbShots.de Allow: / User-Agent: thumbshots-de-Bot (Version: 1.02, powered by www.thumbshots.de)=ThumbShots.de Allow: / User-Agent: TJG/Spider=TJGroup.com Allow: / User-Agent: Tkensaku=Tkensaku.com Allow: / User-Agent: Topodia=Topodia.com Allow: / User-Agent: Toutatis=Hoppa.com Allow: / User-Agent: Toutatis 2.5-2=Hoppa.com Allow: / User-Agent: Toutatis 3.3 (hoppa.com)=Hoppa.com Allow: / User-Agent: Toutatis 4-19.6 (hoppa.com)=Hoppa.com Allow: / User-Agent: Traazibot=Traazi.com Allow: / User-Agent: Trampelpfad=Trampelpfad.de Allow: / User-Agent: Tumblr=Tumblr.com Allow: / User-Agent: Turnitin=TurnItIn.com Allow: / User-Agent: TurnitinBot=Turnitin.com Allow: / User-Agent: TurnitinBot/x.x=Turnitin.com Allow: / User-Agent: TutorGig=TutorGig.com Allow: / User-Agent: Tutorial Crawler=Tutorgig.com Allow: / User-Agent: Tv_Merc_resh_26_1_D-1.0=Altavista.com Allow: / User-Agent: Tygo=Tygo.com Allow: / User-Agent: TygoBot=Tygo.com Allow: / User-Agent: UCmore=Ucmore.com Allow: / User-Agent: UdmSearch=Mnogosearch.org Allow: / User-Agent: UK Searcher Spider=Uksearcher.co.uk Allow: / User-Agent: Ultraseek=Infoseek.com Allow: / User-Agent: unlostBot=Unlost.com Allow: / User-Agent: Updated=Updated.com Allow: / User-Agent: updated/0.1beta (updated.com; http://www.updated.com; crawler@updated.com)=Cogentco.com Allow: / User-Agent: UptimeBot=UptimeBot.com Allow: / User-Agent: URLBlaze=Urlblaze.net Allow: / User-Agent: UrlScope=UrlScope Allow: / User-Agent: URL_Spider_Pro=Innerprise.net Allow: / User-Agent: USyd-NLP-Spider=It.USYD.edu.ua Allow: / User-Agent: Vagabondo=Wise-guys.nl Allow: / User-Agent: Vagabondo/1.x MT (webagent@wise-guys.nl)=Wise-guys.nl Allow: / User-Agent: Vagabondo/2.0 MT=Wise-guys.nl Allow: / User-Agent: Vagabondo/2.0 MT (webagent at wise-guys dot nl)=Wise-guys.nl Allow: / User-Agent: Vagabondo/2.0 MT (webagent@NOSPAMwise-guys.nl)=Wise-guys.nl Allow: / User-Agent: Vakes=Vakes.com Allow: / User-Agent: various=Multiple Robots Allow: / User-Agent: VeryGoodSearch=VeryGoodSearch.com Allow: / User-Agent: VeryGoodSearch.com.DaddyLongLegs=VeryGoodSearch.com Link Checkec Allow: / User-Agent: verzamelgids.nl=Verzamelgids.nl Allow: / User-Agent: Vespa Crawler=Yahoo.com Allow: / User-Agent: Visbot=Visvo.com Allow: / User-Agent: Vivante Link Checker=vivante.com Allow: / User-Agent: VMBot=VerticalMatch.com Allow: / User-Agent: Voyager=CosmixCorp.com Allow: / User-Agent: voyager/1.0=Cogentco.com Allow: / User-Agent: VSE/1.0=Vivismo.com Allow: / User-Agent: vspider=Verity.com Allow: / User-Agent: W3CRobot/5.4.0 libwww/5.4.0=W3C Link Checker Allow: / User-Agent: W3SiteSearch=W3SiteSearch.de Allow: / User-Agent: wadaino.jp=Wadaino.jp Allow: / User-Agent: Watchfire WebXM=Watchfire WebXM Link Checker Allow: / User-Agent: Waypath=WayPath.com Allow: / User-Agent: WebAlta=WebAlta.ru Allow: / User-Agent: WebarooBot=Webaroo.com Allow: / User-Agent: Webbandit=WebBandit Allow: / User-Agent: webbandit/4.xx.0=WebBandit Allow: / User-Agent: Webclipping.com=WebClipping.com Allow: / User-Agent: webcollage=WebCollage.com Allow: / User-Agent: webcollage/1.xx=WebCollage.com Allow: / User-Agent: WebCompass=WebCompass Allow: / User-Agent: webcrawl.net=WebCrawl.net Allow: / User-Agent: WebCrawler-AddURL/2.0=WebCrawler Allow: / User-Agent: WebCrawler/3.0 Robot libwww/5.0a=WebCrawler Allow: / User-Agent: WebFindBot=Web-find.com Allow: / User-Agent: WebFindBot(http://www.web-find.com)=Web-find.com Allow: / User-Agent: WebGather=WebGather Allow: / User-Agent: WebGenie=WebGenie Allow: / User-Agent: Weblink Scanner=Weblink Link Checker Allow: / User-Agent: Weblog Attitude Diffusion=LANL.gov Allow: / User-Agent: webmaster@intags.de=Intags.de Allow: / User-Agent: webmeasurement-bot, http://rvs.informatik.uni-leipzig.de=RVS.Informatik.uni-leipzig.de Allow: / User-Agent: WebSearch.COM.AU=WebSearch.com.au Allow: / User-Agent: WebSite-Watcher=WebSite-Watcher Link Checker Allow: / User-Agent: WebsiteWorth=WebsiteWorth Allow: / User-Agent: Webspinne=Webspinne.de Allow: / User-Agent: Websquash.com=WebSquash.com Allow: / User-Agent: WebTrends Link Analyzer= WebTrends Link Checker Allow: / User-Agent: Webverzeichnis.de=Webverzeichnis.de Allow: / User-Agent: Wget=Unknown Allow: / User-Agent: whatuseek=Whatuseek.com Allow: / User-Agent: whatUseek_winona/3.0=Whatuseek.com Allow: / User-Agent: WhizBang! Lab=Whizbanglabs.com Allow: / User-Agent: Willow Internet Crawler by Twotrees=TwoTrees.com Allow: / User-Agent: WinkBot=Wink.com Allow: / User-Agent: WIRE WebRefiner=Wire.co.uk Allow: / User-Agent: WIRE WebRefiner:=wire.co.uk Allow: / User-Agent: wisenutbot=Looksmart.com Allow: / User-Agent: WiseWire-Spider2=Wisewire.com Domain Checker Allow: / User-Agent: Worio=Worio.com Allow: / User-Agent: Woriobot=Worio.com Allow: / User-Agent: WorldLight=EntireWeb.com Allow: / User-Agent: Wotbox=WotBox.com Allow: / User-Agent: WSCbot=WorldSearchCenter.com Allow: / User-Agent: wume_crawler=Wume.cse.lehigh.edu Allow: / User-Agent: wume_crawler/1.1=Wume.cse.lehigh.edu Allow: / User-Agent: www.arianna.it=Arianna.libero.it Allow: / User-Agent: www.elsop.com=elsop.com Link Checker Allow: / User-Agent: www.inktomisearch.com=Yahoo.com Allow: / User-Agent: www.WebWombat.com.au=Webwombat.com.au Allow: / User-Agent: WWWeasel=WWWeasel.de Allow: / User-Agent: X-Crawler=Arexera.de Allow: / User-Agent: xirq/0.1-beta=XIRQ.com Allow: / User-Agent: xyro_(xcrawler@cosmos.inria.fr)=Inria.fr Allow: / User-Agent: Y!J=Yahoo.co.jp Allow: / User-Agent: Yacy=Yacy.net Allow: / User-Agent: Yahoo=Yahoo.com Allow: / User-Agent: Yahoo-Blogs/v3.9=Yahoo.com Blogs Allow: / User-Agent: Yahoo-MMCrawler/3.x=Yahoo Publisher Network Allow: / User-Agent: YahooFeedSeeker=Yahoo.com RSS Bot Allow: / User-Agent: YahooSeeker/CafeKelsa=Yahoo.com Allow: / User-Agent: YahooYSMcm/1.0.0=Yahoo Publisher Network Allow: / User-Agent: YahooYSMcm/2.0.0=Yahoo Publisher Network Allow: / User-Agent: Yandex=Yandex.com Allow: / User-Agent: Yellopet-Spider=YellowPet.com Allow: / User-Agent: YodaoBot=Yodao.com Allow: / User-Agent: Yoogli=Yoogli.com Allow: / User-Agent: Yoono=Yoono.com Allow: / User-Agent: YottaShopping_Bot/4.12=YottaShopping.com Allow: / User-Agent: ypn-rss.overture.com=Yahoo Publisher Network Allow: / User-Agent: ZACATEK=Zacatek.cz Allow: / User-Agent: Zao-Crawler=Zao Bot Allow: / User-Agent: Zao/0.1=Zao Bot Allow: / User-Agent: Zao/0.1 (http://www.kototoi.org/zao/)=Zao Bot Allow: / User-Agent: Zao/0.2=Zao Bot Allow: / User-Agent: Zearchit=Zearchit.de Allow: / User-Agent: Zerxbot=Zerx.com Allow: / User-Agent: zerxbot/Version 0.6 libwww-perl/5.79=Zerx.com Allow: / User-Agent: Zeusbot=Ulsysseek.com Allow: / User-Agent: Zippy v2.0 - Zippyfinder.com=Zippyfinder.com Allow: / User-Agent: Zspider=Feedback.redkolibri.com Allow: / User-Agent: ZyBorg=Wisenut.com Allow: / User-Agent: Micro$oft Internet Exploder Allow: / User-Agent: holmes/3.11 (OnetSzukaj/5.0; +http://szukaj.onet.pl) Allow: / User-Agent: msnbot/1.0 (+http://search.msn.com/msnbot.htm) Allow: / User-Agent: holmes/3.12 (OnetSzukaj/5.0; +http://szukaj.onet.pl) Allow: / User-Agent: msnbot-media/1.0 (+http://search.msn.com/msnbot.htm) Allow: / User-Agent: Opera/9.24 (Windows NT 5.1; U; pl) Allow: / User-Agent: Opera/9.20 (Windows NT 5.1; U; en) Allow: / User-Agent: Opera/9.23 (Windows NT 5.1; U; pl) Allow: / User-Agent: MJ12bot/v1.0.8 (http://majestic12.co.uk/bot.php?+) Allow: / User-Agent: Mediapartners-Google Allow: / User-Agent: Opera/9.20 (Windows NT 5.1; U; pl) Allow: / User-Agent: Googlebot-Image/1.0 Allow: / User-Agent: Opera/9.22 (Windows NT 5.1; U; pl) Allow: / User-Agent: Opera/9.24 (Windows NT 6.0; U; pl) Allow: / User-Agent: Opera/8.54 (Windows NT 5.1; U; pl) Allow: / User-Agent: Googlebot-Image/1.0 Allow: / User-Agent: Netscape Allow: / User-Agent: Szukacz/1.5 (robot; www.szukacz.pl/html/jak_dziala_robot.html; info@szukacz.pl) Allow: / User-Agent: googlebot Allow: / User-Agent: msnbot Allow: / User-Agent: wpbot Allow: / User-Agent: interiabot Allow: / User-Agent: o2bot Allow: / User-Agent: onetbot Allow: / User-Agent: netsprintbot Allow: / User-Agent: goorubot Allow: / User-Agent: szukaczbot Allow: / User-Agent: allthewebbot Allow: / User-Agent: altavistabot Allow: / User-Agent: yahoobot Allow: / User-Agent: Shareware.Combot Allow: / User-Agent: DejaNewsbot Allow: / User-Agent: webcorpbot Allow: / User-Agent: gazeta.plbot Allow: / User-Agent: wirtualnemiasta.plbot Allow: / User-Agent: panoramamiast.plbot Allow: / User-Agent: wikipediabot Allow: / User-Agent: joomlabot Allow: / User-Agent: powersetbot Allow: / User-Agent: FactSpotterbot Allow: / User-Agent: SEObot Allow: / User-Agent: Aliwebbot Allow: / User-Agent: Allthewebbot Allow: / User-Agent: Amicrawlerbot Allow: / User-Agent: AOLNetFindbot Allow: / User-Agent: Apollobot Allow: / User-Agent: Archiebot Allow: / User-Agent: Ask Jeeves!bot Allow: / User-Agent: BigFootbot Allow: / User-Agent: Biographybot Allow: / User-Agent: Britannica Internet Guidebot Allow: / User-Agent: Browsers.combot Allow: / User-Agent: Chubbabot Allow: / User-Agent: CNN Searchbot Allow: / User-Agent: ComFindbot Allow: / User-Agent: DEC AltaVistabot Allow: / User-Agent: DEC AltaVista Teliabot Allow: / User-Agent: DEC AltaVista Telia PLbot Allow: / User-Agent: DejaNewsbot Allow: / User-Agent: DirectoryGuidebot Allow: / User-Agent: DogPilebot Allow: / User-Agent: Electric Librarybot Allow: / User-Agent: Emultibot Allow: / User-Agent: InfoSeekbot Allow: / User-Agent: Starting Pointbot Allow: /