# Alle Robots ausschließen User-agent: * Allow: /fabrizio/ Allow: /ostsee/ Allow: /cantautori/ Disallow: /main/administrator/ Disallow: /archiv/ Disallow: /main/cache/ Disallow: /main/components/ Disallow: /ecards/ Disallow: /main/editor/ Disallow: /galerie/ Disallow: /gallery/ Disallow: /main/help/ Disallow: /main/images/ Disallow: /main/includes/ Disallow: /main/language/ Disallow: /main/libraries/ Disallow: /main/mambots/ Disallow: /matura/ Disallow: /main/media/ Disallow: /main/modules/ Disallow: /muh/ Disallow: /main/plugins/ Disallow: /main/templates/ Disallow: /main/tmp/ Disallow: /main/xmlrpc/ Disallow: /_lib/ Disallow: /_muh/ User-agent: Googlebot Disallow: / User-agent: ia_archiver Disallow: / User-agent: dotbot Disallow: / User-agent: MSNBot Disallow: / User-agent: Slurp Disallow: / User-agent: yanga worldsearch bot Disallow: / User-agent: Yanga WorldSearch Bot v1.1/beta (http://www.yanga.co.uk/) Disallow: / User-agent: Yandex Disallow: / User-agent: AboutUsBot Disallow: / User-agent: webcrawler Disallow: / User-agent: cuill.com Disallow: / User-agent: Twiceler Disallow: / User-agent: Mozilla/5.0 (compatible; Yahoo! Slurp China; http://misc.yahoo.com.cn/help.html) Disallow: / User-agent: Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) Disallow: / User-agent: Feedfetcher-Google; (+http://www.google.com/feedfetcher.html) Disallow: / User-agent: Feedfetcher-Google; (+http://www.google.com/feedfetcher.html; feed-id=7987056519821485756) Disallow: / User-agent: Mozilla/5.0 (compatible; WebDataCentreBot/1.0; +http://WebDataCentre.com/) Disallow: / User-agent: MJ12bot Disallow: / User-agent: Exabot Disallow: / User-agent: Baiduspider+(+http://www.baidu.com/search/spider.htm) Disallow: / User-agent: Teoma Disallow: / User-agent: psbot Disallow: / User-agent: keywordspy.com Disallow: / User-agent: MooseBot Disallow: / User-agent: itsapic.com_crawler Disallow: / User-agent: bezeqint.net Disallow: / User-agent: Searchmee! Spider v0.98a Disallow: / User-agent: FAST-WebCrawler Disallow: / User-agent: Lycos_Spider_(T-Rex) Disallow: / User-agent: MSNPTC Disallow: / User-agent: msnbot-media/1.0 Disallow: / User-agent: ScoutJet Disallow: / User-agent: Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) Disallow: / User-agent: msnbot-media/1.1 (+http://search.msn.com/msnbot.htm) Disallow: / User-agent: Feedfetcher-Google Disallow: / User-agent: FeedFetcher-Google; (+http://www.google.com/feedfetcher.html) Disallow: / User-agent: Speedy Spider Disallow: / User-agent: voyager/2.0 (http://www.kosmix.com/html/crawler.html) Disallow: / User-agent: Java/1.6.0_04 Disallow: / User-agent: ACONTBOT Disallow: / User-Agent: Charlotte Disallow: / User-Agent: CCBot Disallow: / User-Agent: Mozilla crawl/5.0 (compatible; frt/1.13.2 +http://www..com) Disallow: / User-Agent: SimilarPages/Nutch-1.0-dev (SimilarPages Nutch Crawler; http://www.similarpages.com; info at similarpages dot com) Disallow: / User-Agent: DealGates Bot/1.1 by Luc Michalski (http://spider.dealgates.com/bot.html) Disallow: / User-Agent: DealGates Bot/1.1 Disallow: / User-Agent: DealGates Bot/1.1 by Luc Michalski Disallow: / User-Agent: DealGates Bot/1.2 by Luc Michalski (http://www.dealgates.net/bot.html) Disallow: / User-Agent: Mozilla/4.0 (compatible; MSIE 5.0; Windows 95) VoilaBot BETA 1.2 (http://www.voila.com/) Disallow: / User-Agent: Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; fr; rv:1.8.1) VoilaBot BETA 1.2 (http://www.voila.com/) Disallow: / User-Agent: Bot Mozilla/5.0 (Windows; U; Windows NT 5.1; fr; rv:1.8.1) VoilaBot BETA 1.2 (support.voilabot@orange-ftgroup.com) Disallow: / User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; fr; rv:1.8.1) VoilaBot BETA 1.2 (support.voilabot@orange-ftgroup.com) Disallow: / User-Agent: Yandex/1.01.001 (compatible; Win16; F) Disallow: / User-Agent: Bot Yandex/1.01.001 (compatible; Win16; H) Disallow: / User-Agent: Bot Yandex/1.01.001 (compatible; Win16; I) Disallow: / User-Agent: Bot Yandex/1.02.000 (compatible; Win16; F) Disallow: / User-Agent: Feedfetcher-Google; (+http://www.google.com/feedfetcher.html; feed-id=7987056519821485756) Disallow: / User-Agent: msnbot/1.1 ( http://search.msn.com/msnbot.htm) Disallow: / User-Agent: Bot msnbot/1.1 (+http://search.msn.com/msnbot.htm) Disallow: / User-Agent: StackRambler/2.0 (MSIE incompatible) Disallow: / User-Agent: Mozilla/5.0 (Twiceler-0.9 http://www.cuil.com/twiceler/robot.html) Disallow: / User-Agent: VoilaBot BETA 1.2 (support.voilabot@orange-ftgroup.com) Disallow: / User-Agent: Twiceler-0.9 http://www.cuil.com/twiceler/robot.html Disallow: / User-Agent: msnbot/2.0b (+http://search.msn.com/msnbot.htm) Disallow: / User-Agent: Mail.Ru/1.0 Disallow: / User-Agent: Sogou-Test-Spider/4.0 (compatible; MSIE 5.5; Windows 98) Disallow: / User-Agent: Speedy Spider Disallow: / User-Agent: msnbot/2.0b (+http://search.msn.com/msnbot.htm) Disallow: / User-Agent: findfiles.net/0.96 (Robot;test_robot@gmx-topmail.de) Disallow: / User-Agent: Zscho.de Crawler/Nutch-1.0-Zscho.de-semantic_patch (Zscho.de Crawler, collecting for machine learning; http://zscho.de/ ) Disallow: / User-Agent: msnbot/2.0b (+http://search.msn.com/msnbot.htm) Disallow: / User-Agent: Mozilla/5.0 (compatible; Exabot/3.0 (BiggerBetter); +http://www.exabot.com/go/robot) Disallow: / User-Agent: Yandex/1.01.001 (compatible; Win16; I) Disallow: / User-Agent: Purebot Disallow: / User-Agent: Mozilla/5.0 (compatible; Purebot/1.1; +http://www.puritysearch.net/) Disallow: /