User-agent: * Disallow: /_ Disallow: /log Disallow: /adm Disallow: /inc Disallow: /too Disallow: /s Disallow: /pdf Disallow: /affilate Disallow: /fav Disallow: /stat Disallow: /erfassen User-Agent: MSIECrawler Disallow: / User-Agent: SlySearch Disallow: / User-agent: ia_archiver Disallow: / User-agent: psbot Disallow: /