# Robots.txt # Be nice. # User-agent: MSNBot Disallow: /apps/pbcs.dll/search User-agent: Schibstedsokbot Disallow: /apps/pbcs.dll/search User-agent: Googlebot Disallow: /apps/pbcs.dll/search User-agent: Yahoo! Slurp Disallow: /apps/pbcs.dll/search User-agent: Yahoo-Newscrawler Disallow: /apps/pbcs.dll/search User-agent: Scooter Disallow: /apps/pbcs.dll/search User-Agent: ia_archiver Disallow: /apps/pbcs.dll/search User-Agent: ArchitextSpider Disallow: /apps/pbcs.dll/search User-Agent: InfoSeek Sidewinder Disallow: /apps/pbcs.dll/search User-Agent: WebCrawler/3.0 Disallow: /apps/pbcs.dll/search User-agent: MSIECrawler Disallow: / # User-agent: * Disallow: /apps/pbcs.dll/classifieds Disallow: /apps/pbcs.dll/events Disallow: /apps/pbcs.dll/index Disallow: /apps/pbcs.dll/news Disallow: /apps/pbcs.dll/temaoversikt Disallow: /apps/pbcs.dll/related Disallow: /apps/pbcs.dll/misc Disallow: /apps/pbcs.dll/error Disallow: /apps/pbcs.dll/search Disallow: /apps/pbcsi.dll Disallow: /apps/pbcsad.dll Disallow: /apps/rub.dll Disallow: /apps/pbcs.dll/ptshowguide Disallow: /tmp/ Disallow: /logs/ Disallow: /images/ Disallow: /.cache/ Disallow: /mal/ Disallow: /article/20090825/NYHETER01/929463904/1108/NYHETER02 Disallow: /article/20090825/NYHETER01/929463904/1108/ Disallow: /article/20090825/NYHETER01/929463904/