Robots.txt Template for Community Server

written by Ryan Olshan on Sunday, March 26 2006

I was getting annoyed by MSNBot trying to index /reader/default.aspx. So, I decided to deploy a Robots.txt file. In case anyone wants a template for a Community Server Robots.txt file, here it is. I don't know what the Downloads folder is used for (other than what I found at this thread), so I've included it anyway.

# Robots.txt file for http://domain
# User-agent: * Disallow: /aspnet_client/ Disallow: /ControlPanel/ Disallow: /Downloads/ Disallow: /Emoticons/ Disallow: /FreeTextBox3/ Disallow: /Ink/ Disallow: /Installer/ Disallow: /Languages/ Disallow: /Messages/ Disallow: /reader/ Disallow: /Themes/ Disallow: /User/ Disallow: /Utility/
Kick this post on .NET Kicks

Similar Posts

  1. Updated Robots.txt file for Community Server 2007
  2. Twitter
  3. Tweaking Community Server Out of the Box

Post a comment