This post originated from an RSS feed registered with .NET Buzz by Daniel Zeiß. Original Post: Request.Browser.Crawler Feed Title: Daniel's Blog Feed URL: /error.aspx?aspxerrorpath=/danielz/Rss.aspx Feed Description: ComfortASP.NET - AJAX for all Latest .NET Buzz Posts Latest .NET Buzz Posts by Daniel Zeiß Latest Posts From Daniel's Blog

Back in 2006 with some Crawler infos and ComfortASP.NET.

When you use the ASP.NET Page Property  Request.Browser.Crawler it is documented as:
"Gets a value indicating whether the client browser is a Web crawler search engine."

So, you may assume that there is already a built in Crawler detection in ASP.NET. But that's not the case! You have to provide all the required information about the Web Crawlers that you want to detect within the ASP.NET configuration. For ASP.NET 1.1 you can find a good starting point in this ASP.NET Forum Thread to provide some crawler informations in your web.config file:
http://forums.asp.net/1013338/ShowPost.aspx

Please notice that ComfortASP.NET uses the  Request.Browser.Crawler property internally to switch off hidden postbacks (and AJAX) in case a crawler is accessing the page.