Thread: Block Web Content Scrapers and Downloaders
View Single Post
Old 10 December, 2008, 10:00 AM   #4 (permalink)
DomainMagnate DomainMagnate is offline
Super-Duper Moderator
 
DomainMagnate's Avatar
 
iTrader: (8)
Blog Entries: 2
Thanked 117 Times in 83 Posts
Posts: 622
Recent Blog: The Future of SEO as I See It
$NetBucks: 444
Join Date: Dec 2008
Last Online: 21 February, 2010 11:52 AM
Send a message via AIM to DomainMagnate
Default
Why not just allow the known se bots and disallow the rest?
  Reply With Quote