Net Builders - View Single Post - Block Web Content Scrapers and Downloaders

TopDogger · 2 February, 2009, 13:45 PM

Will, does your white list cover all of the Google spiders?

I've seen some lengthy lists of GoogleBot IP addresses.

2 February, 2009, 13:45 PM	#10 (permalink)
TopDogger Net Builder iTrader: (3) Thanked 184 Times in 127 Posts Posts: 504 $NetBucks: 722 Join Date: Jan 2009 Last Online: Today 14:42 PM	Will, does your white list cover all of the Google spiders? I've seen some lengthy lists of GoogleBot IP addresses.