Thread: Block Web Content Scrapers and Downloaders

I just have it on the home page -- that seems to be what most downloaders hit first.

Google are using lots of different ones that's why.

Originally Posted by webmaster

Google are using lots of different ones that's why.

It's pretty easy to tell which IP's are not really Google.

I just snagged my second fish. This one is from China and is pretending to look like a browser.

Code:

address is 121.9.227.47, hostname is 121.9.227.47, agent is Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)

I've got bot-trap set up on two low traffic test sites. If I do not see anything detrimental over the next week, it will go on my main sites. Thus far it looks like a winner.

can they not hack from 777

Originally Posted by thesyndicate

can they not hack from 777

I do not understand what you are saying.

What is the question?

leaving a file open with 777 can not hackers just hack your server from that file.

Not unless there is a vulnerable program to write to the file and putting something in that file has a benefit for them.

Is this only for private servers or can i use it with shared hosting as well? Or is that a overkill?

You should be able to use it on any server where you can use an .htaccess file.