Google is just faster and more aggressive about crawling. I'm using cloudflare on a few sites, also, and it has really helped me, as well.
So, I've been using Cloudflare on 3 small/medium-traffic sites that have high traffic periods over the past 10 months to save on bandwith...(well Hostgator basically told me I had to do so on two of these last spring or they would kill my account )....it does a good job with that. Cuts the hit on the main server by about 30-40% (on top of the normal caching plugins being installed).
So far, I haven't seen anything negative about the service. Supposedly, they have an iPv4 to iPv6 interface that I signed up to permit as well (no idea if this has helped, hurt, or is just ok at this point)...but, I did see an interesting metric in one of the stats views that the company provides with regards to crawl rates: For yesterday:
Bing - 4,610
Google - 3,335
These are listed as the number of pages crawled by the respective search engine on that day. I was surprised to see Bing having that many more page visits than Google. Anyone have any idea why? Google still provides a fair amount more traffic for the 3 sites than Bing over the same 24 hour timeframe.
Are you talking about: Home | CloudFlare | The web performance & security company
Using the free only option?
If so, how does that work out for you.
The paid option I see could be great for someone with a lot of sites.
Now you have me seriously looking at this.
The paid version is only to prevent SSL from breaking as far as I know. The free version of CloudFlare breaks SSL. I have the CloudFlare plug-in built into cPanel on all of my hosting servers and insist on as many of my customers as possible implementing it (and setting up the required 301 redirect, an important and often overlooked necessity) because it really keeps bad traffic away. I use it on several of my own sites as well.
http://www.cloudflare.com/plans offers those protections if the server doesn't.
Last edited by vectro; 25 January, 2012 at 06:46 AM.
javanx3d (25 January, 2012)
@Iowadog - I use the free version. Have done so since March 2011 and no issues that I have seen so far. I would be interested in just getting on an iPv6 computer to see what is and isn't available for users there at some point for that feature though to see if that functionality really matters...
iowadawg (25 January, 2012)
I'm sure if you look hard enough you'll find some..So far, I haven't seen anything negative about the service
I really hate to be negative about them, but to be honest... After testing the free cloudflare service on a site for almost 5 months or so, we were very happy to get rid of it.
Based on the experience, would never pay for it. They seem to have problems with the free and paid service. If it works for you that's great, but it sure didn't work good for us..
I don't know how closely you guys monitor your sites, we like to keep a very close eye on everything. Took lots of screenshots while cloudflare was running to compare with after it was deactivated.
Some extremely annoying problems we had were excessive gateway timeouts, which were blamed on us, except the timeouts came from cloudflare service. And their no cached version available message all the time. Maybe it's different for people who are connecting from overseas, who knows. But I'm sure there's an excuse ready for everything.
The site load time also blew up to like 60 seconds, from about 15 seconds before the service was running.
Cloudflare didn't block nearly as much bad stuff as they claimed it would. We still had lots of attacks and bots coming through being picked by our php firewall. One claim that it did the same kind of header checks as bad behavior was not true either, since bad behavior still picked up a lot of things.
Didn't help at all against one bot hitting the site 50,000 times in a row, or against a targeted ddos attack.
Also saw lot's of passing the blame and denials which remind me of how godaddy tend to act when they get caught out on things they wont admit to.
Some people also find it a bit hypocritical for the guys at cloudflare to have no problems at all with providing protection for websites run by criminals, spammers, hackers etc, since cloudflare claims to be in the business of protecting people against those kinds of sites. Surely that's one huge conflict of interest right there.
I'm a happy long time project honeypot user, but with cloudflare it was a very disappointing experience overall.. The apparent eagerness to pass the blame onto anything else they could think of made it even more distateful.
With the amount of money they have raised though, hopefully the service will improve in future. Good luck with it.
Dang, sucks you've had such a bad experience. Were your issues with proxy-based sites or others that rely on a significant amount of java/ecmascript?
The 3 sites I have using the service are straight-stick WP sites so could be the difference.
Monitoring-wise, once a day (most days) until the peak month which I do hourly when not sleeping. I've seen the gateway timeout once about one month ago but went away on refresh of the page. Have not had anyone complain back to me regarding, but that really doesn't mean anything I guess since annoyed visitors would just go somewhere else...
Sites are hosted in the U.S. I'm physically in Europe. Will keep an eye out for the gateway issues you mention, and if I see them come up more frequently won't hurt my feelings to drop the service if required!