Results 1 to 8 of 8

Thread: Website Fishing Story & Site Help Please

  1. #1
    Sami4u's Avatar
    Sami4u is offline Butterflies Forever
    Join Date
    Sep 2009
    Location
    USA
    Posts
    1,407
    Thanks
    670
    Thanked 292 Times in 220 Posts

    Unhappy Website Fishing Story & Site Help Please

    Hi,

    This small fishing story explains my BIG problem.

    Two men went fishing. One was an experienced fisherman, the other wasn't.

    Every time the experienced fisherman caught a big fish, he put it in his ice chest to keep it fresh.

    Whenever the inexperienced fisherman caught a big fish, he threw it back.

    The experienced fisherman watched this go on all day and finally got tired of seeing the man waste good fish.

    'Why do you keep throwing back all the big fish you catch?' he asked.

    The inexperienced fisherman replied, 'I only have a small frying pan..'

    --------------------------------------------------------------------------------------

    This is the second day of the month and My one site has used over 1Gig of bandwith. After the last PR change or something happened all of a sudden I am getting tons of traffic. I would bet that most would be very happy about this. However I am not. I have gotten very lucky and the site is on page one all over goggle. For some damm good keywords.

    Here is the my problem. It is with google images that I am getting the traffic.

    The traffic from the images are bouncing like craze looking at the pics not going from page to page in the site. And just burning the Hell out of my bandwith.

    This I do not want to do:

    I do not want to redesign the site.

    I do not want to re-size the pics.

    Thing I am think about doing.

    1.) Is there a way to block google image and still keep google search? Right Now over 80% of traffic is coming from google images and bouncing.

    2.) Is there a way to redirect the traffic you get from google image only so that that a person must see an ad and wait over 30 sec before the pic will load. with NO way around it.

    3.) I need an experienced fisherman to tell me what to do?

    Why do I want to do this. It is costing me for this bandwith that I am seeing NO revenue in return.

    Thanks in advance

    Butterflies Forever

    Sami
    Current Celebrity Gossip Movies & More TV Site
    Find out how I'm able to get up to 420 backlinks for month, by spending 30 seconds per day...all for FREE! - Click Here

  2. #2
    bogart's Avatar
    bogart is offline Super Moderator
    Join Date
    May 2009
    Location
    New York
    Posts
    3,772
    Thanks
    1,886
    Thanked 776 Times in 609 Posts
    I don't know how to do this. Put it does look possible to do a redirect based on the referrer after the user clicks on "See full size image"

    Perhaps this solution from shadyseo will work (also check out the comments for more tips)
    Traffic From Google Image Search: Re-Claiming Your Visitors : Slightly Shady SEO
    PHP Code:
    <script language=”Javascript”>
    if(
    parent.location != self.location)
    {
    parent.location=self.location;
    }
    </script> 
    Put that in an external JS, restricted by Robots.txt

  3. #3
    Snak3's Avatar
    Snak3 is offline Moderator
    Join Date
    Jul 2009
    Location
    Undisclosed Location
    Posts
    629
    Thanks
    155
    Thanked 190 Times in 121 Posts
    You may want to try Bogart's suggestion as stated above or you can use the following code to break out of frames

    <script type="text/javascript">
    <!--
    if (parent.frames.length > 0) { parent.location.href = location.href; }
    -->

    </script>
    This script works very well, as soon as a user clicks on the image on Google and comes to your site, the Google Images Frame is broken. So in such cases users normally would look around your site rather than just steal your images and go.

    My case is somewhat similar to yours as one of my site is ranking between 1-7 for very good keywords like 'pagerank', 'ask', 'ask.com', 'robots.txt', etc.. in Google images.
    So this framebreaker code helps a lot.
    Good Luck.

  4. #4
    jakki's Avatar
    jakki is offline Directory Submission Service
    Join Date
    Mar 2009
    Posts
    962
    Blog Entries
    2
    Thanks
    146
    Thanked 90 Times in 74 Posts
    I hope this trick will help you.

    by using this trick you can remove any frame and you start getting traffic.
    that means this will not help you to cut your bandwidth usage but this will help you to convert that bandwidth usage into REVENUE.



    Tips & Trick: Remove Google Image Search Frame. » Istanto Blogs
    Premium Directory :: PR4 Submit Your Link
    Lamrod.org :: Best Product Review and Price Comparison Site One LD :: PR1 Directory



  5. #5
    TopDogger's Avatar
    TopDogger is offline Über Hund
    Join Date
    Jan 2009
    Location
    Hellfire, AZ
    Posts
    2,946
    Thanks
    341
    Thanked 883 Times in 671 Posts
    You can block the Google image spider in the robots.txt file. I do that on all of my sites because I prefer not having my images stolen by everyone who mistakenly thinks that Google images are free to use. I have also found that this traffic does not result in business, because it is frequently from people who are merely looking for images and not from those looking for answers or information.

    Just add the following to the robot.txt file. This does not affect the regular Google search spider. It may take some time got Google to recognize it.


    Code:
    User-agent: Googlebot-Image
    Disallow: /
    As an experienced fisherman, my advice is to eliminate the fish that do not put food on your table.
    "Democracy is two wolves and a lamb voting on what to have for lunch. Liberty is a well-armed lamb contesting the vote." -- Benjamin Franklin


  6. #6
    Sami4u's Avatar
    Sami4u is offline Butterflies Forever
    Join Date
    Sep 2009
    Location
    USA
    Posts
    1,407
    Thanks
    670
    Thanked 292 Times in 220 Posts
    Hi,

    OK one step at a time.

    1.) I have had a codebreaker on the site for over a year now

    Check site:freewomensblogs.com - Google Search

    2.) I have this line in my .htaccess Yet I am still getting hotlinked

    Code:
    RewriteCond %{HTTP_REFERER} !^http://(.+\.)?freewomensblogs\.com/ [NC]
    RewriteCond %{HTTP_REFERER} !^$
    RewriteRule .*\.(jpe?g|gif|bmp|png)$ /images/nohotlink.jpe [L]
    3.)This is my Robots.txt But I see I have a Cap. R would that make a difference?

    User-agent: Googlebot-Image
    Disallow: /

    Is there check along with others


    Code:
    Sitemap: http://freewomensblogs.com/sitemap.xml
    
    
    User-agent: ADSAComponent
    Disallow: /
    
    User-agent: Alexibot
    Disallow: /
    
    User-agent: Aqua_Products
    Disallow: /
    
    User-agent: BackDoorBot
    Disallow: /
    
    User-agent: BecomeBot
    Disallow: /
    
    User-agent: BlowFish
    Disallow: /
    
    User-agent: Bookmark search tool
    Disallow: /
    
    User-agent: BotALot
    Disallow: /
    
    User-agent: BruinBot
    Disallow: /
    
    User-agent: BuiltBotTough
    Disallow: /
    
    User-agent: Bullseye
    Disallow: /
    
    User-agent: BunnySlippers
    Disallow: /
    
    User-agent: CheeseBot
    Disallow: /
    
    User-agent: CazoodleBot
    Disallow: /
    
    User-agent: CherryPicker
    Disallow: /
    
    User-agent: CherryPickerElite
    Disallow: /
    
    User-agent: CherryPickerSE
    Disallow: /
    
    User-agent: Copernic
    Disallow: /
    
    User-agent: CopyRightCheck
    Disallow: /
    
    User-agent: Crescent
    Disallow: /
    
    User-agent: DittoSpyder
    Disallow: /
    
    User-agent: DomainsDB.net
    Disallow: /
    
    User-agent: EmailCollector
    Disallow: /
    
    User-agent: EmailSiphon
    Disallow: /
    
    User-agent: EmailWolf
    Disallow: /
    
    User-agent: Enterprise_Search
    Disallow: /
    
    User-agent: EroCrawler
    Disallow: /
    
    User-agent: ExtractorPro
    Disallow: /
    
    User-agent: FairAd Client
    Disallow: /
    
    User-agent: Flaming AttackBot
    Disallow: /
    
    User-agent: Foobot
    Disallow: /
    
    User-agent: FreeFind
    Disallow: /
    
    User-agent: Gaisbot
    Disallow: /
    
    User-agent: GetRight
    Disallow: /
    
    User-agent: Harvest
    Disallow: /
    
    User-agent: Hatena Antenna
    Disallow: /
    
    User-agent: ia_archiver
    Disallow: /
    
    User-agent: InfoNaviRobot
    Disallow: /
    
    User-agent: Iron33
    Disallow: /
    
    User-agent: JennyBot
    Disallow: /
    
    User-agent: Jetbot
    Disallow: /
    
    User-agent: Kenjin Spider
    Disallow: /
    
    User-agent: Keyword Density
    Disallow: /
    
    User-agent: LNSpiderguy
    Disallow: /
    
    User-agent: LexiBot
    Disallow: /
    
    User-agent: LinkScan
    Disallow: /
    
    User-agent: LinkWalker
    Disallow: /
    
    User-agent: LinkextractorPro
    Disallow: /
    
    User-agent: MIIxpc
    Disallow: /
    
    User-agent: Mata Hari
    Disallow: /
    
    User-agent: Microsoft URL Control
    Disallow: /
    
    User-agent: Mister PiX
    Disallow: /
    
    User-agent: NICErsPRO
    Disallow: /
    
    User-agent: NPBot
    Disallow: /
    
    User-agent: NetAnts
    Disallow: /
    
    User-agent: NetMechanic
    Disallow: /
    
    User-agent: Nutch
    Disallow: /
    
    User-agent: Offline Explorer
    Disallow: /
    
    User-agent: OmniExplorer_Bot
    Disallow: /
    
    User-agent: Openbot
    Disallow: /
    
    User-agent: Openfind
    Disallow: /
    
    User-agent: Oracle Ultra Search
    Disallow: /
    
    User-agent: PerMan
    Disallow: /
    
    User-agent: ProPowerBot
    Disallow: /
    
    User-agent: ProWebWalker
    Disallow: /
    
    User-agent: Python-urllib
    Disallow: /
    
    User-agent: QueryN Metasearch
    Disallow: /
    
    User-agent: RMA
    Disallow: /
    
    User-agent: Radiation Retriever
    Disallow: /
    
    User-agent: RepoMonkey
    Disallow: /
    
    User-agent: SBIder
    Disallow: /
    
    User-agent: SiteSnagger
    Disallow: /
    
    User-agent: SpankBot
    Disallow: /
    
    User-agent: Stanford
    Disallow: /
    
    User-agent: Stanford Comp Sci
    Disallow: /
    
    User-agent: SurveyBot
    Disallow: /
    
    User-agent: Swooglebot
    Disallow: /
    
    User-agent: Szukacz
    Disallow: /
    
    User-agent: Teleport
    Disallow: /
    
    User-agent: TeleportPro
    Disallow: /
    
    User-agent: Telesoft
    Disallow: /
    
    User-agent: The Intraformant
    Disallow: /
    
    User-agent: TheNomad
    Disallow: /
    
    User-agent: True_Robot
    Disallow: /
    
    User-agent: TurnitinBot
    Disallow: /
    
    User-agent: URL Control
    Disallow: /
    
    User-agent: URL_Spider_Pro
    Disallow: /
    
    User-agent: URLy Warning
    Disallow: /
    
    User-agent: VCI
    Disallow: /
    
    User-agent: VCI WebViewer VCI WebViewer Win32
    Disallow: /
    
    User-agent: WWW-Collector-E
    Disallow: /
    
    User-agent: Web Image Collector
    Disallow: /
    
    User-agent: WebAuto
    Disallow: /
    
    User-agent: WebBandit
    Disallow: /
    
    User-agent: WebCopier
    Disallow: /
    
    User-agent: WebEnhancer
    Disallow: /
    
    User-agent: WebSauger
    Disallow: /
    
    User-agent: WebStripper
    Disallow: /
    
    User-agent: WebVac
    Disallow: /
    
    User-agent: WebZip
    Disallow: /
    
    User-agent: Website Quester
    Disallow: /
    
    User-agent: Webster Pro
    Disallow: /
    
    User-agent: Wget
    Disallow: /
    
    User-agent: Xenu's
    Disallow: /
    
    User-agent: Zeus
    Disallow: /
    
    User-agent: Zeus Link Scout
    Disallow: /
    
    User-agent: asterias
    Disallow: /
    
    User-agent: b2w/0.1
    Disallow: /
    
    User-agent: cosmos
    Disallow: /
    
    User-agent: dumbot
    Disallow: /
    
    User-agent: es
    Disallow: /
    
    User-agent: grub
    Disallow: /
    
    User-agent: grub-client
    Disallow: /
    
    User-agent: hloader
    Disallow: /
    
    User-agent: httplib
    Disallow: /
    
    User-agent: humanlinks
    Disallow: /
    
    User-agent: larbin
    Disallow: /
    
    User-agent: libWeb/clsHTTP
    Disallow: /
    
    User-agent: lwp-trivial
    Disallow: /
    
    User-agent: moget
    Disallow: /
    
    User-agent: naver
    Disallow: /
    
    User-agent: polybot
    Disallow: /
    
    User-agent: psbot
    Disallow: /
    
    User-agent: ru-robot
    Disallow: /
    
    User-agent: searchpreview
    Disallow: /
    
    User-agent: sootle
    Disallow: /
    
    User-agent: spanner
    Disallow: /
    
    User-agent: suzuran
    Disallow: /
    
    User-agent: toCrawl/UrlDispatcher
    Disallow: /
    
    User-agent: turingos
    Disallow: /
    
    User-agent: whowhere
    Disallow: /
    
    User-agent: Googlebot-Image
    Disallow: /
    
    User-agent: Yahoo-MMCrawler
    Disallow: /
    
    User-agent: msnbot
    Disallow: /*.doc$
    Disallow: /*.PDF$
    Disallow: /*.jpeg$
    Disallow: /*.jpg$
    Disallow: /*.png$
    Disallow: /*.gif$
    Disallow: /*.exe$
    Disallow: /*.mp3$
    Disallow: /*.mid$
    Disallow: /*.wav$
    Disallow: /*.swf$
    
    User-agent: *
    Disallow: /admin/
    Disallow: /axs/
    Disallow: /carp/
    Disallow: /cgi-bin/
    Disallow: /generator/
    Disallow: /guardian/
    Disallow: /images/
    Disallow: /inc/
    Disallow: /news/
    Disallow: /rss/
    Disallow: /spamtrap/
    Disallow: /config.php
    Disallow: /carpsetup.php
    Disallow: /*.doc$
    Disallow: /*.PDF$
    Disallow: /*.jpeg$
    Disallow: /*.jpg$
    Disallow: /*.png$
    Disallow: /*.gif$
    Disallow: /*.exe$
    Disallow: /*.mp3$
    Disallow: /*.mid$
    Disallow: /*.wav$
    Disallow: /*.swf$
    #Crawl-delay: 30
    What do I need to do now? None of this ia working

    Thanks in advance

    Sami
    Current Celebrity Gossip Movies & More TV Site
    Find out how I'm able to get up to 420 backlinks for month, by spending 30 seconds per day...all for FREE! - Click Here

  7. #7
    Snak3's Avatar
    Snak3 is offline Moderator
    Join Date
    Jul 2009
    Location
    Undisclosed Location
    Posts
    629
    Thanks
    155
    Thanked 190 Times in 121 Posts
    Quote Originally Posted by Sami4u View Post
    Hi,

    OK one step at a time.

    1.) I have had a codebreaker on the site for over a year now

    Check site:freewomensblogs.com - Google Search

    2.) I have this line in my .htaccess Yet I am still getting hotlinked

    Code:
    RewriteCond %{HTTP_REFERER} !^http://(.+\.)?freewomensblogs\.com/ [NC]
    RewriteCond %{HTTP_REFERER} !^$
    RewriteRule .*\.(jpe?g|gif|bmp|png)$ /images/nohotlink.jpe [L]
    3.)This is my Robots.txt But I see I have a Cap. R would that make a difference?

    User-agent: Googlebot-Image
    Disallow: /

    Is there check along with others


    Code:
    Sitemap: http://freewomensblogs.com/sitemap.xml
    
    
    User-agent: ADSAComponent
    Disallow: /
    
    User-agent: Alexibot
    Disallow: /
    
    User-agent: Aqua_Products
    Disallow: /
    
    User-agent: BackDoorBot
    Disallow: /
    
    User-agent: BecomeBot
    Disallow: /
    
    User-agent: BlowFish
    Disallow: /
    
    User-agent: Bookmark search tool
    Disallow: /
    
    User-agent: BotALot
    Disallow: /
    
    User-agent: BruinBot
    Disallow: /
    
    User-agent: BuiltBotTough
    Disallow: /
    
    User-agent: Bullseye
    Disallow: /
    
    User-agent: BunnySlippers
    Disallow: /
    
    User-agent: CheeseBot
    Disallow: /
    
    User-agent: CazoodleBot
    Disallow: /
    
    User-agent: CherryPicker
    Disallow: /
    
    User-agent: CherryPickerElite
    Disallow: /
    
    User-agent: CherryPickerSE
    Disallow: /
    
    User-agent: Copernic
    Disallow: /
    
    User-agent: CopyRightCheck
    Disallow: /
    
    User-agent: Crescent
    Disallow: /
    
    User-agent: DittoSpyder
    Disallow: /
    
    User-agent: DomainsDB.net
    Disallow: /
    
    User-agent: EmailCollector
    Disallow: /
    
    User-agent: EmailSiphon
    Disallow: /
    
    User-agent: EmailWolf
    Disallow: /
    
    User-agent: Enterprise_Search
    Disallow: /
    
    User-agent: EroCrawler
    Disallow: /
    
    User-agent: ExtractorPro
    Disallow: /
    
    User-agent: FairAd Client
    Disallow: /
    
    User-agent: Flaming AttackBot
    Disallow: /
    
    User-agent: Foobot
    Disallow: /
    
    User-agent: FreeFind
    Disallow: /
    
    User-agent: Gaisbot
    Disallow: /
    
    User-agent: GetRight
    Disallow: /
    
    User-agent: Harvest
    Disallow: /
    
    User-agent: Hatena Antenna
    Disallow: /
    
    User-agent: ia_archiver
    Disallow: /
    
    User-agent: InfoNaviRobot
    Disallow: /
    
    User-agent: Iron33
    Disallow: /
    
    User-agent: JennyBot
    Disallow: /
    
    User-agent: Jetbot
    Disallow: /
    
    User-agent: Kenjin Spider
    Disallow: /
    
    User-agent: Keyword Density
    Disallow: /
    
    User-agent: LNSpiderguy
    Disallow: /
    
    User-agent: LexiBot
    Disallow: /
    
    User-agent: LinkScan
    Disallow: /
    
    User-agent: LinkWalker
    Disallow: /
    
    User-agent: LinkextractorPro
    Disallow: /
    
    User-agent: MIIxpc
    Disallow: /
    
    User-agent: Mata Hari
    Disallow: /
    
    User-agent: Microsoft URL Control
    Disallow: /
    
    User-agent: Mister PiX
    Disallow: /
    
    User-agent: NICErsPRO
    Disallow: /
    
    User-agent: NPBot
    Disallow: /
    
    User-agent: NetAnts
    Disallow: /
    
    User-agent: NetMechanic
    Disallow: /
    
    User-agent: Nutch
    Disallow: /
    
    User-agent: Offline Explorer
    Disallow: /
    
    User-agent: OmniExplorer_Bot
    Disallow: /
    
    User-agent: Openbot
    Disallow: /
    
    User-agent: Openfind
    Disallow: /
    
    User-agent: Oracle Ultra Search
    Disallow: /
    
    User-agent: PerMan
    Disallow: /
    
    User-agent: ProPowerBot
    Disallow: /
    
    User-agent: ProWebWalker
    Disallow: /
    
    User-agent: Python-urllib
    Disallow: /
    
    User-agent: QueryN Metasearch
    Disallow: /
    
    User-agent: RMA
    Disallow: /
    
    User-agent: Radiation Retriever
    Disallow: /
    
    User-agent: RepoMonkey
    Disallow: /
    
    User-agent: SBIder
    Disallow: /
    
    User-agent: SiteSnagger
    Disallow: /
    
    User-agent: SpankBot
    Disallow: /
    
    User-agent: Stanford
    Disallow: /
    
    User-agent: Stanford Comp Sci
    Disallow: /
    
    User-agent: SurveyBot
    Disallow: /
    
    User-agent: Swooglebot
    Disallow: /
    
    User-agent: Szukacz
    Disallow: /
    
    User-agent: Teleport
    Disallow: /
    
    User-agent: TeleportPro
    Disallow: /
    
    User-agent: Telesoft
    Disallow: /
    
    User-agent: The Intraformant
    Disallow: /
    
    User-agent: TheNomad
    Disallow: /
    
    User-agent: True_Robot
    Disallow: /
    
    User-agent: TurnitinBot
    Disallow: /
    
    User-agent: URL Control
    Disallow: /
    
    User-agent: URL_Spider_Pro
    Disallow: /
    
    User-agent: URLy Warning
    Disallow: /
    
    User-agent: VCI
    Disallow: /
    
    User-agent: VCI WebViewer VCI WebViewer Win32
    Disallow: /
    
    User-agent: WWW-Collector-E
    Disallow: /
    
    User-agent: Web Image Collector
    Disallow: /
    
    User-agent: WebAuto
    Disallow: /
    
    User-agent: WebBandit
    Disallow: /
    
    User-agent: WebCopier
    Disallow: /
    
    User-agent: WebEnhancer
    Disallow: /
    
    User-agent: WebSauger
    Disallow: /
    
    User-agent: WebStripper
    Disallow: /
    
    User-agent: WebVac
    Disallow: /
    
    User-agent: WebZip
    Disallow: /
    
    User-agent: Website Quester
    Disallow: /
    
    User-agent: Webster Pro
    Disallow: /
    
    User-agent: Wget
    Disallow: /
    
    User-agent: Xenu's
    Disallow: /
    
    User-agent: Zeus
    Disallow: /
    
    User-agent: Zeus Link Scout
    Disallow: /
    
    User-agent: asterias
    Disallow: /
    
    User-agent: b2w/0.1
    Disallow: /
    
    User-agent: cosmos
    Disallow: /
    
    User-agent: dumbot
    Disallow: /
    
    User-agent: es
    Disallow: /
    
    User-agent: grub
    Disallow: /
    
    User-agent: grub-client
    Disallow: /
    
    User-agent: hloader
    Disallow: /
    
    User-agent: httplib
    Disallow: /
    
    User-agent: humanlinks
    Disallow: /
    
    User-agent: larbin
    Disallow: /
    
    User-agent: libWeb/clsHTTP
    Disallow: /
    
    User-agent: lwp-trivial
    Disallow: /
    
    User-agent: moget
    Disallow: /
    
    User-agent: naver
    Disallow: /
    
    User-agent: polybot
    Disallow: /
    
    User-agent: psbot
    Disallow: /
    
    User-agent: ru-robot
    Disallow: /
    
    User-agent: searchpreview
    Disallow: /
    
    User-agent: sootle
    Disallow: /
    
    User-agent: spanner
    Disallow: /
    
    User-agent: suzuran
    Disallow: /
    
    User-agent: toCrawl/UrlDispatcher
    Disallow: /
    
    User-agent: turingos
    Disallow: /
    
    User-agent: whowhere
    Disallow: /
    
    User-agent: Googlebot-Image
    Disallow: /
    
    User-agent: Yahoo-MMCrawler
    Disallow: /
    
    User-agent: msnbot
    Disallow: /*.doc$
    Disallow: /*.PDF$
    Disallow: /*.jpeg$
    Disallow: /*.jpg$
    Disallow: /*.png$
    Disallow: /*.gif$
    Disallow: /*.exe$
    Disallow: /*.mp3$
    Disallow: /*.mid$
    Disallow: /*.wav$
    Disallow: /*.swf$
    
    User-agent: *
    Disallow: /admin/
    Disallow: /axs/
    Disallow: /carp/
    Disallow: /cgi-bin/
    Disallow: /generator/
    Disallow: /guardian/
    Disallow: /images/
    Disallow: /inc/
    Disallow: /news/
    Disallow: /rss/
    Disallow: /spamtrap/
    Disallow: /config.php
    Disallow: /carpsetup.php
    Disallow: /*.doc$
    Disallow: /*.PDF$
    Disallow: /*.jpeg$
    Disallow: /*.jpg$
    Disallow: /*.png$
    Disallow: /*.gif$
    Disallow: /*.exe$
    Disallow: /*.mp3$
    Disallow: /*.mid$
    Disallow: /*.wav$
    Disallow: /*.swf$
    #Crawl-delay: 30
    What do I need to do now? None of this ia working

    Thanks in advance

    Sami
    Disallowing access to Malicious Bots from the robots.txt wont help. I doubt they even bother to check the robots.txt, following instructions from it is not something that would ever happen.

    Honestly speaking, you should be happy that you are receiving this traffic. Be it Google images or whatever, as long as there is a possibility for its conversion to atleast some revenue i don't think you should block it.

  8. #8
    TopDogger's Avatar
    TopDogger is offline Über Hund
    Join Date
    Jan 2009
    Location
    Hellfire, AZ
    Posts
    2,946
    Thanks
    341
    Thanked 883 Times in 671 Posts
    I agree with snak3. Bad bots ignore the robots.txt file. It is a voluntary file.

    The Googlebot-Image spider usually does follow the robots.txt file. If that has been in there for a year, it should be working.

    The Cap R in the file name is your problem. The robots.txt file name needs to be all lower case. Naming it Robots.txt is incorrect.

    All file names are case sensitive on Unix and Linux servers.

    I just verified that this is the problem. When you enter robots.txt after your domain name, you get the default robots.txt that WordPress generates, which merely contains:

    Code:
    User-agent: *
    Disallow:
    When you name the file properly, WordPress should stop displaying their default file.
    "Democracy is two wolves and a lamb voting on what to have for lunch. Liberty is a well-armed lamb contesting the vote." -- Benjamin Franklin


  9. Thanked by:

    Sami4u (4 February, 2010)

Similar Threads

  1. Site That Analyses your website
    By Andy101 in forum Tech-Talk
    Replies: 1
    Last Post: 15 April, 2011, 11:24 AM
  2. [WTS] Fishing Gear E-Commerce Site For Sale
    By Zethix in forum Sites
    Replies: 0
    Last Post: 10 April, 2011, 00:40 AM
  3. [Free] Get On Site SEO Audit Report for Your Website
    By GreyHatSEO in forum Services
    Replies: 0
    Last Post: 10 October, 2010, 17:54 PM
  4. [WTB] signature links on fishing related forum
    By budhi1976 in forum Links
    Replies: 1
    Last Post: 26 May, 2010, 02:05 AM

Tags for this Thread

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •