Results 1 to 5 of 5

Thread: What is the difference between .htaccess and robots.txt?

  1. #1
    indiamaphosting is offline Internet Marketing and Web Design Company in India
    Join Date
    Nov 2010
    Bangalore, India
    Thanked 1 Time in 1 Post

    What is the difference between .htaccess and robots.txt?

    Please someone let me know the difference between these two:

    .htaccess and robots.txt

  2. #2
    AJKpeter is offline Banned
    Join Date
    Dec 2010
    Thanked 0 Times in 0 Posts
    .htaccess is a file that is giving right to all the visitors and robots.txt is only for search engine crawlers

  3. #3
    netbhu is offline Unknown Net Builder
    Join Date
    Jan 2011
    Thanked 0 Times in 0 Posts
    .htacess is for Apache server only. robots.txt is normal text file

  4. #4
    UncleP's Avatar
    UncleP is offline The perfect face for radio
    Join Date
    Nov 2009
    Thanked 91 Times in 61 Posts
    A more detailed explanation:

    The robots.txt file is a simple text file (as the name suggests) that is just for bots and spiders (web crawlers) to look at for reference. It can contain a list of what pages/directories are not supposed to be index or crawled by the bots. It can also be ignored by them and often is by 'bad' bots from unscrupulous sites like phishers and spammers. It should not be relied on to keep anything out. It is a purely passive 'read only' type file and is a suggestion rather than an instruction. It can usually be seen just by typing it's name in a browser bar and is not hidden.

    The .htaccess file is an apache server system file that can contain instructions for the server to carry out given certain conditions. Like blocking IP's or rewriting webpages or redirecting error pages and such. This can be relied on to perform it's job like keeping out spammers etc. and would be what you should use for guaranteed functions. It cannot be ignored and is an 'active' type file that must be obeyed. It is hidden from view and cannot be accessed by visitors.

    Summary: robots.txt = suggestions & .htaccess = instructions (system file).

    I hope that's clear now
    If I can't be a good example, I'll just have to be a terrible warning...

  5. #5
    bhartzer is offline Net Builder
    Join Date
    Dec 2008
    Thanked 135 Times in 101 Posts
    .htaccess is a server file, and really can only be "seen" by the server or the website owner.

    robots.txt is a public file that anyone, mainly search engines, can see.
    Need links? Try AuthorLinks where you can buy or sell links based on Authorship and Klout score. Check out my blog or like me on Facebook.

Similar Threads

  1. Help with Robots.txt
    By 5starpix in forum Building
    Replies: 4
    Last Post: 11 February, 2010, 02:27 AM
  2. robots.txt help
    By Sami4u in forum Building
    Replies: 9
    Last Post: 27 September, 2009, 07:43 AM
  3. Robots.txt?
    By dmi in forum Managing
    Replies: 15
    Last Post: 9 September, 2009, 17:15 PM
  4. Block Robots and Web Downloaders with robots.txt
    By Will.Spencer in forum Managing
    Replies: 12
    Last Post: 6 June, 2009, 15:40 PM
  5. What is robots.txt file?
    By ltimranjaved in forum Managing
    Replies: 1
    Last Post: 26 May, 2009, 12:27 PM

Tags for this Thread


Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts