Page 1 of 2 12 LastLast
Results 1 to 10 of 13

Thread: How is Google finding pages which don't have any links to them?

Hybrid View

  1. How is Google finding pages which don't have any links to them?

    How can Googlebot crawl and index pages that don't have any links to them on my website? I find each day two or three pages in the index that don't have any links to them on my site. The pages are generated by the search field of my website.


    I thought I must share this good video with netbuilders users . If it is not displaying here than check this video from this link - [ame="http://www.youtube.com/watch?v=xS0oHYZafTQ"]Google Indexing Video[/ame] .

    Thanks

  2. #2
    Join Date
    May 2009
    Location
    New York
    Posts
    3,772
    I don't have any speakers on my PC. How does Google crawl the pages without any links?

    I'm guessing that they crawl the folders that contain other pages.

  3. #3

  4. In video this guy mention that if you have created one keyword and it is getting famous than Google will start crawling profile links and other inside links which are not indexed but comes in searched surrounding keywords . I didn't understood whole method but senior member of Netbuilder may explain it in better way ...

  5. #5
    Join Date
    May 2009
    Location
    New York
    Posts
    3,772
    Quote Originally Posted by badmash View Post
    In video this guy mention that if you have created one keyword and it is getting famous than Google will start crawling profile links and other inside links which are not indexed but comes in searched surrounding keywords . I didn't understood whole method but senior member of Netbuilder may explain it in better way ...
    Perhaps the Google Toolbar and Chrome are sending data back to Google that they use to crawl and rank pages.

    I believe that the bot will also crawl contents of folders that have no links. So for example, you have a site "www.thesite.com/mystuff/". The bot would crawl the "mystuff" folder. Link popularity decides whether the contents of the folder gets indexed and appears in the results.

    Quote Originally Posted by SonnyCooL View Post
    or sitemap ???
    A sitemap would be an inbound link.

  6. #6
    Quote Originally Posted by bogart View Post
    Perhaps the Google Toolbar and Chrome are sending data back to Google that they use to crawl and rank pages..
    I think it is getting data from the toolbar. I have seen administration pages show up in Google Webmaster Tools, even though there is no way for a spider to access to those pages due to password protection.

    Chrome is another distinct possibility, but I only use that to test web pages for proper rendering.

    Google has a long history of gathering information without your knowledge or permission.
    "Democracy is two wolves and a lamb voting on what to have for lunch. Liberty is a well-armed lamb contesting the vote." -- Benjamin Franklin


  7. #7
    Quote Originally Posted by TopDogger View Post
    I think it is getting data from the toolbar. I have seen administration pages show up in Google Webmaster Tools, even though there is no way for a spider to access to those pages due to password protection.

    Chrome is another distinct possibility, but I only use that to test web pages for proper rendering.

    Google has a long history of gathering information without your knowledge or permission.
    Links, Sitemaps, Google Toolbar, Chrome, Chrome OS? (possible), Android Surfing
    and lastly, Google hacks your directories to extract pages. (kidding)

  8. #8
    Join Date
    Mar 2009
    Location
    If I tell you, I would have to kill you.
    Posts
    614
    To add to all the above options, wordpress pings pages automatically...this might also cause G to crawl that page and index it..

  9. #9
    Yep, the apparently "unlinked" pages, are in some way. So, that means, if you don't want your pages to be crawled, then password protect them


    ~Mike

  10. #10
    Also, Google could possibly track the pages via E-mail and Gtalk (if you share link with other contact) since all links are scanned by google and filtered for protection.

Page 1 of 2 12 LastLast

Similar Threads

  1. Google Not Caching Pages (And AdSense PSAs)
    By Zash in forum On-Site SEO
    Replies: 4
    Last Post: 10 August, 2010, 02:15 AM
  2. Replies: 0
    Last Post: 5 April, 2010, 16:37 PM
  3. Finding Internal Pages with PR
    By 5starpix in forum Promoting
    Replies: 3
    Last Post: 24 February, 2010, 12:15 PM
  4. [WTS] Selling links in report: "Finding Hungry Markets"
    By DotComBum in forum Links
    Replies: 0
    Last Post: 21 September, 2009, 05:08 AM
  5. Are Urls from google profile pages usefull?
    By irahat in forum Promoting
    Replies: 0
    Last Post: 18 August, 2009, 20:14 PM

Tags for this Thread

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •