Page 1 of 2 12 LastLast
Results 1 to 10 of 13

Thread: How is Google finding pages which don't have any links to them?

  1. #1
    badmash's Avatar
    badmash is offline Aham Brahmasmi
    Join Date
    Jul 2009
    Posts
    661
    Thanks
    65
    Thanked 139 Times in 110 Posts

    How is Google finding pages which don't have any links to them?

    How can Googlebot crawl and index pages that don't have any links to them on my website? I find each day two or three pages in the index that don't have any links to them on my site. The pages are generated by the search field of my website.


    I thought I must share this good video with netbuilders users . If it is not displaying here than check this video from this link - [ame="http://www.youtube.com/watch?v=xS0oHYZafTQ"]Google Indexing Video[/ame] .

    Thanks

  2. #2
    bogart's Avatar
    bogart is offline Super Moderator
    Join Date
    May 2009
    Location
    New York
    Posts
    3,772
    Thanks
    1,886
    Thanked 776 Times in 609 Posts
    I don't have any speakers on my PC. How does Google crawl the pages without any links?

    I'm guessing that they crawl the folders that contain other pages.

  3. #3
    SonnyCooL's Avatar
    SonnyCooL is offline HeeHa
    Join Date
    Jan 2010
    Location
    Melb/Malaysia
    Posts
    920
    Thanks
    250
    Thanked 92 Times in 78 Posts

  4. #4
    badmash's Avatar
    badmash is offline Aham Brahmasmi
    Join Date
    Jul 2009
    Posts
    661
    Thanks
    65
    Thanked 139 Times in 110 Posts
    In video this guy mention that if you have created one keyword and it is getting famous than Google will start crawling profile links and other inside links which are not indexed but comes in searched surrounding keywords . I didn't understood whole method but senior member of Netbuilder may explain it in better way ...

  5. Thanked by:

    bogart (16 September, 2010)

  6. #5
    bogart's Avatar
    bogart is offline Super Moderator
    Join Date
    May 2009
    Location
    New York
    Posts
    3,772
    Thanks
    1,886
    Thanked 776 Times in 609 Posts
    Quote Originally Posted by badmash View Post
    In video this guy mention that if you have created one keyword and it is getting famous than Google will start crawling profile links and other inside links which are not indexed but comes in searched surrounding keywords . I didn't understood whole method but senior member of Netbuilder may explain it in better way ...
    Perhaps the Google Toolbar and Chrome are sending data back to Google that they use to crawl and rank pages.

    I believe that the bot will also crawl contents of folders that have no links. So for example, you have a site "www.thesite.com/mystuff/". The bot would crawl the "mystuff" folder. Link popularity decides whether the contents of the folder gets indexed and appears in the results.

    Quote Originally Posted by SonnyCooL View Post
    or sitemap ???
    A sitemap would be an inbound link.

  7. #6
    TopDogger's Avatar
    TopDogger is offline Über Hund
    Join Date
    Jan 2009
    Location
    Hellfire, AZ
    Posts
    3,050
    Thanks
    345
    Thanked 909 Times in 694 Posts
    Quote Originally Posted by bogart View Post
    Perhaps the Google Toolbar and Chrome are sending data back to Google that they use to crawl and rank pages..
    I think it is getting data from the toolbar. I have seen administration pages show up in Google Webmaster Tools, even though there is no way for a spider to access to those pages due to password protection.

    Chrome is another distinct possibility, but I only use that to test web pages for proper rendering.

    Google has a long history of gathering information without your knowledge or permission.
    "Democracy is two wolves and a lamb voting on what to have for lunch. Liberty is a well-armed lamb contesting the vote." -- Benjamin Franklin


  8. Thanked by:

    Aziz (16 September, 2010), bogart (17 September, 2010)

  9. #7
    Aziz's Avatar
    Aziz is offline no investment, no glory
    Join Date
    May 2009
    Location
    IL
    Posts
    736
    Thanks
    588
    Thanked 243 Times in 168 Posts
    Quote Originally Posted by TopDogger View Post
    I think it is getting data from the toolbar. I have seen administration pages show up in Google Webmaster Tools, even though there is no way for a spider to access to those pages due to password protection.

    Chrome is another distinct possibility, but I only use that to test web pages for proper rendering.

    Google has a long history of gathering information without your knowledge or permission.
    Links, Sitemaps, Google Toolbar, Chrome, Chrome OS? (possible), Android Surfing
    and lastly, Google hacks your directories to extract pages. (kidding)

  10. #8
    rome9t9's Avatar
    rome9t9 is offline No Longer Loves SEO
    Join Date
    Mar 2009
    Location
    If I tell you, I would have to kill you.
    Posts
    614
    Blog Entries
    4
    Thanks
    168
    Thanked 105 Times in 77 Posts
    To add to all the above options, wordpress pings pages automatically...this might also cause G to crawl that page and index it..

  11. #9
    Mike30's Avatar
    Mike30 is offline Looking Forward...
    Join Date
    May 2009
    Location
    @ Wihee
    Posts
    158
    Blog Entries
    18
    Thanks
    73
    Thanked 22 Times in 21 Posts
    Yep, the apparently "unlinked" pages, are in some way. So, that means, if you don't want your pages to be crawled, then password protect them


    ~Mike

  12. #10
    Aziz's Avatar
    Aziz is offline no investment, no glory
    Join Date
    May 2009
    Location
    IL
    Posts
    736
    Thanks
    588
    Thanked 243 Times in 168 Posts
    Also, Google could possibly track the pages via E-mail and Gtalk (if you share link with other contact) since all links are scanned by google and filtered for protection.

  13. Thanked by:

    bogart (18 September, 2010), javanx3d (17 September, 2010)

Page 1 of 2 12 LastLast

Similar Threads

  1. Google Not Caching Pages (And AdSense PSAs)
    By Zash in forum On-Site SEO
    Replies: 4
    Last Post: 10 August, 2010, 02:15 AM
  2. Replies: 0
    Last Post: 5 April, 2010, 16:37 PM
  3. Finding Internal Pages with PR
    By 5starpix in forum Promoting
    Replies: 3
    Last Post: 24 February, 2010, 11:15 AM
  4. [WTS] Selling links in report: "Finding Hungry Markets"
    By DotComBum in forum Links
    Replies: 0
    Last Post: 21 September, 2009, 05:08 AM
  5. Are Urls from google profile pages usefull?
    By irahat in forum Promoting
    Replies: 0
    Last Post: 18 August, 2009, 20:14 PM

Tags for this Thread

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •