Thread: How is Google finding pages which don't have any links to them?

How can Googlebot crawl and index pages that don't have any links to them on my website? I find each day two or three pages in the index that don't have any links to them on my site. The pages are generated by the search field of my website.


I thought I must share this good video with netbuilders users . If it is not displaying here than check this video from this link - [ame="http://www.youtube.com/watch?v=xS0oHYZafTQ"]Google Indexing Video[/ame] .

Thanks

I don't have any speakers on my PC. How does Google crawl the pages without any links?

I'm guessing that they crawl the folders that contain other pages.

or sitemap ???

In video this guy mention that if you have created one keyword and it is getting famous than Google will start crawling profile links and other inside links which are not indexed but comes in searched surrounding keywords . I didn't understood whole method but senior member of Netbuilder may explain it in better way ...

Originally Posted by badmash

In video this guy mention that if you have created one keyword and it is getting famous than Google will start crawling profile links and other inside links which are not indexed but comes in searched surrounding keywords . I didn't understood whole method but senior member of Netbuilder may explain it in better way ...

Perhaps the Google Toolbar and Chrome are sending data back to Google that they use to crawl and rank pages.

I believe that the bot will also crawl contents of folders that have no links. So for example, you have a site "www.thesite.com/mystuff/". The bot would crawl the "mystuff" folder. Link popularity decides whether the contents of the folder gets indexed and appears in the results.

Originally Posted by SonnyCooL

or sitemap ???

A sitemap would be an inbound link.

Originally Posted by bogart

Perhaps the Google Toolbar and Chrome are sending data back to Google that they use to crawl and rank pages..

I think it is getting data from the toolbar. I have seen administration pages show up in Google Webmaster Tools, even though there is no way for a spider to access to those pages due to password protection.

Chrome is another distinct possibility, but I only use that to test web pages for proper rendering.

Google has a long history of gathering information without your knowledge or permission.

Originally Posted by TopDogger

I think it is getting data from the toolbar. I have seen administration pages show up in Google Webmaster Tools, even though there is no way for a spider to access to those pages due to password protection.

Chrome is another distinct possibility, but I only use that to test web pages for proper rendering.

Google has a long history of gathering information without your knowledge or permission.

Links, Sitemaps, Google Toolbar, Chrome, Chrome OS? (possible), Android Surfing
and lastly, Google hacks your directories to extract pages. (kidding)

To add to all the above options, wordpress pings pages automatically...this might also cause G to crawl that page and index it..

Yep, the apparently "unlinked" pages, are in some way. So, that means, if you don't want your pages to be crawled, then password protect them


~Mike

Also, Google could possibly track the pages via E-mail and Gtalk (if you share link with other contact) since all links are scanned by google and filtered for protection.