Thread: Search Engine Crawler and Spider

Hi,
I need to know that is there any difference between search engine Crawler and Spider. How does they work independently ?

Heya joy! They're essentially one in the same. In a nutshell, search engine crawlers aka Web crawlers are also known as spiders, ants, and robots. They're simply programs that run in order to index, validate, and maintain sites, etc.

Originally Posted by m42

Heya joy! They're essentially one in the same. In a nutshell, search engine crawlers aka Web crawlers are also known as spiders, ants, and robots. They're simply programs that run in order to index, validate, and maintain sites, etc.

Ok, so they all do same things. Don't they have any specific tusk? But what do you mean by AKA?

They are all the same. They just have different names.

AKA means "Also Known As."

I've already given you the tasks above, but I think Wikipedia may be able to explain it better for you.

http://en.wikipedia.org/wiki/Web_crawlers

Hope this clarifies it.

They are whatever you want to call them. A spider is simply computer code running on a server that pulls in HTML/XHTML code from other web sites and dissects it or performs some other task.

There actually is nothing physically crawling through your site. All the activity takes place on the spider's server.