Crawlers, Robots and Spiders

Information

Crawlers are one of the three basic types of search engines. The other two are human powered or a combination of both.

Crawler search engines have indexes that receive data from robots. Robots are computer programs that are also called spiders.

They ?crawl? all over the internet to provide the internet user with the best results when they type a keyword into a search engine. An example of a human powered search engine or directory would be Yahoo. Google is a great example of a crawler search engine.

Submit Site

Search Crawlers, Robots and Spiders: Google, Yahoo, MSN

dirSpace
Arts and Humanities
Computers
Shopping
Health & Fitness