![]() 1,074,621,755 visitors served. |
|
![]() Dictionary/ thesaurus | ![]() Medical dictionary | ![]() Legal dictionary | ![]() Financial dictionary | ![]() Acronyms | ![]() Idioms | ![]() Encyclopedia | ![]() Wikipedia encyclopedia | ? |
crawler |
Also found in: Dictionary/thesaurus, Wikipedia, Hutchinson | 0.87 sec. |
|
Also known as a "Web crawler," "spider," "ant," "robot" (bot) and "intelligent agent," a crawler is a program that searches for information on the Web. Crawlers are widely used by Web search engines to index all the pages on a site by following the links from page to page. The search engine then summarizes the content and adds the links to their indexes. They are also used to locate Web pages that sell a particular product or to find blogs that have opinions about a product. See spidering program.
How to thank TFD for its existence? Tell a friend about us, add a link to this page, add the site to iGoogle, or visit webmaster's page for free fun content. |
|
? Mentioned in |
|---|
| Free Tools: |
For surfers:
Browser extension |
Word of the Day |
Help
For webmasters: Free content | Linking | Lookup box | Double-click lookup | Partner with us |
|
|---|