Encyclopedia

WebCrawler

Also found in: Dictionary, Medical, Financial, Wikipedia.

WebCrawler

(World-Wide Web)
A free World-Wide Web search engine developed by Brian Pinkerton at the University of Washington and now moved to America Online, Inc. WebCrawler collects URLs by searching the Internet and allows users to perform keyword searches through a World-Wide Web browser.

http://webcrawler.com/.
This article is provided by FOLDOC - Free Online Dictionary of Computing (foldoc.org)

WebCrawler

(1) A search portal that searches other search engines for results, provides yellow and white page lookup and offers three levels of searching: general Web pages, news and photos. It also provides featured listings and site recommendations by category. The site is run by Infospace, Inc., which also owns the MetaCrawler.com and Dogpile.com brands. For more information, visit www.webcrawler.com. See Web search engines.

(2) A Web crawler. See spider.
Copyright © 1981-2025 by The Computer Language Company Inc. All Rights reserved. THIS DEFINITION IS FOR PERSONAL USE ONLY. All other reproduction is strictly prohibited without permission from the publisher.
Mentioned in
References in periodicals archive
InfoSpace operates a number of metasearch engine brands, including Dogpile and Webcrawler.
cna.gob.mx/ http://www.sedatu.gob.mx/sraweb /biblioteca-virtual-agraria/ Secretaria de Agricultura, Enciclopedia Virtual Agraria Ganaderia, Desarrollo Rural, http://www.sedatu.gob.mx/sraweb/ Pesca y Alimentacion (SAGARPA) biblioteca-virtual-agraria/ http://www.sagarpa.gob.mx/ Paginas/default.aspx Secretaria de Turismo (SECTUR) Instituto Mexicano de la http://www.sectur.gob.mx/ Propiedad Industrial (IMPI) http://www.impi.gob.mx/wb/IMPI/ patentes En cuanto a la configuracion del webcrawler Mbot, la especificacion de dominio se refiere a las dependencias del gobierno federal, y se establecio un limite de 3 niveles de profundidad; es decir los enlaces se hacen sobre la topografia web.
It also competes with Infospace s Dogpile, WebCrawler and MetaCrawler in metasearch, or returning results from multiple search engines.
com), Lycos (http://www.lycos.com), or WebCrawler (http://www.webcrawler.com).
Shortly after the RBSE Spider, WebCrawler and the Lycos WebBots were developed (Eichmann., 1994; Pinkerton., 1994; Zeinalipour-Yazti and Dikaiakos., 2001).
(291.) For example, most would agree that the following sites are commonly recognizable as search engines: AltaVista, Dogpile, Go, Google, Hotbot, Looksmart, Lycos, Mamma, Metacrawler, Northern Light, Open Directory Project, NBCi, Webcrawler, Yahoo!.
The first well-known full-text search engine on the Web was WebCrawler in 1994, soon joined by Infoseek and Lycos.
(2) Google, Alltheweb, Yahoo, AltaVista, WebCrawler, MetaCrawler, Dogpile, etc.
Copyright © 2003-2025 Farlex, Inc Disclaimer
All content on this website, including dictionary, thesaurus, literature, geography, and other reference data is for informational purposes only. This information should not be considered complete, up to date, and is not intended to be used in place of a visit, consultation, or advice of a legal, medical, or any other professional.