WebCrawler


Also found in: Dictionary, Thesaurus, Medical, Financial, Wikipedia.
Related to WebCrawler: MetaCrawler, Lycos, AltaVista, Search engines

WebCrawler

(World-Wide Web)
A free World-Wide Web search engine developed by Brian Pinkerton at the University of Washington and now moved to America Online, Inc. WebCrawler collects URLs by searching the Internet and allows users to perform keyword searches through a World-Wide Web browser.

http://webcrawler.com/.
This article is provided by FOLDOC - Free Online Dictionary of Computing (foldoc.org)

WebCrawler

(1) A search portal that searches other search engines for results, provides yellow and white page lookup and offers three levels of searching: general Web pages, news and photos. It also provides featured listings and site recommendations by category. The site is run by Infospace, Inc., which also owns the MetaCrawler.com and Dogpile.com brands. For more information, visit www.webcrawler.com. See Web search engines.

(2) A Web crawler. See spider.
Copyright © 1981-2019 by The Computer Language Company Inc. All Rights reserved. THIS DEFINITION IS FOR PERSONAL USE ONLY. All other reproduction is strictly prohibited without permission from the publisher.
References in periodicals archive ?
InfoSpace operates a number of metasearch engine brands, including Dogpile and Webcrawler.
cna.gob.mx/ http://www.sedatu.gob.mx/sraweb /biblioteca-virtual-agraria/ Secretaria de Agricultura, Enciclopedia Virtual Agraria Ganaderia, Desarrollo Rural, http://www.sedatu.gob.mx/sraweb/ Pesca y Alimentacion (SAGARPA) biblioteca-virtual-agraria/ http://www.sagarpa.gob.mx/ Paginas/default.aspx Secretaria de Turismo (SECTUR) Instituto Mexicano de la http://www.sectur.gob.mx/ Propiedad Industrial (IMPI) http://www.impi.gob.mx/wb/IMPI/ patentes En cuanto a la configuracion del webcrawler Mbot, la especificacion de dominio se refiere a las dependencias del gobierno federal, y se establecio un limite de 3 niveles de profundidad; es decir los enlaces se hacen sobre la topografia web.
It also competes with Infospace s Dogpile, WebCrawler and MetaCrawler in metasearch, or returning results from multiple search engines.
com), Lycos (http://www.lycos.com), or WebCrawler (http://www.webcrawler.com).
Shortly after the RBSE Spider, WebCrawler and the Lycos WebBots were developed (Eichmann., 1994; Pinkerton., 1994; Zeinalipour-Yazti and Dikaiakos., 2001).
(291.) For example, most would agree that the following sites are commonly recognizable as search engines: AltaVista, Dogpile, Go, Google, Hotbot, Looksmart, Lycos, Mamma, Metacrawler, Northern Light, Open Directory Project, NBCi, Webcrawler, Yahoo!.
The first well-known full-text search engine on the Web was WebCrawler in 1994, soon joined by Infoseek and Lycos.
Moukdad and Large analyzed over 2,000 search strategies submitted by users to WebCrawler to determine query characteristics and also to try "to understand how these users view the Web" (2001, p.
(2) Google, Alltheweb, Yahoo, AltaVista, WebCrawler, MetaCrawler, Dogpile, etc.