Also found in: Dictionary, Thesaurus, Medical, Financial, Wikipedia.
A free World-Wide Web search engine developed by Brian Pinkerton at the University of Washington and now moved to America Online, Inc. WebCrawler collects URLs by searching the Internet and allows users to perform keyword searches through a World-Wide Web browser.
This article is provided by FOLDOC - Free Online Dictionary of Computing (foldoc.org)
WebCrawler(1) A search portal that searches other search engines for results, provides yellow and white page lookup and offers three levels of searching: general Web pages, news and photos. It also provides featured listings and site recommendations by category. The site is run by Infospace, Inc., which also owns the MetaCrawler.com and Dogpile.com brands. For more information, visit www.webcrawler.com. See Web search engines.
(2) A Web crawler. See spider.
Copyright © 1981-2019 by The Computer Language Company Inc. All Rights reserved. THIS DEFINITION IS FOR PERSONAL USE ONLY. All other reproduction is strictly prohibited without permission from the publisher.