surface Web

(redirected from crawlable Web)

surface Web

Content on the World Wide Web that is available to the general public and for indexing by a search engine (see spider). Also called the "crawlable Web" and "public Web," links to the pages on the surface Web are displayed on search engine results pages. Descriptive text on the pages as well as metatags hidden within the Web pages identify the page's contents for the various search engines. Contrast with deep Web. See search engine optimization and spider.
References in periodicals archive ?
There's a lot of stuff you may want to find that simply isn't in the crawlable Web," he said, often because the content is dynamically generated or contained in a relational database.