Dictionary, Encyclopedia and Thesaurus - The Free Dictionary

1,522,272,012 visitors served.

forum mailing list For webmasters

New: Language forums

Dictionary/
thesaurus

Medical
dictionary

Legal
dictionary

Financial
dictionary

Idioms

Encyclopedia

Wikipedia
encyclopedia

standard for robot exclusion

Also found in: Acronyms, Wikipedia

0.06 sec.

(World-Wide Web)

standard for robot exclusion - A proposal to try to prevent the havoc wreaked by many of the early World-Wide Web robots when they retrieved documents too rapidly or retrieved documents that had side effects (such as voting). The proposed standard for robot exclusion offers a solution to these problems in the form of a file called "robots.txt" placed in the document root of the web site.

W3C standard.

How to thank TFD for its existence? Tell a friend about us, add a link to this page, add the site to iGoogle, or visit webmaster's page for free fun content.

?Page tools

Printer friendly
Cite / link

? Mentioned in

robot exclusion standard

Encyclopedia browser

? Full browser

standard cell
Standard Commands for Programmable Instruments
Standard d'Echange et de Transfert
standard data format
standard definition
standard deviation
standard extension
standard for robot exclusion
Standard for the exchange of product model data
standard gauge
Standard Generalised Markup Language
Standard Generalized Markup Language
Standard Grade
standard I/O
standard input

standard film
standard film
standard film
Standard Films
Standard Financial Information Structure
Standard Financial System
Standard Finite Difference
Standard fireworks
Standard First Aid
Standard First Order Logic
Standard First Quality
Standard Flat Rate Shipping Service
Standard Flight Data Recorder
Standard Floating License Manager
Standard Flood Hazard Determination Form
Standard Flood Insurance Policy

Standard Flower Show
Standard for CD-ROM file system
Standard for Embedded Core Test
Standard for Exchange of Product Data
Standard for Handling of Exception Error Protocol (SHEEP)
Standard for Harassment & Racism Prevention
Standard for Interoperable LAN Security
Standard for Public-Key Infrastructure
standard for robot exclusion
Standard for the Exchange of Product model data
Standard for the Exchange of Product model data
Standard for the Exchange of Product model data
Standard for the Uniform Scheduling of Drugs and Poisons
Standard for the Uniform Scheduling of Drugs and Poisons
Standard Foreign Rate Level
Standard form
Standard form

Standard form
Standard Form 180
Standard Form 312
Standard form 330
Standard form contract
Standard form contract
Standard Form of Agreement
Standard Form of Cost Analysis
Standard Form of Union Agreement
Standard Format and Content Guidance
Standard Format for Equipment List
Standard Formatted Data Unit
Standard forms of contract
Standard French
Standard Frequency Action Format
Standard Fruit

Free Tools:	For surfers: Browser extension \| Word of the Day \| Help For webmasters: Free content \| Linking \| Lookup box \| Double-click lookup \| Partner with us

Disclaimer | Privacy policy | Feedback | Copyright © 2009 Farlex, Inc.

All content on this website, including dictionary, thesaurus, literature, geography, and other reference data is for informational purposes only. This information should not be considered complete, up to date, and is not intended to be used in place of a visit, consultation, or advice of a legal, medical, or any other professional. Terms of Use.