precision
[prə′sizh·ən] (mathematics)
The number of digits in a decimal fraction to the right of the decimal point.
(navigation)
In air operations, pertaining to a navigational facility which provides a combined azimuth and glide slope guidance to a runway.
(science and technology)
The measure of the range of values of a set of measurements; indicates reproducibility of the observations.
McGraw-Hill Dictionary of Scientific & Technical Terms, 6E, Copyright © 2003 by The McGraw-Hill Companies, Inc.
precision
(mathematics)This article is provided by FOLDOC - Free Online Dictionary of Computing (foldoc.org)
precision
The number of digits used to express the fractional part of a number. The more digits, the more precision. See single precision and double precision. See also accuracy.Copyright © 1981-2025 by The Computer Language Company Inc. All Rights reserved. THIS DEFINITION IS FOR PERSONAL USE ONLY. All other reproduction is strictly prohibited without permission from the publisher.
The following article is from The Great Soviet Encyclopedia (1979). It might be outdated or ideologically biased.
Precision
a measure of the dispersion of the values of a random variable. The precision h is related to the standard deviation σ by the formula
This method of measuring dispersion is justified since, in the case of a normal distribution, the probability density of a random variable with precision h and mathematical expectation a is described by the formula
The precision is used as a measure of the dispersion primarily in gunnery theory and the theory of errors.
The Great Soviet Encyclopedia, 3rd Edition (1970-1979). © 2010 The Gale Group, Inc. All rights reserved.