precision


Also found in: Dictionary, Thesaurus, Medical, Legal, Financial, Acronyms, Wikipedia.

precision

[prə′sizh·ən]
(mathematics)
The number of digits in a decimal fraction to the right of the decimal point.
(navigation)
In air operations, pertaining to a navigational facility which provides a combined azimuth and glide slope guidance to a runway.
(science and technology)
The measure of the range of values of a set of measurements; indicates reproducibility of the observations.

Precision

 

a measure of the dispersion of the values of a random variable. The precision h is related to the standard deviation σ by the formula

This method of measuring dispersion is justified since, in the case of a normal distribution, the probability density of a random variable with precision h and mathematical expectation a is described by the formula

The precision is used as a measure of the dispersion primarily in gunnery theory and the theory of errors.

precision

(mathematics)
The number of decimal places to which a number is computed.

Compare accuracy.

precision

The number of digits used to express the fractional part of a number. The more digits, the more precision. See single precision and double precision. See also accuracy.
References in periodicals archive ?
But first, let's place Precision Strike and the Fight on today's battlefield in some context:
Specializes in precision injection molds, industrial automation and contract machining.
Seeking feedback must be a conscious and intentional activity in the Precision Selling process.
Bloom states that the process from technical precision to personal expression sometimes was gradual and sometimes was abrupt.
Although the auditor's assessment of such risk does not affect the expectation's precision, it can affect die level of assurance derived from an analytical procedure.
Manufactures precision injection molds for small to medium-size parts--mostly multicavity, hot-runner molds with tight tolerances.
To support the launch of The Precision Network, MIVA is offering advertisers access to teams of vertical experts who will provide insights into areas such as traffic trends, top converting keywords and bid landscapes.
Mentor Graphics, Precision, and ModelSim are registered trademarks of Mentor Graphics Corporation.
Also facilities for manufacturing precision thermoplastic components and tight-tolerance gears.
Nikon Precision is a wholly owned subsidiary of Nikon Corporation, one of the world's leading optical companies, and a sister company of Nikon, Inc.
Process can be used to produce micromolds or microfluidic plastic devices with high precision.