precision

(redirected from imprecision)
Also found in: Dictionary, Thesaurus, Medical, Legal, Wikipedia.

precision

[prə′sizh·ən]
(mathematics)
The number of digits in a decimal fraction to the right of the decimal point.
(navigation)
In air operations, pertaining to a navigational facility which provides a combined azimuth and glide slope guidance to a runway.
(science and technology)
The measure of the range of values of a set of measurements; indicates reproducibility of the observations.

Precision

 

a measure of the dispersion of the values of a random variable. The precision h is related to the standard deviation σ by the formula

This method of measuring dispersion is justified since, in the case of a normal distribution, the probability density of a random variable with precision h and mathematical expectation a is described by the formula

The precision is used as a measure of the dispersion primarily in gunnery theory and the theory of errors.

precision

(mathematics)
The number of decimal places to which a number is computed.

Compare accuracy.

precision

The number of digits used to express the fractional part of a number. The more digits, the more precision. See single precision and double precision. See also accuracy.
References in periodicals archive ?
Each of the 12 true glucose concentrations per hour was measured by a simulated glucose assay with a defined imprecision and bias.
5%, and the maximum analytical imprecision (CVa) = 0.
In addition to the intermediate imprecision QC data method above, we also calculated the SDs and z values from the imprecision data obtained from duplicate analysis of patient samples after exclusion of outliers.
Data are presented as contour plots, which show the percent of insulin dosing errors as a function of increasing bias and imprecision.
Y = bias + total imprecision + random patient interferences (1)
A method for direct estimation of imprecision profiles, with reference to immunoassay data.
To examine the role of imprecision on diagnostic accuracy, we obtained data from a multisite clinical trial on the use of the ADVIA Centaur BNP assay (5).
The distribution of values for a cTnI assay, assuming an imprecision profile with a 25% CV at the 99th percentile limit of 0.
The US National Cholesterol Education Program (NCEP)(3) provides physicians with explicit guidelines to interpret a patient's cholesterol values (a clinical criterion) and also provides laboratories with specifications for the imprecision and inaccuracy of their routine cholesterol methods (analytical criteria).
A total imprecision (CV) at this decision limit of <10% is recommended (1-3, 9,10).