precision


Also found in: Dictionary, Thesaurus, Medical, Financial, Acronyms, Wikipedia.

precision

[prə′sizh·ən]
(mathematics)
The number of digits in a decimal fraction to the right of the decimal point.
(navigation)
In air operations, pertaining to a navigational facility which provides a combined azimuth and glide slope guidance to a runway.
(science and technology)
The measure of the range of values of a set of measurements; indicates reproducibility of the observations.

Precision

 

a measure of the dispersion of the values of a random variable. The precision h is related to the standard deviation σ by the formula

This method of measuring dispersion is justified since, in the case of a normal distribution, the probability density of a random variable with precision h and mathematical expectation a is described by the formula

The precision is used as a measure of the dispersion primarily in gunnery theory and the theory of errors.

precision

(mathematics)
The number of decimal places to which a number is computed.

Compare accuracy.

precision

The number of digits used to express the fractional part of a number. The more digits, the more precision. See single precision and double precision. See also accuracy.
References in periodicals archive ?
Announcement of the China Precision Medicine Initiative in 2016 has radically changed healthcare regimes in the country, with the renewed focus being directed toward capitalizing the present genome sequencing boom in the country.
As discussed, since APV approaches are not precision approaches, Appendix 7 of the instrument rating ACS allows a GPS approach flown to LPV minima to be considered a precision approach if the HAT (height above touchdown) DH is 300 feet AGL or less.
The Dell Precision rack workstations unveiled at Computex 2019 included the Precision 3930 and the 1U rack workstation.
When a customer calls Precision Door Service of Harrisburg, the call will be answered by a live operator and an appointment will be scheduled at a time that is convenient for the customer.
As the economy and industrial output value of China maintain sustained growth, the management believes that the CNC high precision machine tool industry in China will further strengthen.
Both Deere and Precision Planting invested years in developing their high-speed seed delivery cartridges, and strong patent protections, in part, ensure that Deere and Precision Planting are the only two firms offering these seed delivery cartridges.
Northern Precision Casting will retain its name and become a division of Wisconsin Precision Casting Corp.
Novel lasers integrated with legacy motion systems work well for research laboratories and some low precision processes but production systems need to make multiple parts with part-to-part repeatability and quality.
Dell Precision Performance Optimizer is an extension of Dell's existing workstation tools designed to provide customers maximum performance and dependability so they can remain focused on being creative.
Monitor the Precision Strike Association Web site <www.precisionstrike.org/events.htm> for future updates and registration information.
Precision, verification, and repeatability are the hallmarks of modern science.
Remarks to the Precision Strike Association, Johns Hopkins University, Baltimore, Md., Oct.