benchmark


Also found in: Dictionary, Thesaurus, Medical, Financial, Acronyms, Idioms, Wikipedia.

benchmark

[′bench‚märk]
(engineering)
A relatively permanent natural or artificial object bearing a marked point whose elevation above or below an adopted datum—for example, sea level—is known. Abbreviated BM.
(industrial engineering)
A standard of measurement possessing sufficient identifiable characteristics common to the individual units of a population to facilitate economical and efficient comparison of attributes for units selected from a sample.
(science and technology)
A reference value against which a measurement or a series of measurements may be compared.

Benchmark

A permanent reference mark, fixed to a building or to the ground, whose height above a standard datum level has been accurately determined by survey.

benchmark

(benchmark)
A standard program or set of programs which can be run on different computers to give an inaccurate measure of their performance.

"In the computer industry, there are three kinds of lies: lies, damn lies, and benchmarks."

A benchmark may attempt to indicate the overall power of a system by including a "typical" mixture of programs or it may attempt to measure more specific aspects of performance, like graphics, I/O or computation (integer or floating-point). Others measure specific tasks like rendering polygons, reading and writing files or performing operations on matrices. The most useful kind of benchmark is one which is tailored to a user's own typical tasks. While no one benchmark can fully characterise overall system performance, the results of a variety of realistic benchmarks can give valuable insight into expected real performance.

Benchmarks should be carefully interpreted, you should know exactly which benchmark was run (name, version); exactly what configuration was it run on (CPU, memory, compiler options, single user/multi-user, peripherals, network); how does the benchmark relate to your workload?

Well-known benchmarks include Whetstone, Dhrystone, Rhealstone (see h), the Gabriel benchmarks for Lisp, the SPECmark suite, and LINPACK.

See also machoflops, MIPS, smoke and mirrors.

Usenet newsgroup: news:comp.benchmarks.

Tennessee BenchWeb.

benchmark

A performance test of hardware and/or software. There are various programs that very accurately test the raw power of a single machine, the interaction in a single client/server system (one server/multiple clients) and the transactions per second in a transaction processing system. However, it is next to impossible to benchmark the performance of an entire enterprise network with a great degree of accuracy.

Benchmarks may change their rating scale with new releases of the software. Thus, the same version of the test must often be run to compare results. See PC Magazine benchmarks, BAPCo, ECperf, Linpack, Dhrystone, Whetstone, Khornerstone, SPEC, GPC and RAMP-C.
References in periodicals archive ?
Roderick Public Relations (Representing Credit Benchmark)
The results of Study 1 suggest that consumers are influenced by the benchmarks. Subjects who had seen the fifty-thousand-miles benchmark for Monroe shocks reported a subjective benchmark for replacement of 89,338, compared with 108,974 for those who had not seen the marketing benchmark (t = 1.35, p = .09).
"I can't help but wonder how recent events will impact founders' views towards raising capital from Benchmark," Michael Boswell, a tech entrepreneur, wrote on Twitter.
Alfalah GHP Islamic prosperity planning fund - balance allocation generated a return of 6.8 percent against the benchmark which generated 6.05 percent.
Common planning benchmarks used in healthcare design involve square feet per key planning unit (KPU), such as a patient bed, imaging modality, or operating room.
Benchmark labor productivity is comparing internal and external performance on monthly basis of SMEs with other organizations.
The aim of calibration is to check geometric conditions which should be met by the inner surface axis ([t.sub.1]-[t.sub.1]) and the outer surface axis ([t.sub.2]-[t.sub.2]) of the benchmark sleeve and the axis ([l.sub.1]-[l.sub.1]) of the tubular level (Fig.
We use this event to examine how this speed change affected behavior during Benchmark Events.
* Full descriptions of all of the metrics and instrumentation used to monitor the benchmark
Gensler called for 'a coordinated global effort' to identify alternative interest rate benchmarks anchored in observable transactions and plan a smooth and orderly transition from benchmarks referencing unsecured, interbank markets.
These data sets are easy to acquire and track, but they may not be the best available benchmarks because they do not look outside the company.
Nine states -- Florida, Iowa, Indiana, New Jersey, New Mexico, Ohio, Oklahoma, Wisconsin and West Virginia -- have taken no formal steps toward recommending a benchmark plans.