deduplication

(redirected from Dedupe)
Also found in: Dictionary, Medical.

deduplication

(1) A method for compressing data by storing only changes to the original data. For example, when a document is created, it is stored as a regular, complete file. When changes are made, deduplication stores only the data that has been modified in a subsequent file with indexes to the original. The changes may be identified by bytes or blocks. See backup types.

(2) To remove duplicate records from a file or duplicate files in various storage locations.
References in periodicals archive ?
One of the key technology elements of the Microsoft HCS solution are granular data objects called fingerprints, which are created by the integrated dedupe process.
Velocity Dedupe Engine is the first deduplication implementation in programmable logic, which results in high throughput while incurring low latencies and maintaining very high data reduction efficiency.
Basically, dedupe software works by analyzing a chunk of data, be it a block, a series of bits, or the entire file.
0 into its storage offering in the Nexsan DeDupe SG 2.
Stephen Ebanks, information and sales manager at Birmingham Hippodrome, said: "Using Win-Pure 'Clean & Match' to dedupe and clean our lists means the quality of our data is vastly improved before going to our mailing house, which helps reduce costs.
Using DataFlux's dfPower Studio, a software product suite, used to manage the quality, consistency and usability of corporate data, iMarket was able to dedupe its prospect database and make incorrect records inactive.
4 release is Universal Dedupe Transfer that significantly increases the maximum performance of HYDRAstor for general applications running on Linux and eliminates the need to transfer deduplicated data blocks from applications to HYDRAstor to reduce bandwidth use.
For example, an enterprise-sized organisation that has a steady dataflow and predictable process may think an appliance is the easiest route which means they could miss out on significant efficiencies and savings in other areas not addressed by a dedupe appliance but still get the 'dedupe dividend' with software and low cost disk.
dedupe disk through to removable media or cloud storage.
When combined with the ViSX Performance Dedupe facility, a ViSX appliance can be acquired for less than $2 per GB at industry-leading IOPS per dollar.
Preparing your historical case data for migration into the CRM system can be a huge task: not only do you have to cleanse and dedupe, you have to reorganise the data and the pointers to make the move.
And, increasingly, more third-party connectors are becoming available which helps further extend the power and capabilities of SSIS, including the ability to cleanse, standardize, dedupe and enrich data seamlessly within the pipeline.