deduplication

(redirected from Dedupe)
Also found in: Dictionary, Medical.

deduplication

(1) A method for compressing data by storing only changes to the original data. For example, when a document is created, it is stored as a regular, complete file. When changes are made, deduplication stores only the data that has been modified in a subsequent file with indexes to the original. The changes may be identified by bytes or blocks. See backup types.

(2) To remove duplicate records from a file or duplicate files in various storage locations.
References in periodicals archive ?
Fundamental to the engine are three characteristics necessary to provide 5x or more data reduction on high-speed network traffic: distributed processing; massively parallel design; and dedupe performed in programmable logic.
From this, they came to an insightful conclusion: inline, hash-based dedupe simply doesn't work well for high performance deduplicating database backup," said Arun Taneja, founder and consulting analyst, Taneja Group.
The Tegile array that the company has deployed has a total capacity of 25TB but after dedupe and compression, Rahr has reduced its storage needs by 75 percent, which Kmieciak describes as "one of the best parts about all of this.
The new release also offers dynamic deduplication cache sizing, which simplifies the configuration process and guarantees optimal performance by automatically selecting the ideal dedupe cache size based on available memory.
Offering support for virtual environments like Hyper-V, VMware and XenServer and applications like SQL, Exchange (including 2010), Open File Backup, Oracle, Mac, Linux, and SharePoint, and using the latest in vertical DeDupe Technology[TM] to transmit and store only a fraction of what other backup solutions transmit and store.
lt;p>Unlike appliance-based solutions that limit dedupe benefits to the boundaries of the box, CommVault's unique, end-to-end approach expands the benefits of block-level deduplication across an entire organisation's backup and archive copies, resulting in cost-efficient scaling and performance across the entire data management infrastructure.
While Replay quickly became Brundage Bone's backup and disaster recovery solution of choice, Thornton also found himself impressed by Replay's dedupe and compression features.
To better demonstrate FlashArray s actual performance against its data reduction claims, the company also launched the Pure Storage Dedupe Ticker on its website today, a first-of-its-kind tool that presents FlashArray's actual data reduction rates in aggregate across its installed customer base.
Also, Replay gives me a lot of key features, like dedupe and compression, corruption detection, ease of setup, and time saving.
Scalability to millions of dedupe operations per second
However, for a majority of environments, hybrid arrays can deliver lower costs, the flexibility of NAS and SAN from the same array, no-brainer installation, compression and dedupe, and performance high enough to deploy hundreds of VDIs in minutes, so most users don't have to overpay for all-flash or bolted together legacy arrays.
From this, they came to an insightful conclusion: inline, hash-based dedupe simply doesn t work well for high performance deduplicating database backup, said Arun Taneja, founder and consulting analyst, Taneja Group.