deduplication

(redirected from de-dupe)
Also found in: Dictionary.

deduplication

(1) A method for compressing data by storing only changes to the original data. For example, when a document is created, it is stored as a regular, complete file. When changes are made, deduplication stores only the data that has been modified in a subsequent file with indexes to the original. The changes may be identified by bytes or blocks. See backup types.

(2) To remove duplicate records from a file or duplicate files in various storage locations.
Copyright © 1981-2019 by The Computer Language Company Inc. All Rights reserved. THIS DEFINITION IS FOR PERSONAL USE ONLY. All other reproduction is strictly prohibited without permission from the publisher.
References in periodicals archive ?
Appliance-based de-dupe is a reflection of an earlier time when custom ASICs were almost a requirement to achieve performance benchmarks.
IT should consider new storage solutions built from the ground, such as grid-based arrays, that have de-duplication technology that not only does not degrade performance but actually improves performance as the de-dupe ratio grows.
Again, de-dupe can eliminate up to 97 percent of your replication traffic for disaster recovery, and including continuous data protection will improve the recovery times from hours or days to just a few minutes.
Data DomainAAEs technology is single-node, meaning it can only de-dupe one node at a time, whereas rivals such as FalconStor, Sepaton and Permabit offer the more expansive global de-duplication, Taneja says.
Their argument is that because a single search returns a very large number of hits, say 100,000, you can't claim to de-dupe unless you de-dupe every one of those hits.
In addition, Pratt is pleased not only with Replay's virtual failover and ability restore to dissimilar hardware, but also with the huge space savings he's seeing due to Replay's de-dupe and compression.
In order to de-dupe, the engine would have to download all search results and compare them.
Symantec is targeting small- and midsize businesses (SMB)Aawith Backup Exec 2010, which will integrate de-duplication with backup clients and the BackupExec media server, and be able to manage third-party de-dupe appliances.
The "de-dupe" command locates matching hits by comparing bibliographic citations from one file with those from another.
"OnlineMarketr.com downloads all your keywords daily, de-dupes and aggregates rankings to provide granular insights into your website's SEO performance.
When the list is finalized, USADATA runs a merge-purge process, created by Acxiom and called PureProspects, that de-dupes the list against Jiffy Lube's customer database.