Live briefing
Everything about Data deduplication
Data processing technique to eliminate duplicate copies of repeating data
In computing, data deduplication is a technique for eliminating duplicate copies of repeating data. Successful implementation of the technique can improve storage utilization, which may in turn lower capital expenditure by reducing the overall amount of storage media required to meet storage capacity needs. It can also be applied to network data transfers to reduce the number of bytes that must be sent. Wikipedia →
🧭 Start here: a 6-step reading path
- Read the overview: Data deduplicationA 5-minute orientation
- Skim a recent paper: Ultrafast one‐pass FASTQ data preprocessing, quality control, and deduplication using fastpInfluential work since 2022
- Pick up a classic book: Data Deduplication for Data Optimization for Storage and Network SystemsThe most-reprinted book on the subject
- Read the landmark paper: Deduplication on Encrypted Big Data in CloudCited 133 times
- Go sideways: Single-instance storageA closely related topic
- Go sideways: Storage efficiencyA closely related topic
📖 Definitions
No dictionary entry for this exact phrase.
🗂️ The subject at a glance
🏆 Landmark papers (most cited)
Deduplication on Encrypted Big Data in Cloud
Distributed data deduplication
Application-Aware Big Data Deduplication in Cloud Environment
Reducing the Storage Burden via Data Deduplication
Secure Encrypted Data Deduplication Based on Data Popularity
Data Deduplication Techniques for Big Data Storage Systems
Framework of Data Deduplication: A Survey
Data Deduplication Techniques
🆕 Influential since 2022
Ultrafast one‐pass FASTQ data preprocessing, quality control, and deduplication using fastp
Blockchain-Based Shared Data Integrity Auditing and Deduplication
Secure Cloud Data Deduplication with Efficient Re-Encryption
Enabling Balanced Data Deduplication in Mobile Edge Computing
SecDedup: Secure data deduplication with dynamic auditing in the cloud
📚 Books worth reading
Data Deduplication for Data Optimization for Storage and Network SystemsDaehee Kim, Sejun Song · 2016
Apache Solr Beginner's GuideAlfredo Serafini · 2013- 📕Data Deduplication ApproachesG. R. Sinha, Tin Tein Thwel · 2020
- 📕Data Deduplication for High Performance Storage SystemDan Feng · 2022
- 📕Insider's Guide to Data DeduplicationLarry Freeman · 2010
AI EngineeringChip Huyen · 2024- 📕Data DeduplicationGerard Blokdyk · 2017
- 📕Implementing IBM storage data deduplication solutionsAlex Osuna · 2011
Ranked by number of editions on Open Library, a rough measure of how lasting a book is.
🔗 Related topics
- Single-instance storage Single-instance storage (SIS) is a system's ability to take multiple copies of content and replace them by a single shared copy. It is a means to eliminate…
- Storage efficiency Storage efficiency is the ability to store and manage data that consumes the least amount of space with little to no impact on performance; resulting in…
- Proxmox Backup Server Proxmox Backup Server (Proxmox BS) is an open-source backup software project supporting virtual machines, containers, and physical hosts. The bare-metal…
- NTFS reparse point An NTFS reparse point is a type of NTFS file system object. It is available with the NTFS v3.0 found in Windows 2000 or later versions. Reparse points…
- Backup In information technology, a backup, or data backup is a copy of computer data taken and stored elsewhere so that it may be used to restore the original…
- Replication (computing) Replication in computing refers to maintain multiple copies of data, processes, or resources to ensure consistency across redundant components. This fundamental…
- EMC NetWorker EMC NetWorker (formerly Legato NetWorker) is an enterprise-level data protection software product from Dell EMC that unifies and automates backup to tape…
- Disk-based backup Disk-based backup refers to technology that allows one to back up large amounts of data to a disk storage unit. It is often supplemented by tape drives…