International Journal of Grid and High Performance Computing · 2018 · 12 citations · 87 references
ComputingCloud ComputingComputer ScienceCloud StorageData ManagementStorage SystemsData De-identificationData DeduplicationData RedundancyData Storage SystemsDistributed StorageStorage ManagementCloud Storage DeduplicationDigital Data StorageLocal StorageRedundant ComputationRedundant Data StorageStorage DeduplicationStorage-aware Deduplication
This article describes how data deduplication efficiently eliminates the redundant data by selecting and storing only single instance of it and becoming popular in storage systems. Digital data is growing much faster than storage volumes, which shows the importance of data deduplication among scientists and researchers. Data deduplication is considered as most successful and efficient technique of data reduction because it is computationally efficient and offers a lossless data reduction. It is applicable to various storage systems, i.e. local storage, distributed storage, and cloud storage. This article discusses the background, components, and key features of data deduplication which helps the reader to understand the design issues and challenges in this field.
87
A Mathematical Theory of Communication
Claude E. Shannon · Bell System Technical Journal · 1948 · 80.7K citations
Space/time trade-offs in hash coding with allowable errors
Burton H. Bloom · Communications of the ACM · 1970 · 7.5K citations · Full text