IEEE Transactions on Parallel and Distributed Systems · 2013 · 60 citations · 16 references
ComputingCloud ComputingComputer SystemsCloud InfrastructureCloud StorageStorage SystemsBackup SystemsCloud BackupData BackupData DeduplicationData RedundancyDuplicate DetectionBackupBackup DeduplicationBackup ServicesBackup Window ManagementCloud Storage DeduplicationDeduplication Performance EvaluationSource-side DeduplicationStorage Deduplication
In personal computing devices that rely on a cloud storage environment for data backup, an imminent challenge facing source deduplication for cloud backup services is the low deduplication efficiency due to a combination of the resource-intensive nature of deduplication and the limited system resources. In this paper, we present ALG-Dedupe, an Application-aware Local-Global source deduplication scheme that improves data deduplication efficiency by exploiting application awareness, and further combines local and global duplicate detection to strike a good balance between cloud storage capacity saving and deduplication time reduction. We perform experiments via prototype implementation to demonstrate that our scheme can significantly improve deduplication efficiency over the state-of-the-art methods with low system overhead, resulting in shortened backup window, increased power efficiency and reduced cost for cloud backup services of personal storage.
16
Michael Armbrust, Armando Fox, Rean Griffith et al. · Communications of the ACM · 2010 · 9K citations · Full text
A low-bandwidth network file system
Athicha Muthitacharoen, Benjie Chen, David Mazières · 2001 · 786 citations
Sparse indexing: large scale, inline deduplication using sampling and locality
Mark Lillibridge, Kave Eshghi, Deepavali Bhagwat et al. · 2009 · 384 citations
Extreme Binning: Scalable, parallel deduplication for chunk-based file backup
Deepavali Bhagwat, Kave Eshghi, Darrell D. E. Long et al. · 2009 · 327 citations