2023 · 17 citations · 38 references
ComputingComputer EngineeringComputer ScienceCloud ArchitectureCloud InfrastructureCloud Performance OptimizationCachingCaching StrategiesCloud Resource ManagementCompute Resource ManagementElastic Resource ManagementRemote Memory AccessCache ManagementCaching ArchitecturesCaching MechanismsDisaggregated Storage ArchitectureElasticityHit RateIn-memory CachingMemory Access Patterns
In-memory caching systems are fundamental building blocks in cloud services. However, due to the coupled CPU and memory on monolithic servers, existing caching systems cannot elastically adjust resources in a resource-efficient and agile manner. To achieve better elasticity, we propose to port in-memory caching systems to the disaggregated memory (DM) architecture, where compute and memory resources are decoupled and can be allocated flexibly. However, constructing an elastic caching system on DM is challenging since accessing cached objects with CPU-bypass remote memory accesses hinders the execution of caching algorithms. Moreover, the elastic changes of compute and memory resources on DM affect the access patterns of cached data, compromising the hit rates of caching algorithms. We design Ditto, the first caching system on DM, to address these challenges. Ditto first proposes a client-centric caching framework to efficiently execute various caching algorithms in the compute pool of DM, relying only on remote memory accesses. Then, Ditto employs a distributed adaptive caching scheme that adaptively switches to the best-fit caching algorithm in real-time based on the performance of multiple caching algorithms to improve cache hit rates. Our experiments show that Ditto effectively adapts to the changing resources on DM and outperforms the state-of-the-art caching systems by up to 3.6× in real-world workloads and 9× in YCSB benchmarks.
38
Benchmarking cloud serving systems with YCSB
Brian F. Cooper, Adam Silberstein, Erwin Tam et al. · 2010 · 3.6K citations
2017 USENIX Annual Technical Conference (USENIX ATC'17)
Do Le Quoc, Martin S. Beck, Pramod Bhatotia et al. · 2017 · 3.1K citations
Ceph: a scalable, high-performance distributed file system
Sage A. Weil, Scott Brandt, Ethan L. Miller et al. · eScholarship (California Digital Library) · 2006 · 1.4K citations · Full text
Cost-aware WWW proxy caching algorithms
Pei Cao, Sandy Irani · Minds at UW (University of Wisconsin) · 1997 · 924 citations · Full text
Workload analysis of a large-scale key-value store
Berk Atikoglu, Yuehai Xu, Eitan Frachtenberg et al. · 2012 · 904 citations