IEEE Transactions on Computers · 2013 · 30 citations · 34 references
EngineeringComputer EngineeringComputer ScienceComputer ArchitectureHardware-software Co-designParallel ComputingBenchmarkingCachingCaching StrategiesMemory HierarchyMemory Hierarchy DesignPerformance OptimizationCache DesignCache LocalityCache OptimizationCache Performance ModelingHardware Overhead AnalysisLast-level Cache BehaviorOverhead AnalysisPerformance Overhead
The design of an effective last-level cache (LLC) in general—and an effective cache replacement/partitioning algorithm in particular—is critical to the overall system performance. The processor’s ability to hide the LLC miss penalty differs widely from one miss to another. The more instructions the processor manages to issue during the miss, the better it is capable of hiding the miss penalty and the lower the cost of that miss. This nonuniformity in the processor’s ability to hide LLC miss latencies, and the resultant nonuniformity in the performance impact of LLC misses, opens up an opportunity for a new cost-sensitive cache replacement algorithm. This paper makes two key contributions. First, It proposes a framework for estimating the costs of cache blocks at run-time based on the processor’s ability to (partially) hide their miss latencies. Second, It proposes a simple, low-hardware overhead, yet effective, cache replacement algorithm that is locality-aware and cost-sensitive (LACS). LACS is thoroughly evaluated using a detailed simulation environment. LACS speeds up 12 LLC-performance-constrained SPEC CPU2006 benchmarks by up to 51% and 11% on average. When evaluated using a dual/quad-core CMP with a shared LLC, LACS significantly outperforms LRU in terms of performance and fairness, achieving improvements up to 54%.
34
A study of replacement algorithms for a virtual-storage computer
L. A. Belady · IBM Systems Journal · 1966 · 1.7K citations
Cost-aware WWW proxy caching algorithms
Pei Cao, Sandy Irani · Minds at UW (University of Wisconsin) · 1997 · 924 citations · Full text
Adaptive insertion policies for high performance caching
Moinuddin K. Qureshi, Aamer Jaleel, Yale N. Patt et al. · 2007 · 633 citations