2005 · 99 citations · 14 references
EngineeringComputer EngineeringComputer ScienceComputer ArchitectureData StructuresHardware-software Co-designCachingCaching StrategiesMemory HierarchyMemory Hierarchy DesignMemory Hierarchy OptimizationMemory Subsystem DesignCache ArchitectureCache Associativity OptimizationCache DesignCache Hit Rate OptimizationCache OptimizationMemory LatencyMemory Latency OptimizationMemory Latency Reduction
As processor speeds increase and memory latency becomes more critical, intelligent design and management of secondary caches becomes increasingly important. The efficiency of current set-associative caches is reduced because programs exhibit a non-uniform distribution of memory accesses across different cache sets. We propose a technique to vary the associativity of a cache on a per-set basis in response to the demands of the program. By increasing the number of tag-store entries relative to the number of data lines, we achieve the performance benefit of global replacement while maintaining the constant hit latency of a set-associative cache. The proposed variable-way, or V-Way, set-associative cache achieves an average miss rate reduction of 13% on sixteen benchmarks from the SPEC CPU2000 suite. This translates into an average IPC improvement of 8%.
14
A study of replacement algorithms for a virtual-storage computer
L. A. Belady · IBM Systems Journal · 1966 · 1.7K citations
A case for two-way skewed-associative caches
André Seznec · 1993 · 306 citations