2024 · 31 citations · 20 references
EngineeringComputer EngineeringComputer ScienceComputer ArchitectureInterconnection NetworksSystem-on-chip DesignCommunication OverheadInterconnect ArchitectureLatency OptimizationMemory Hierarchy DesignMemory ModelingMemory Subsystem DesignApplication Performance AssessmentApplication Performance OptimizationApplication-level PerformanceCost Model ValidationInterconnect OptimizationLow-latency CommunicationMemory InterconnectsMemory Latency Optimization
As memory-intensive applications continue to drive the need for advanced architectural solutions, Compute Express Link (CXL) has risen as a promising interconnect technology that enables seamless high-speed, low-latency communication between host processors and various peripheral devices. In this study, we explore the application performance of ASIC CXL memory in various data-center scenarios. We then further explore multiple potential impacts (e.g., throughput, latency, and cost reduction) of employing CXL memory via carefully designed policies and strategies. Our empirical results show the high potential of CXL memory, reveal multiple intriguing observations of CXL memory and contribute to the wide adoption of CXL memory in real-world deployment environments. Based on our benchmarks, we also develop an Abstract Cost Model that can estimate the cost benefit from using CXL memory.
20
Benchmarking cloud serving systems with YCSB
Brian F. Cooper, Adam Silberstein, Erwin Tam et al. · 2010 · 3.6K citations
2017 USENIX Annual Technical Conference (USENIX ATC'17)
Do Le Quoc, Martin S. Beck, Pramod Bhatotia et al. · 2017 · 3.1K citations
Efficient Memory Management for Large Language Model Serving with PagedAttention
Woosuk Kwon, Z. Li, Siyuan Zhuang et al. · 2023 · 1.1K citations · Full text
Measuring the gap between FPGAs and ASICs
Ian Kuon, Jonathan Rose · 2006 · 319 citations
Engineering, Computer Engineering, Electrical Engineering +16