2015 · 21 citations · 22 references
ComputingComputer EngineeringComputer ScienceOperating SystemsParallel ComputingVirtualizationCachingHigh-throughput ComputingKernel DesignMemory ManagementMemory Protection HardwareVirtual MemoryHigh PerformanceI/o Memory Management UnitI/o Memory ProtectionI/o Resource AllocationMemory ProtectionMemory Protection Mechanisms
IOMMUs provided by modern hardware allow the OS to enforce memory protection controls on the DMA operations of its I/O devices. An IOMMU translation management design must scalably handle frequent concurrent updates of IOMMU translations made by multiple cores, which occur in high throughput I/O workloads such as multi-Gb/s networking. Today, however, OSes experience performance meltdowns when using the IOMMU in such workloads. This paper explores scalable IOMMU management designs and addresses the two main bottlenecks we find in current OSes: (1) assignment of I/O virtual addresses (IOVAs), and (2) management of the IOMMU's TLB. We propose three approaches for scalable IOVA assignment: (1) dynamic identity mappings, which eschew IOVA allocation altogether, (2) allocating IOVAs using the kernel's kmalloc, and (3) per-core caching of IOVAs allocated by a globally-locked IOVA allocator. We further describe a scalable IOMMU TLB management scheme that is compatible with all these approaches. Evaluation of our designs under Linux shows that (1) they achieve 88.5%-100% of the performance obtained without an IOMMU, (2) they achieve similar latency to that obtained without an IOMMU, (3) scalable IOVA allocation and dynamic identity mappings perform comparably, and (4) kmalloc provides a simple solution with high performance, but can suffer from unbounded page table blowup.
22
An empirical study of operating systems errors
Andy Chou, Junfeng Yang, Benjamin Chelf et al. · 2001 · 718 citations
Arvind Seshadri, Mark Luk, Ning Qu et al. · 2007 · 632 citations
Distributed caching with memcached
Brad Fitzpatrick · Linux journal · 2004 · 513 citations
Thorough static analysis of device drivers
Thomas Ball, Ella Bounimova, Byron Cook et al. · 2006 · 378 citations