2020 · 84 citations · 51 references
ComputingComputer EngineeringComputer ScienceDistributed SystemsParallel ComputingReconfigurable ComputingData Movement OptimizationDistributed Data ProcessingHardware AccelerationKernel OffloadingRemote Memory AccessStream ProcessingCardinality EstimationData Transfer OverheadData-intensive ComputingIn-network ComputingIn-network ProcessingMemory Access ControlMemory Access PatternsRemote Memory Access Overhead
Big data applications often incur large costs in I/O, data transfer and copying overhead, especially when operating in cloud environments. Since most such computations are distributed, data processing operations offloaded to the network card (NIC) could potentially reduce the data movement overhead by enabling near-data processing at several points of a distributed system. Following this idea, in this paper we present StRoM, a programmable, FPGA-based RoCE v2 NIC supporting the offloading of application level kernels. These kernels can be used to perform memory access operations directly from the NIC such as traversal of remote data structures as well as filtering or aggregation over RDMA data streams on both the sending or receiving sides. StRoM bypasses the CPU entirely and extends the semantics of RDMA to enable multi-step data access operations and in-network processing of RDMA streams. We demonstrate the versatility and potential of StRoM with four different kernels extending one-sided RDMA commands: 1) Traversal of remote data structures through pointer chasing, 2) Consistent retrieval of remote data blocks, 3) Data shuffling on the NIC by partitioning incoming data to different memory regions or CPU cores, and 4) Cardinality estimation on data streams.
51
Pat Bosshart, Dan Daly, Glen Gibb et al. · ACM SIGCOMM Computer Communication Review · 2014 · 2.8K citations
Pat Bosshart, Glen Gibb, Hun-Seok Kim et al. · 2013 · 778 citations · Full text
Xin Jin, Xiaozhou Li, Haoyu Zhang et al. · 2017 · 539 citations
Aleksandar Dragojević, Dushyanth Narayanan, Orion Hodson et al. · Networked Systems Design and Implementation · 2014 · 503 citations