ComputingComputer ScienceComputer SystemsCloud Performance OptimizationDistributed SystemsInterconnection NetworksData ReplicationDistributed StorageDistributed Systems PerformanceLatency OptimizationAcceleratorsDistributed Key-value StoresKey-value StoresLatency ReductionLatency Reduction TechniquesLatency TradeoffsReplica ManagementReplica Selection
In distributed key-value stores, performance fluctuations generally occur across servers, especially when the servers are deployed in a cloud environment. Hence, the replica selected for a request will directly affect the response latency. In the context of key-value stores, even the state-of-the-art algorithm of replica selection still has considerable room for improving the response latency. In this paper, we present the fundamental factors that prevent replica selection algorithms from being effective. We address these factors by proposing NetRS, a framework that enables in-network replica selection for key-value stores. NetRS exploits emerging network devices, including programmable switches and network accelerators, to select replicas for requests. NetRS supports diverse algorithms of replica selection and is suited to the network topology of modern data centers. Compared with the conventional scheme of clients selecting replicas for requests, NetRS could effectively cut the response latency according to our extensive evaluations. Specifically, NetRS reduces the average latency by up to 48.4%, and the 99th latency by up to 68.7%.
29
Software-Defined Networking: A Comprehensive Survey
Diego Kreutz, Fernando M. V. Ramos, Paulo Esteves Veríssimo et al. · Proceedings of the IEEE · 2014 · 4.9K citations · Full text
The Hadoop Distributed File System
Konstantin V. Shvachko, Hairong Kuang, Sanjay Radia et al. · 2010 · 4.8K citations
Giuseppe DeCandia, Deniz Hastorun, Madan Jampani et al. · 2007 · 3.5K citations
Network traffic characteristics of data centers in the wild
Theophilus Benson, Aditya Akella, David A. Maltz · 2010 · 2.2K citations