C3: cutting tail latency in cloud data stores via adaptive replica selection

Abstract

Achieving predictable performance is critical for many distributed applications, yet difficult to achieve due to many factors that skew the tail of the latency distribu-tion even in well-provisioned systems. In this paper, we present the fundamental challenges involved in design-ing a replica selection scheme that is robust in the face of performance fluctuations across servers. We illustrate these challenges through performance evaluations of the Cassandra distributed database on Amazon EC2. We then present the design and implementation of an adap-tive replica selection mechanism, C3, that is robust to performance variability in the environment. We demon-strate C3’s effectiveness in reducing the latency tail and improving throughput through extensive evaluations on Amazon EC2 and through simulations. Our results show that C3 significantly improves the latencies along the mean, median, and tail (up to 3 times improvement at the 99.9th percentile) and provides higher system through-put. 1