ACM SIGCOMM Computer Communication Review · 2015 · 149 citations · 34 references
ComputingComputer ScienceHigh-performance ComputingAlgorithmsMachine LearningParallel ComputingData ParallelismDistributed ComputingDistributed Data ProcessingMatrix ComputationParallel ArchitecturesParallel ComputationData-parallel AlgorithmsDistributed Graph ProcessingInterprocess Communication InterfaceMapreduce AlgorithmsParallel Data ProcessingParallel Graph AlgorithmsParallel Machine LearningParallel Matrix Computation
Datacenter networks deal with a variety of workloads, ranging from latency-sensitive small flows to bandwidth-hungry large flows. Load balancing schemes based on flow hashing, e.g., ECMP, cause congestion when hash collisions occur and can perform poorly in asymmetric topologies. Recent proposals to load balance the network require centralized traffic engineering, multipath-aware transport, or expensive specialized hardware. We propose a mechanism that avoids these limitations by (i) pushing load-balancing functionality into the soft network edge (e.g., virtual switches) such that no changes are required in the transport layer, customer VMs, or networking hardware, and (ii) load balancing on fine-grained, near-uniform units of data (flowcells) that fit within end-host segment offload optimizations used to support fast networking speeds. We design and implement such a soft-edge load balancing scheme, called Presto, and evaluate it on a 10 Gbps physical testbed. We demonstrate the computational impact of packet reordering on receivers and propose a mechanism to handle reordering in the TCP receive offload functionality. Presto's performance closely tracks that of a single, non-blocking switch over many workloads and is adaptive to failures and topology asymmetry.
34
Sangtae Ha, Injong Rhee, Lisong Xu · ACM SIGOPS Operating Systems Review · 2008 · 2.2K citations
Network traffic characteristics of data centers in the wild
Theophilus Benson, Aditya Akella, David A. Maltz · 2010 · 2.2K citations
Albert Greenberg, James R. Hamilton, Navendu Jain et al. · 2009 · 2.1K citations
Mohammad Alizadeh, Albert Greenberg, David A. Maltz et al. · 2010 · 1.8K citations · Full text