ACM SIGCOMM Computer Communication Review · 2012 · 106 citations · 18 references
ComputingComputer ScienceComputer SystemsDistributed SystemsQueuing TheoryReal-time RenderingCongestion ControlLatency OptimizationNetwork Performance AnalysisWeb Performance OptimizationWebsite Traffic AnalysisCross-layer DesignCross-layer OptimizationLatency ReductionNetwork Latency MitigationNetwork Load BalancingNetwork StackNetwork Stack ImplementationTail Latency Reduction
Web applications have now become so sophisticated that rendering a typical page may require hundreds of intra-datacenter flows. At the same time, web sites must meet strict page creation deadlines of 200-300 ms to satisfy user demands for interactivity. Long-tailed flow completion times make it challenging for web sites to meet these constraints. They are forced to choose between rendering a subset of the complex page, or delay its rendering, thus missing deadlines and sacrificing either quality or responsiveness. Either option leads to potential financial loss. In this paper, we present a new cross-layer network stack aimed at reducing the long tail of flow completion times. The approach exploits cross-layer information to reduce packet drops, prioritize latency-sensitive flows, and evenly distribute network load, effectively reducing the long tail of flow completion times. We evaluate our approach through NS-3 based simulation and Click-based implementation demonstrating our ability to consistently reduce the tail across a wide range of workloads. We often achieve reductions of over 50% in 99.9 th percentile flow completion times.
18
Glen W. Davidson, Danell Crase · Death Studies · 1989 · 2.9K citations
Eddie Kohler, Robert Morris, Benjie Chen et al. · ACM Transactions on Computer Systems · 2000 · 2.4K citations · Full text
End-To-End Arguments In System Design
Jerome H. Saltzer, David P. Reed, David D. Clark · 1984 · 2.1K citations
Albert Greenberg, James R. Hamilton, Navendu Jain et al. · 2009 · 2.1K citations