Queues don't matter when you can JUMP them!

Abstract

QJUMP is a simple and immediately deployable ap-proach to controlling network interference in datacenter networks. Network interference occurs when congestion from throughput-intensive applications causes queueing that delays traffic from latency-sensitive applications. To mitigate network interference, QJUMP applies Inter-net QoS-inspired techniques to datacenter applications. Each application is assigned to a latency sensitivity level (or class). Packets from higher levels are rate-limited in the end host, but once allowed into the network can “jump-the-queue ” over packets from lower levels. In set-tings with known node counts and link speeds, QJUMP can support service levels ranging from strictly bounded latency (but with low rate) through to line-rate through-put (but with high latency variance). We have implemented QJUMP as a Linux Traffic Con-trol module. We show that QJUMP achieves bounded latency and reduces in-network interference by up to