2017 · 32 citations · 6 references
ComputingComputer ScienceComputer SystemsDistributed SystemsInternet Of ThingsMessage PassingInterprocess CommunicationIot Communication ProtocolsIot NetworkingResource BrokeringEvent-driven I/oEvent-driven ScalabilityHardware ResourcesMulti-core ComputingPublish-subscribe MessagingResource ContentionScalable Iot SystemsSystem Call Overhead
A message broker is an imperative component in IoT systems, and it works as a gateway between IoT devices and application platforms. With the growth of IoT devices today, these systems can easily overwhelm message brokers unless the software can fully utilize hardware resources such as multi-core facility. This paper presents muMQ, a high-performance MQTT broker running on Commercial-Off-The-Shelf hardware. It tackles the challenge to improve the performance of message brokering on a single machine by efficiently utilizing multi-core CPUs. First, muMQ exploits an event-driven I/O mechanism for multi-core scalability. Each CPU core equally handles dispatched TCP connections and locally processes MQTT logic. Second, muMQ adopts a user-level TCP/IP stack, mTCP with DPDK, to avoid the overhead of the in-kernel TCP/IP stack, including system call overhead and resource contention. We evaluate the effectiveness of our approach through experiments. The results show that muMQ can handle 512K or greater long-lived subscribers with no message loss; muMQ achieves a publish messaging rate at 930K messages per second, which is 5.38 times faster than an existing MQTT broker. We also confirm mTCP accelerates the performance by 1.8 times compared with muMQ using the in-kernel TCP/IP stack.
6
Sangjin Han, Keon Jang, KyoungSoo Park et al. · 2010 · 536 citations · Full text
mTCP: a highly scalable user-level TCP stack for multicore systems
Eun Young Jeong, Shinae Woo, Muhammad Asim Jamshed et al. · 2014 · 278 citations
MegaPipe: a new programming interface for scalable network I/O
Sangjin Han, Scott Marshall, Byung-Gon Chun et al. · 2012 · 130 citations
Improving network connection locality on multicore systems
Aleksey Pesterev, J. I. Strauss, Nickolai Zeldovich et al. · 2012 · 119 citations · Full text