Performance Evaluation of Open Source IoT Platforms

Abstract

IoT platforms play a central role in IoT architecture; as they enable the development of services and applications by end users. More than 300 IoT platforms were reported in the literature. IoT platforms vary in their capabilities and features. Accordingly, Selecting between the various platforms can be troublesome. This is particularly true given the fact that no benchmark or systematic evaluation criteria currently exist to evaluate and compare various platforms. To this end, this paper attempts to develop a performance evaluation for open source IoT platforms to reduce the complexity of the selection process. In particular, the paper evaluates the scalability (in terms of throughput and average response time) and stability (in terms of resource utilization and robustness) of the ThingsBoard and SiteWhere platforms. The two platforms are evaluated under heavy load of sensor data readings.