Building an IoT Data Hub with Elasticsearch, Logstash and Kibana

Abstract

The goal of this publication is to describe the implementation of an Elastisearch, Logstash and Kibana (ELK) stack to process IoT data. Although, those tools were designed to be used mainly for handling large number of log data, they can be applied also to store, search and visualise other type of information - including IoT data. In order to show practical implementation of the idea, selected devices installed in thebuilding of ABB Corporate Research in Krakow has been used. In prepared system, real data generated by various subsystems in this building has been integrated into one Elasticsearch based solution for further processing. Later on, this data will be used to develop data analytics to extract and visualize meaningful insights about building operations. In addition, selected data is sent to the Azure cloud to use its abilities in big data processing and machine learning.