IoT Data Management Using Cloud Computing and Big Data Technologies

Abstract

With recent developments in technology, devices like vehicles and home appliances are able to connect to the Internet and communicate, contributing to the Internet of Things. These advancements lead to generation of huge amount of data. This data is needed to derive all the metrics of the IoT devices, which can later be used to make suitable analysis and henceforth take some business decisions. Moreover, these huge amounts of data are very difficult to handle with conventional data warehousing techniques and need a better system. The existing data centers that are located on-site are mostly relational databases which are not scalable to handle increasing needs of storage and compute. These systems are also inefficient to handle different types of data which is mandatory for IoT devices capturing different metrics. In the proposed work, a model is designed to better handle the data generated by IoT devices via Rest API's. Results are presented to depict the functioning of Rest API across all the nodes deployed in a cluster via JSON request. The input to the model is a corresponding JSON payload as a request. The transactions get added to the registered nodes, without a necessity to add payload for the second time. A new batch is created with readings from all the devices. The contents of the entire batch and all systems are obtained while retrieving the results, thus signifying the effectiveness of the proposed work.