Smart meter data analytics using OpenTSDB and Hadoop

Abstract

Technology is continuously evolving which has led to the advent of new monitoring systems that keep track electrical power consumption. The data from these new monitoring systems, smart meters etc provide very useful insights related to the usage patterns which can be used both by the customers and the service providers. In particular smart meter data can be accumulated and analyzed which can give very useful information. Smart meter data is essentially time series data that is continuously accumulated at short but regular intervals of time. This paper mainly aims at showcasing the usage of open source tools such as OpenTSDB [3], Hbase [5] and Hadoop [4] to store time series data and perform analytics on the time series data to get useful insights related to power consumption and get the result in pictorial format essentially a graph. This paper introduces smart meters, time series data, open source tools that work with time series data, limitations of Traditional RDBMS to handle time series data. In this paper, we provide a prototype implementation of smart meter data storage and analytics eco system using open source tools and publicly available smart meter test data set. [1] As a further extension to this proof-of-concept, we provide cloud computing approach for large scale smart meter data analytics.