Benchmarking Time Series Databases with IoTDB-Benchmark for IoT\n Scenarios

Abstract

With the wide application of time series databases (TSDBs) in big data fields\nlike cluster monitoring and industrial IoT, there have been developed a number\nof TSDBs for time series data management. Different TSDBs have test reports\ncomparing themselves with other databases to show their advantages, but the\ncomparisons are typically based on their own tools without using a common\nwell-recognized test framework. To the best of our knowledge, there is no\nmature TSDB benchmark either. With the goal of establishing a standard of\nevaluating TSDB systems, we present the IoTDB-Benchmark framework, specifically\ndesigned for TSDB and IoT application scenarios. We pay close attention to some\nspecial data ingestion scenarios and summarize 10 basic queries types. We use\nthis benchmark to compare four TSDB systems: InfluxDB, OpenTSDB, KairosDB and\nTimescaleDB. Our benchmark framework/tool not only measures performance metrics\nbut also takes system resource consumption into consideration.\n