Real time analytics

Arun Kejariwal, Sanjeev Kulkarni, Karthik Ramasamy

Proceedings of the VLDB Endowment · 2015 · 40 citations · 1 references

Concepts

TL;DR

Big Data velocity, driven by countless real‑time sources, creates a growing opportunity for streaming analytics, which is applied across domains such as healthcare, e‑commerce, finance, telecom, energy, manufacturing, government, and transportation for real‑time visualization, personalized experiences, and emergency response. This tutorial offers an in-depth overview of streaming analytics—including applications, algorithms, platforms, and Twitter’s state of the art—to inform researchers and industry practitioners. The tutorial traces the decade‑long evolution of streaming analytics, examines challenges posed by volume, variety, and veracity, and reviews current applications, algorithms, platforms, and Twitter’s state of the art.

Abstract

V elocity is one of the 4 Vs commonly used to characterize Big Data [5]. In this regard, Forrester remarked the following in Q3 2014 [8]: "The high velocity, white-water flow of data from innumerable real-time data sources such as market data, Internet of Things, mobile, sensors, click-stream, and even transactions remain largely unnavigated by most firms. The opportunity to leverage streaming analytics has never been greater." Example use cases of streaming analytics include, but not limited to: (a) visualization of business metrics in real-time (b) facilitating highly personalized experiences (c) expediting response during emergencies. Streaming analytics is extensively used in a wide variety of domains such as healthcare, e-commerce, financial services, telecommunications, energy and utilities, manufacturing, government and transportation. In this tutorial, we shall present an in-depth overview of streaming analytics -- applications, algorithms and platforms -- landscape. We shall walk through how the field has evolved over the last decade and then discuss the current challenges -- the impact of the other three V s, viz., V olume, V ariety and V eracity, on Big Data streaming analytics. The tutorial is intended for both researchers and practitioners in the industry. We shall also present state-of-the-affairs of streaming analytics at Twitter.

References

1