An Overview of Current Trends in Data Ingestion and Integration

Abstract

Data ingestion and integration present a significant factor in the data analytics, especially with the emergence of high volume and velocity data. The existing approaches, which were focused mainly on the batch processing, had to be adjusted in order to align with the new trends in data processing and storage. At the same time, data ingestion tools have gained a popularity as they have supported new development and analytics trends. Moreover, major vendors have shifted their focus to cloud solutions, which affected both the existing and emerging tools. Due to the huge variety in the ingestion and integration approaches, the tools vary in features, from different programming language support up to the platform-specific usage. In this article, state-of-the-art data ingestion and integration tools are systematically and individually reviewed, with their key features identified. Also, the current tools categories are observed and compared, together with the list of tools which they encompass, based on their features.