2019 · 10 citations · 18 references
ComputingComputer ScienceInformation TechnologyBig Data AnalyticsData ManagementData MiningDocument ClusteringText ClusteringBig Data ArchitectureData ProcessingLarge-scale Data Processing
Big Data represents an actual research topic. More and more it becomes part of people life's through different applications that are used daily, such as stock exchange, news, social media, health-care. All these applications make use of Big Data technologies for storing and processing information. There have been developed numerous technologies for implementing Big Data requirements and it is interesting to follow their strengths and weaknesses, when to use one over another and how well they perform in different situations. In this paper, we compare two frameworks Apache Spark and Ignite that are used for data processing. We perform the comparison taking into consideration the following aspects: features, implementation, architecture, and performance metrics. In order to test the performance, we used two popular applications such as word count and k-means clustering. Results show that Spark achieved better performance than Ignite.
18
The Hadoop Distributed File System
Konstantin V. Shvachko, Hairong Kuang, Sanjay Radia et al. · 2010 · 4.8K citations
Spark: cluster computing with working sets
Matei Zaharia, Mosharaf Chowdhury, Michael J. Franklin et al. · 2010 · 4.2K citations
Matei Zaharia, Reynold Xin, Patrick Wendell et al. · Communications of the ACM · 2016 · 2.3K citations
Mesos: a platform for fine-grained resource sharing in the data center
Benjamin Hindman, Andy Konwinski, Matei Zaharia et al. · UC Berkeley · 2011 · 1.6K citations