Procedia Computer Science · 2017 · 27 citations · 9 references
ComputingComputer ScienceComputer SystemsDistributed SystemsParallel AlgorithmsParallel ComputingResource SchedulingStream ProcessingStreaming AlgorithmsData Stream ProcessingGenetic Algorithm OptimizationHeuristic SchedulingIntelligent Decision Support SystemsLoadStream Processing PerformanceStream SchedulingStreaming Data Processing
The main objective of Decision Support Systems is detection of critical states and response on them in time. Such systems can be based on constant monitoring of continuously incoming data. Stream processing is carried out on the basis of computing infrastructure and specialized frameworks such as Apache Storm, Flink, Spark Streaming. However, to provide the necessary system performance at high load incoming data, additional data processing mechanisms are required. In particular, the efficient scheduling of streaming applications plays an important role in the data stream processing. Therefore, this paper is devoted to investigation of genetic algorithm to improve the performance of data stream processing system. The proposed genetic algorithm is developed and integrated into Apache Storm platform, and its efficiency is compared with heuristic algorithm for scheduling of Storm streaming applications.
9
Adaptive online scheduling in storm
Leonardo Aniello, Roberto Baldoni, Leonardo Querzoni · 2013 · 239 citations
T-Storm: Traffic-Aware Online Scheduling in Storm
Jielong Xu, Zhenhua Chen, Jian Tang et al. · 2014 · 198 citations
Boyang Peng, Mohammad Hosseini, Zhihao Hong et al. · 2015 · 191 citations · Full text