2011 · 21 citations · 27 references
ComputingComputer EngineeringComputer ScienceFault ToleranceFault-tolerant ComputingFault-tolerant SystemsData RedundancyData-flow AnalysisDependability MetricsFault Tolerance DesignReliable System DesignStream ProcessingControl Flow Graph AnalysisControl-flow Graph ConstructionData Stream ProcessingFault Injection MethodologyFinancial EngineeringFlow Graph ConstructionQuality DegradationStream Processing Metrics
This paper describes an experimental methodology used to evaluate the effectiveness of partial fault tolerance (PFT) techniques in data stream processing applications. Without a clear understanding of the impact of faults on the quality of the application output, applying PFT techniques in practice is not viable. We assess the impact of PFT by injecting faults into a synthetic financial engineering application running on top of IBM's stream processing middleware, System S. The application output quality degradation is evaluated via an application-specific output score function. In addition, we propose four metrics that are aimed at assessing the impact of faults in different stream operators of the application flow graph with respect to predictability and availability. These metrics help the developer to decide where in the application he should place redundant resources. We show that PFT is indeed viable, which opens the way for considerably reducing the resource consumption when compared to fully consistent replicas.
27
S4: Distributed Stream Computing Platform
Leonardo Neumeyer, Bruce Robbins, Anish Nair et al. · 2010 · 905 citations
Fault injection techniques and tools
Mei-Chen Hsueh, Timothy Tsai, Ravishankar K. Iyer · Computer · 1997 · 869 citations · Full text