2015 · 11 citations · 23 references
ComputingComputer SystemsCybersecurityCluster ComputingDistributed SystemsEvent ManagementDistributed ComputingDistributed Data ProcessingEvent DetectionEvent EvaluationEvent Management SystemsStream ProcessingAggregationCorrelationDistributed Event ProcessingEvent Correlation RulesEvent ProcessingEvent Stream AnalysisEvent Stream ProcessingSecurity Information And Event Management
Security Information and Event Management (SIEM) systems perform complex event processing over a large number of event streams at high rate. As event streams increase in volume and event processing becomes more complex, traditional approaches such as scaling up to more powerful systems quickly become ineffective. This paper describes the design and implementation of DRES, a distributed, rule-based event evaluation system that can easily scale to process a large volume of non-trivial events. DRES intelligently forwards events across a cluster of nodes to evaluate complex correlation and aggregation rules. This approach enables DRES to work with any rules engine implementation. Our evaluation shows DRES scales linearly to more than 16 nodes. At this size it successfully processed more than half a million events per second.
23
Sanjay Ghemawat · Communications of the ACM · 2008 · 18.5K citations · Full text
Spark: cluster computing with working sets
Matei Zaharia, Mosharaf Chowdhury, Michael J. Franklin et al. · 2010 · 4.2K citations
Leslie Lamport · ACM Transactions on Computer Systems · 1998 · 2.7K citations · Full text
Michael Isard, Mihai Budiu, Yuan Yu et al. · 2007 · 2.5K citations