Proceedings of the VLDB Endowment · 2018 · 64 citations · 37 references
MedicineBiologyGeneticsCytogeneticsMicroevolutionRecombinationGene ConversionGene IntrogressionMeiotic RecombinationSite-specific RecombinationAllelic RecombinationConversion RatesCrossover Gene ConversionGene Conversion DynamicsNonallelic Gene ConversionRecombination Site SpecificitySegregation
Stream-processing workloads and modern shared cluster environments exhibit high variability and unpredictability. Combined with the large parameter space and the diverse set of user SLOs, this makes modern streaming systems very challenging to statically configure and tune. To address these issues, in this paper we investigate a novel control-plane design, Chi, which supports continuous monitoring and feedback, and enables dynamic re-configuration. Chi leverages the key insight of embedding control-plane messages in the data-plane channels to achieve a low-latency and flexible control plane for stream-processing systems. Chi introduces a new reactive programming model and design mechanisms to asynchronously execute control policies, thus avoiding global synchronization. We show how this allows us to easily implement a wide spectrum of control policies targeting different use cases observed in production. Large-scale experiments using production workloads from a popular cloud provider demonstrate the flexibility and efficiency of our approach.
37
Sanjay Ghemawat · Communications of the ACM · 2008 · 18.5K citations · Full text
A bridging model for parallel computation
Leslie G. Valiant · Communications of the ACM · 1990 · 3.7K citations · Full text
K. Mani Chandy, Leslie Lamport · ACM Transactions on Computer Systems · 1985 · 2.4K citations · Full text
Aurora: a new model and architecture for data stream management
Daniel J. Abadi, Don Carney, Ugur �etintemel et al. · The VLDB Journal · 2003 · 1.5K citations
Michael Armbrust, Reynold Xin, Cheng Lian et al. · 2015 · 1.2K citations