2017 · 11 citations · 5 references
ComputingComputer ScienceComputer SystemsDatabasesDistributed SystemsStorage SystemsData ReplicationDistributed ComputingDistributed Database ArchitectureDistributed DatabasesDistributed TransactionsLog ManagementDistributed LoggingHigh PerformanceLog ConsistencyLoggingPublish-subscribe MessagingPublish-subscribe SystemsReal-time Data IngestionSynchronous Logging
DistributedLog is a high performance, strictly ordered, durably replicated log. It is multi-tenant, designed with a layered architecture that allows reads and writes to be scaled independently and supports OLTP, stream processing and batch workloads. It also supports a globally synchronous consistent replicated log spanning multiple geographically separated regions. This paper describes how DistributedLog is structured, its components and the rationale underlying various design decisions. We have been using DistributedLog in production for several years, supporting applications ranging from transactional database journaling, real-time data ingestion, and analytics to general publish-subscribe messaging.
5
In search of an understandable consensus algorithm
Diego Ongaro, John K. Ousterhout · 2014 · 1.5K citations
ZooKeeper: wait-free coordination for internet-scale systems
P. G. Hunt, Mahadev Konar, Flavio Junqueira et al. · 2010 · 1.3K citations
Ankit Toshniwal, Siddarth Taneja, Amit K. Shukla et al. · 2014 · 858 citations
Flavio Junqueira, I. W. Kelly, Benjamin Reed · ACM SIGOPS Operating Systems Review · 2013 · 31 citations
Atul Adya, Gregory H. Cooper, Daniel S. Myers et al. · 2011 · 30 citations