2022 · 21 citations · 21 references
ComputingComputer EngineeringComputer ScienceDistributed SystemsNetwork SecuritySecurity ProtocolsBenchmarkingConcurrency ControlConsensus ProtocolsDistributed ConsensusDistributed TransactionsReliable Distributed SystemsBlockchain ConsensusConsensus LatencyConsensus PerformanceConsensus ScalabilityDistributed Transaction PerformanceThroughputWorkloadWorkload Characterization
The growing number of implementations of blockchain systems stands in stark contrast with still limited research on a systematic comparison of performance characteristics of these solutions. Such research is crucial for evaluating fundamental trade-offs introduced by novel consensus protocols and their implementations. These performance limitations are commonly analyzed with ad-hoc benchmarking frameworks focused on the consensus algorithm of blockchain systems. However, comparative evaluations of design choices require macro-benchmarks for uniform and comprehensive performance evaluations of blockchains at the system level rather than performance metrics of isolated components. To address this research gap, we implement Gromit, a generic framework for analyzing blockchain systems. Gromit treats each system under test as a transaction fabric where clients issue transactions to validators. We use Gromit to conduct the largest blockchain study to date, involving seven representative systems with varying consensus models. We determine the peak performance of these systems with a synthetic workload in terms of transaction throughput and scalability and show that transaction throughput does not scale with the number of validators. We explore how robust the subjected systems are against network delays and reveal that the performance of permissoned blockchain is highly sensitive to network conditions.
21
Ethereum: A Secure Decentralised Generalised Transaction Ledger
Gavin Wood · 2013 · 5.3K citations
Elli Androulaki, Artem Barger, Vita Bortnikov et al. · 2018 · 3.4K citations · Full text
In search of an understandable consensus algorithm
Diego Ongaro, John K. Ousterhout · 2014 · 1.5K citations
Yossi Gilad, Rotem Hemo, Silvio Micali et al. · 2017 · 1.5K citations · Full text
Maofan Yin, Dahlia Malkhi, Michael K. Reiter et al. · 2019 · 944 citations · Full text