2015 · 53 citations · 18 references
ComputingComputer ScienceComputer SystemsCloud InfrastructureCloud Performance OptimizationDistributed SystemsCloud Resource ManagementDistributed Systems PerformanceLatency OptimizationScalability ArchitectureScalability EngineeringChannelsCloud Latency OptimizationCloud Load BalancingHashingLatency ReductionLoad MonitoringMultiplayer GamesScalable Middleware Architectures
This paper presents Dynamoth, a dynamic, scalable, channel-based pub/sub middleware targeted at large scale, distributed and latency constrained systems. Our approach provides a software layer that balances the load generated by a high number of publishers, subscribers and messages across multiple, standard pub/sub servers that can be deployed in the Cloud. In order to optimize Cloud infrastructure usage, pub/sub servers can be added or removed as needed. Balancing takes into account the live characteristics of each channel and is done in an hierarchical manner across channels (macro) as well as within individual channels (micro) to maintain acceptable performance and low latencies despite highly varying conditions. Load monitoring is performed in an unintrusive way, and rebalancing employs a lazy approach in order to minimize its temporal impact on performance while ensuring successful and timely delivery of all messages. Extensive real-world experiments that illustrate the practicality of the approach within a massively multiplayer game setting are presented. Results indicate that with a given number of servers, Dynamoth was able to handle 60% more simultaneous clients than the consistent hashing approach, and that it was properly able to deal with highly varying conditions in the context of large workloads.
18
Krishna P. Gummadi, Stefan Saroiu, Steven D. Gribble · ACM SIGCOMM Computer Communication Review · 2002 · 629 citations
Hermes: a distributed event-based middleware architecture
Peter Pietzuch, Jean Bacon · 2003 · 481 citations
Krishna P. Gummadi, Stefan Saroiu, Steven D. Gribble · 2002 · 370 citations