IEEE Transactions on Parallel and Distributed Systems · 2019 · 38 citations · 45 references
ComputingCloud ComputingComputer ScienceCloud InfrastructureDistributed SystemsGrid ComputingCloud Resource ManagementCloud-based AnalyticsCompute Resource ManagementDistributed ComputingDistributed Data ProcessingDistributed Systems PerformanceCloud Data CentersCloud Data ProcessingData Privacy RequirementsGeo-distributed SystemsPrivacy RequirementsPrivacy Requirements AnalysisPrivacy-preserving ComputingPrivacy-preserving Processing
Recently, various applications including data analytics and machine learning have been developed for geo-distributed cloud data centers. For those applications, the ways of mapping parallel processes to physical nodes (i.e., “process mapping”) could significantly impact the performance of the applications because of non-uniform communication cost in geo-distributed environments. What's more, the different data privacy requirements in geo-distributed data centers pose additional constraints on process mapping solutions. While process mapping has been widely studied in grid/cluster environments, few of the existing studies have considered the problem in geo-distributed cloud environment, which is a challenging task due to the multi-level data privacy constraints, heterogeneous network performance and process failures. In this paper, we introduce the special privacy requirements in geo-distributed data centers and formulate the geo-distributed process mapping problem as an optimization problem with multiple constraints. We develop a new method to efficiently find good process mapping solutions to the problem. Experimental results on real clouds (including Amazon EC2 and Windows Azure) and simulations demonstrate that our proposed approach can achieve significant performance improvement compared to the state-of-the-art algorithms.
45
LogP: towards a realistic model of parallel computation
David Culler, Richard M. Karp, David A. Patterson et al. · 1993 · 1.5K citations
Raluca Ada Popa, Catherine M. S. Redfield, Nickolai Zeldovich et al. · 2011 · 1.1K citations · Full text
Parallelized Stochastic Gradient Descent
Martin Zinkevich, Markus Weimer, Lihong Li et al. · 2010 · 1.1K citations