2013 · 212 citations · 21 references
ComputingCloud ComputingComputer ScienceCloud InfrastructureSchedulingScientific ComputingCompute Resource ManagementDeadline AnalysisResource SchedulingTask SchedulingWorkflow OrchestrationWorkload SchedulingCloud Resource ProvisioningDeadline GuaranteesDynamic Resource ProvisioningInfrastructure As A ServiceInfrastructure-as-a-service StrategyProvisioningScientific Workflow ManagementWorkflow Scheduling
Abstract—Large-scale applications expressed as scientific workflows are often grouped into ensembles of inter-related workflows. In this paper, we address a new and important problem concerning the efficient management of such ensembles under budget and deadline constraints on Infrastructure- as-a-Service (IaaS) clouds. We discuss, develop, and assess algorithms based on static and dynamic strategies for both task scheduling and resource provisioning. We perform the evaluation via simulation using a set of scientific workflow ensembles with a broad range of budget and deadline parameters, taking into account uncertainties in task runtime estimations, provisioning delays, and failures. We find that the key factor determining the performance of an algorithm is its ability to decide which workflows in an ensemble to admit or reject for execution. Our results show that an admission procedure based on workflow structure and estimates of task runtimes can significantly improve the quality of solutions. I.
21
Rodrigo N. Calheiros, Rajiv Ranjan, Anton Beloglazov et al. · Software Practice and Experience · 2010 · 4.9K citations · Full text
Pegasus: A Framework for Mapping Complex Scientific Workflows onto Distributed Systems
Ewa Deelman, Gurmeet Singh, Mei-Hui Su et al. · Scientific Programming · 2005 · 1.2K citations · Full text
Characterization of scientific workflows
Shishir Bharathi, Ann Chervenak, Ewa Deelman et al. · 2008 · 611 citations