Scientific Programming · 2015 · 63 citations · 20 references
ComputingCloud ComputingComputer ScienceCloud ArchitectureCloud InfrastructureScientific ComputingCloud Resource ManagementCompute Resource ManagementCost OptimizationResource SchedulingWorkflow OrchestrationWorkload SchedulingBillingCloud SchedulingCost-aware SchedulingWorkflow Cost OptimizationWorkflow ExecutionWorkflow Management SystemsWorkflow SchedulingWorkload Cost Modeling
This paper presents a cost optimization model for scheduling scientific workflows on IaaS clouds such as Amazon EC2 or RackSpace. We assume multiple IaaS clouds with heterogeneous virtual machine instances, with limited number of instances per cloud and hourly billing. Input and output data are stored on a cloud object store such as Amazon S3. Applications are scientific workflows modeled as DAGs as in the Pegasus Workflow Management System. We assume that tasks in the workflows are grouped into levels of identical tasks. Our model is specified using mathematical programming languages (AMPL and CMPL) and allows us to minimize the cost of workflow execution under deadline constraints. We present results obtained using our model and the benchmark workflows representing real scientific applications in a variety of domains. The data used for evaluation come from the synthetic workflows and from general purpose cloud benchmarks, as well as from the data measured in our own experiments with Montage, an astronomical application, executed on Amazon EC2 cloud. We indicate how this model can be used for scenarios that require resource planning for scientific workflows and their ensembles.
20
LIGO: The Laser Interferometer Gravitational-Wave Observatory
Alex Abramovici, W. E. Althouse, R. W. P. Drever et al. · Science · 1992 · 2.3K citations
Natural Sciences, Astronomy, Physics +16
Characterizing and profiling scientific workflows
Gideon Juve, Ann Chervenak, Ewa Deelman et al. · Future Generation Computer Systems · 2012 · 766 citations
Characterization of scientific workflows
Shishir Bharathi, Ann Chervenak, Ewa Deelman et al. · 2008 · 611 citations