Data Archiving and Networked Services (DANS) · 2011 · 27 citations · 13 references
EngineeringSoftware SystemsSoftware EngineeringSimulationData-driven DevelopmentData ScienceManagementSimulation FrameworkSimulation WorkflowsSystems EngineeringData IntegrationModeling And SimulationParallel ComputingData ManagementSimulation LanguageAdequate Data ManagementWorkflow TechnologyComputer EngineeringSoftware SimulationComputer ScienceData ProvisioningAccessing External DataDistributed SimulationWorkflow ExecutionScientific Workflow SystemSimulation InfrastructureWorkflow PatternParallel ProgrammingIndustrial InformaticsSystem SoftwareData Modeling
Adequate data management and data provisioning are among the most important topics to cope with the information explosion intrinsically associated with simulation applications. Today, data exchange with and between simulation applications is mainly accomplished in a file-style manner. These files show proprietary formats and have to be transformed according to the specific needs of simulation applications. Lots of effort has to be spent to find appropriate data sources and to specify and implement data transformations. In this paper, we present SIMPL – an extensible framework that provides a generic and consolidated abstraction for data management and data provisioning in simulation workflows. We introduce extensions to workflow languages and show how they are used to model the data provisioning for simulation workflows based on data management patterns. Furthermore, we show how the framework supports a uniform access to arbitrary external data in such workflows. This removes the burden from engineers and scientists to specify low-level details of data management for their simulation applications and thus boosts their productivity.
13
Michael Isard, Mihai Budiu, Yuan Yu et al. · 2007 · 2.4K citations
Examining the Challenges of Scientific Workflows
Yolanda Gil, Ewa Deelman, Mark H. Ellisman et al. · Computer · 2007 · 520 citations