IEEE Transactions on Parallel and Distributed Systems · 2022 · 15 citations · 22 references
ComputingEarth SciencesPrecision AgricultureMachine LearningRemote SensingSoil ScienceAnnotationData ProvenanceData TraceabilityExplainable Machine LearningMetadata CaptureEarth Science ModelingMetadataProvenance AnnotationProvenance CaptureProvenance TrackingScientific Workflow ProvenanceSoil Moisture EstimationSoil Moisture Modeling
To trust findings in computational science, scientists need workflows that trace the data provenance and support results explainability. As workflows become more complex, tracing data provenance and explaining results become harder to achieve. In this paper, we propose a computational environment that automatically creates a workflow execution's record trail and invisibly attaches it to the workflow's output, enabling data traceability and results explainability. Our solution transforms existing container technology, includes tools for automatically annotating provenance metadata, and allows effective movement of data and metadata across the workflow execution. We demonstrate the capabilities of our environment with the study of SOMOSPIE, an earth science workflow. Through a suite of machine learning modeling techniques, this workflow predicts soil moisture values from the 27 km resolution satellite data down to higher resolutions necessary for policy making and precision agriculture. By running the workflow in our environment, we can identify the causes of different accuracy measurements for predicted soil moisture values in different resolutions of the input data and link different results to different machine learning methods used during the soil moisture downscaling, all without requiring scientists to know aspects of workflow design and implementation.
22
Pegasus, a workflow management system for science automation
Ewa Deelman, Karan Vahi, Gideon Juve et al. · Future Generation Computer Systems · 2014 · 818 citations · Full text
Special Issue: The First Provenance Challenge
Luc Moreau, Bertram Ludäscher, İlkay Altıntaş et al. · Concurrency and Computation Practice and Experience · 2007 · 133 citations · Full text