2014 · 17 citations · 10 references
ComputingComputer ScienceParallel ComputingProgramming LanguagesScientific ComputingData ParallelismData-flow AnalysisDataflow ModelingParallel Programming ModelsDataflow GraphsDataflow ProgrammingDataflow Programming ModelsDataflow SemanticsParallel ProgrammingProgramming Models
Current work on parallel programming models are trending towards the dataflow paradigm. Previous works on that topic have shown that dataflow programming is indeed a natural way to exploit parallelism in programs. However, there is still a gap in terms of ease of programming between high level languages adopted by the scientific community and the languages and tools available for dataflow programming. In this paper we present Sucuri: a minimalistic Python library that provides dataflow programming with reasonably simple syntax. To parallelize applications using our library, the programmer needs only to identify functions of his code that are good candidates for parallelization and instantiate a dataflow graph where each node is associated with one of such functions, and the edges between nodes describe data dependencies between functions. We then proceed to implement two benchmarks that represent important parallel programming patterns using our library and execute them on a cluster of multicores. Experimental results are promising, proving that our library can be an interesting first option for parallelization.
10
The String-to-String Correction Problem
Robert A. Wagner, Michael J. Fischer · Journal of the ACM · 1974 · 3.1K citations · Full text
Ruffus: a lightweight Python library for computational pipelines
Leo Goodstadt · Bioinformatics · 2010 · 150 citations · Full text
TERAFLUX: Harnessing dataflow in next generation teradevices
Roberto Giorgi, Rosa M. Badía, François Bodin et al. · Microprocessors and Microsystems · 2014 · 66 citations