Concepedia

Data Pipeline Design

Data Pipeline Design is the systematic methodology for structuring, orchestrating, and optimizing data flows and processing stages in batch computing environments to ensure efficient, reliable, and scalable transformation of raw data into usable forms.

171

Publications

12.3K

Citations

992

Authors

354

Institutions

Publications per year

2017–2026

93

Parents

Publications

171

<i>lumi</i>: a pipeline for processing Illumina microarray

Pan Du, Warren A. Kibbe, Simon Lin · Bioinformatics · 2008 · 2.1K citations · Full text

, , +9

KNIME - the Konstanz information miner

Michael R. Berthold, Nicolas Cebron, Fabian Dill et al. · ACM SIGKDD Explorations Newsletter · 2009 · 1.2K citations · Full text

, , +15

COVID-19 Artificial Intelligence Diagnosis Using Only Cough Recordings

Jordi Laguarta, Ferran Hueto, Brian Subirana · IEEE Open Journal of Engineering in Medicine and Biology · 2020 · 599 citations · Full text

, , +8

Evaluation of a Tree-based Pipeline Optimization Tool for Automating Data Science

Randal S. Olson, Nathan Bartley, Ryan J. Urbanowicz et al. · 2016 · 571 citations · Full text

, , +14

Camino: Open-Source Diffusion-MRI Reconstruction and Processing

PA Cook, Yu Bai, Shahrum Nedjati-Gilani et al. · 2006 · 451 citations

, , +17

1–5 of 171

Authors

992

  1. DC
    Dianne Cook

    Iowa State University, United States

    4 publications · 104 citations

    4

    h-index

  2. JB
    Jack B. Dennis

    Massachusetts Institute of Technology, United States

    3 publications · 129 citations

    3

    h-index

  3. RS
    Randal S. Olson

    University of Pennsylvania, United States

    3 publications · 628 citations

    3

    h-index

  4. GR
    Guang R. Gao

    University of Delaware, United States

    3 publications · 129 citations

    3

    h-index

  5. ZC
    Zach Cox

    Iowa State University, United States

    2 publications · 41 citations

    2

    h-index

1–5 of 992

Institutions

354

  1. University of California, Berkeley

    Berkeley, United States

    6 h-index

    10 publications

    783 citations

  2. Virginia Tech

    Blacksburg, United States

    5 h-index

    6 publications

    583 citations

  3. University of California San Diego

    San Diego, United States

    5 h-index

    19 publications

    595 citations

  4. Herzberg Institute of Astrophysics

    Victoria, Canada

    5 h-index

    9 publications

    266 citations

  5. University of Pennsylvania

    Philadelphia, United States

    5 h-index

    14 publications

    2.1K citations

  6. University of California, Los Angeles

    Los Angeles, United States

    5 h-index

    25 publications

    1.5K citations

  7. California Institute of Technology

    Pasadena, United States

    5 h-index

    6 publications

    395 citations

  8. ETH Zurich

    Zurich, Switzerland

    5 h-index

    7 publications

    184 citations

1–8 of 354

Venues

  1. arXiv (Cornell University)

    Repository · 8 publications · 190 citations

    8

    h-index

  2. 7

    h-index

  3. Bioinformatics

    5 publications · 2.5K citations

    5

    h-index

  4. The Astronomical Journal

    AJ · 3 publications · 408 citations

    3

    h-index

  5. Journal of Computational and Graphical Statistics

    JCGS · 3 publications · 93 citations

    3

    h-index

1–5