2020 · 19 citations · 4 references
ComputingComputer ScienceLanguage DocumentationScientific ComputingScientific VisualizationComputational ModelingScientific WritingComputational ReproducibilityMethod ReproducibilityNarrative Text CollectionReproducibility Assessment
Jupyter notebooks---documents that contain live code, equations, visualizations, and narrative text---now are among the most popular means to compute, present, discuss and disseminate scientific findings. In principle, Jupyter notebooks should easily allow to reproduce and extend scientific computations and their findings; but in practice, this is not the case. The individual code cells in Jupyter notebooks can be executed in any order, with identifier usages preceding their definitions and results preceding their computations. In a sample of 936 published notebooks that would be executable in principle, we found that 73% of them would not be reproducible with straightforward approaches, requiring humans to infer (and often guess) the order in which the authors created the cells.
4
Why Jupyter is data scientists’ computational notebook of choice
Jeffrey M. Perkel · Nature · 2018 · 377 citations
A Large-Scale Study About Quality and Reproducibility of Jupyter Notebooks
João Felipe Pimentel, Leonardo Murta, Vanessa Braganholo et al. · 2019 · 234 citations
The decay and failures of web references
Diomidis Spinellis · Communications of the ACM · 2003 · 161 citations · Full text
Jiawei Wang, Li Li, Andreas Zeller · 2020 · 63 citations