Concepedia

A case study on parallel HDF5 dataset concatenation for high energy physics data analysis

Sunwoo Lee, Kaiyuan Hou, Kewei Wang, Saba Sehrish, M. Paterno, Quincey Koziol, Robert Ross, Ankit Agrawal, Alok Choudhary, Wei‐keng Liao

Parallel Computing · 2021 · 13 citations · 10 references

Open access

Concepts

ComputingComputer SciencePhysicsData ManagementParallel ComputingScientific ComputingData IntegrationData ParallelismData PipelinesData ReductionDistributed Data ProcessingHigh-energy AstrophysicsData Parallel ExecutionData Reduction PipelinesData-intensive ComputingHigh-performance Computing In AstrophysicsParallel Data ProcessingParallel Stream ProcessingParallelism Exploitation

References

10

Proceedings of the 2007 ACM/IEEE conference on Supercomputing

Becky Verastegui · 2007 · 313 citations

Computing, Computer Science, High-performance Computing +10

Scientific data exchange: a schema for HDF5-based storage of raw and analyzed data

Francesco De Carlo, Doğa Gürsoy, Federica Marone et al. · Journal of Synchrotron Radiation · 2014 · 103 citations · Full text

Natural Sciences, Information Technology, Biomedical Imaging +16

Parallel data analysis directly on scientific file formats

Spyros Blanas, Kesheng Wu, Bin Dong et al. · 2014 · 92 citations

Computing, Computer Science, High-performance Computing +16

zlib compression library

Jean-loup Gailly, Mark Adler · Apollo (University of Cambridge) · 2012 · 69 citations

Computing, Computer Engineering, Computer Science +8

Unifying biological image formats with HDF5

Matthew T. Dougherty, Michael Folk, Erez Zadok et al. · Communications of the ACM · 2009 · 57 citations · Full text

Medicine, Biomedical Sciences, Biomedical Imaging +16