2018 · 28 citations · 19 references
ComputingComputer ScienceHigh-performance ComputingCosmologyData VisualizationScientific ComputingAstrophysical SimulationsComputational AstrophysicsData ReductionResampling MethodsResampling TechniquesAdaptive SamplingCosmological SimulationsData SamplingHigh-performance Computing SystemsInformation-directed SamplingSimulation Data Visualization
Recent advancements in high-performance computing have enabled scientists to model various scientific phenomena in great detail. However, the analysis and visualization of the output data from such large-scale simulations are posing significant challenges due to their excessive size and disk I/O bottlenecks. One viable solution to this problem is to create a sub-sampled dataset which is able to preserve the important information of the data and also is significantly smaller in size compared to the raw data. Creating an in situ workflow for generating such intelligently sub-sampled datasets is of prime importance for such simulations. In this work, we propose an information-driven data sampling technique and compare it with two well-known sampling methods to demonstrate the superiority of the proposed method. The in situ performance of the proposed method is evaluated by applying it to the Nyx Cosmology simulation. We compare and contrast the performance of these various sampling algorithms and provide a holistic view of all the methods so that the scientists can choose appropriate sampling schemes based on their analysis requirements.
19
Information Theory and Statistical Mechanics
E. T. Jaynes · Physical Review · 1957 · 12.9K citations
M. C. Shewry, Henry P. Wynn · Journal of Applied Statistics · 1987 · 601 citations
An Exact Algorithm for Maximum Entropy Sampling
Chun-Wa Ko, Jon Lee, Maurice Queyranne · Operations Research · 1995 · 338 citations
3 Nyx: A Massively Parallel AMR Code for Computational Cosmology
Ann Almgren, John B. Bell, M. J. Lijewski et al. · 2016 · 222 citations