ACM Transactions on Intelligent Systems and Technology · 2019 · 22 citations · 41 references
ComputingVisualizationComputer VisionRenderingVolume Visualization3D ReconstructionRendering PipelineScene ReconstructionVolume RenderingVolumetric RenderingVolumetric VisualizationConvolutional Neural NetworksFeature-based SimilarityImage Similarity MeasurementPerspective ViewpointsSimilarity ReasoningViewpoint AnalysisViewpoint Estimation
Viewpoint estimation from 2D rendered images is helpful in understanding how users select viewpoints for volume visualization and guiding users to select better viewpoints based on previous visualizations. In this article, we propose a viewpoint estimation method based on Convolutional Neural Networks (CNNs) for volume visualization. We first design an overfit-resistant image rendering pipeline to generate the training images with accurate viewpoint annotations, and then train a category-specific viewpoint classification network to estimate the viewpoint for the given rendered image. Our method can achieve good performance on images rendered with different transfer functions and rendering parameters in several categories. We apply our model to recover the viewpoints of the rendered images in publications, and show how experts look at volumes. We also introduce a CNN feature-based image similarity measure for similarity voting based viewpoint selection, which can suggest semantically meaningful optimal viewpoints for different volumes and transfer functions.
41
Deep Residual Learning for Image Recognition
Kaiming He, Xiangyu Zhang, Shaoqing Ren et al. · 2016 · 222.1K citations · Full text
Going deeper with convolutions
Christian Szegedy, Wei Liu, Yangqing Jia et al. · 2015 · 46.8K citations
Yangqing Jia, Evan Shelhamer, Jeff Donahue et al. · 2014 · 11.2K citations