ACM Transactions on Graphics · 2021 · 14 citations · 76 references
ComputingComputer Science3D ModelingComputer VisionVisual Perception3D Reconstruction3D RenderingPhotorealistic RenderingThree-dimensional VisualizationTree FormVirtual RealityAttributesGeometric Tree ModelsNeural Network-based EstimationPerceptual RenderingRealism EnhancementSide-by-side ComparisonUser Study EvaluationVisual Realism
Many algorithms for virtual tree generation exist, but the visual realism of the 3D models is unknown. This problem is usually addressed by performing limited user studies or by a side-by-side visual comparison. We introduce an automated system for realism assessment of the tree model based on their perception. We conducted a user study in which 4,000 participants compared over one million pairs of images to collect subjective perceptual scores of a large dataset of virtual trees. The scores were used to train two neural-network-based predictors. A view independent ICTreeF uses the tree model's geometric features that are easy to extract from any model. The second is ICTreeI that estimates the perceived visual realism of a tree from its image. Moreover, to provide an insight into the problem, we deduce intrinsic attributes and evaluate which features make trees look like real trees. In particular, we show that branching angles, length of branches, and widths are critical for perceived realism. We also provide three datasets: carefully curated 3D tree geometries and tree skeletons with their perceptual scores, multiple views of the tree geometries with their scores, and a large dataset of images with scores suitable for training deep neural networks.
76
Leo Breiman · Machine Learning · 2001 · 126.2K citations · Full text
Image quality assessment: from error visibility to structural similarity
Zhou Wang, Alan C. Bovik, Hamid R. Sheikh et al. · IEEE Transactions on Image Processing · 2004 · 56K citations
The Unreasonable Effectiveness of Deep Features as a Perceptual Metric
Richard Zhang, Phillip Isola, Alexei A. Efros et al. · 2018 · 12.4K citations
3D ShapeNets: A deep representation for volumetric shapes
Zhirong Wu, Shuran Song, Aditya Khosla et al. · 2015 · 4.7K citations · Full text
Multi-view Convolutional Neural Networks for 3D Shape Recognition
Hang Su, Subhransu Maji, Evangelos Kalogerakis et al. · 2015 · 3.3K citations