2021 IEEE/CVF International Conference on Computer Vision (ICCV) · 2021 · 56 citations · 39 references
ComputingComputer ScienceComputer VisionDigital RenderingRendering3D Reconstruction3D RenderingGlobal IlluminationScene ReconstructionStereo RenderingComputer Graphics RenderingGlobal Illumination ModelsIllumination EffectsPhotometric StereoScene Reconstruction For RenderingSpecular ReflectanceSpecular Reflection
Retrieving accurate 3D reconstructions of objects from the way they reflect light is a very challenging task in computer vision. Despite more than four decades since the definition of the Photometric Stereo problem, most of the literature has had limited success when global illumination effects such as cast shadows, self-reflections and ambient light come into play, especially for specular surfaces. Recent approaches have leveraged the capabilities of deep learning in conjunction with computer graphics in order to cope with the need of a vast number of training data to invert the image irradiance equation and retrieve the geometry of the object. However, rendering global illumination effects is a slow process which can limit the amount of training data that can be generated.In this work we propose a novel pixel-wise training procedure for normal prediction by replacing the training data (observation maps) of globally rendered images with independent per-pixel generated data. We show that global physical effects can be approximated on the observation map domain and this simplifies and speeds up the data creation procedure. Our network, PX-NET, achieves state-of-the-art performance compared to other pixelwise methods on synthetic datasets, as well as the DiLiGenT real dataset on both dense and sparse light settings.
39
Adam: A Method for Stochastic Optimization
Diederik P. Kingma, Jimmy Ba · UvA-DARE (University of Amsterdam) · 2014 · 84.8K citations · Full text
Densely Connected Convolutional Networks
Gao Huang, Zhuang Liu, Laurens van der Maaten et al. · 2017 · 44.7K citations
Illumination for computer generated pictures
Bui Tuong Phong · Communications of the ACM · 1975 · 3K citations · Full text
A Reflectance Model for Computer Graphics
Robert L. Cook, K. E. Torrance · ACM Transactions on Graphics · 1982 · 1.4K citations · Full text