Computer Graphics Forum · 2018 · 51 citations · 47 references
ArchitectureComputer ScienceComputer VisionPhotographyRendering3D RenderingComputational PhotographyImage SynthesisImage-based LightingLighting ModelsHdr Environment MappingHigh Dynamic Range (Hdr) ImagingHigh Dynamic Range RenderingIllumination EstimationImage-based Lighting ApproximationInverse LightingLighting Environment EstimationLighting Estimation
Abstract Image‐based lighting has allowed the creation of photo‐realistic computer‐generated content. However, it requires the accurate capture of the illumination conditions, a task neither easy nor intuitive, especially to the average digital photography enthusiast. This paper presents an approach to directly estimate an HDR light probe from a single LDR photograph, shot outdoors with a consumer camera, without specialized calibration targets or equipment. Our insight is to use a person's face as an outdoor light probe. To estimate HDR light probes from LDR faces we use an inverse rendering approach which employs data‐driven priors to guide the estimation of realistic, HDR lighting. We build compact, realistic representations of outdoor lighting both parametrically and in a data‐driven way, by training a deep convolutional autoencoder on a large dataset of HDR sky environment maps. Our approach can recover high‐frequency, extremely high dynamic range lighting environments. For quantitative evaluation of lighting estimation accuracy and relighting accuracy, we also contribute a new database of face photographs with corresponding HDR light probes. We show that relighting objects with HDR light probes estimated by our method yields realistic results in a wide variety of settings.
47
One millisecond face alignment with an ensemble of regression trees
Vahid Kazemi, Josephine Sullivan · 2014 · 2.8K citations · Full text
Recovering high dynamic range radiance maps from photographs
Paul Debevec, Jitendra Malik · 2008 · 2.4K citations
Recovering high dynamic range radiance maps from photographs
Paul Debevec, Jitendra Malik · 1997 · 1.7K citations · Full text