Evaluation and unification of some methods for estimating reflectance spectra from RGB images

Abstract

The problem of estimating spectral reflectances from the responses of a digital camera has received considerable attention recently. This problem can be cast as a regularized regression problem or as a statistical inversion problem. We discuss some previously suggested estimation methods based on critically undersampled RGB measurements and describe some relations between them. We concentrate mainly on those models that are using a priori information in the form of high-resolution measurements. We use the "kernel machine" framework in our evaluations and concentrate on the use of multiple illuminations and on the investigation of the performance of global and locally adapted estimation methods. We also introduce a nonlinear transformation of reflectance values to ensure that the estimated reflection spectra fulfill physically motivated boundary conditions. The reported experimental results are derived from measured and simulated camera responses from the Munsell Matte, NCS, and Pantone data sets.