Three-dimensional volumetric object reconstruction using computational integral imaging

TLDR

The authors develop and evaluate a 3D imaging technique that captures a scene with a microlens array and reconstructs it as a volumetric image. The method acquires elemental images via a microlens and detector array and computationally reconstructs volume pixels by simulating ray optics and back‑propagating through a synthesized pinhole array. Experimental results demonstrate that the reconstructed volume pixels enable accurate 3D surface reconstruction, validating the algorithm’s performance.

Abstract

We propose a three-dimensional (3D) imaging technique that can sense a 3D scene and computationally reconstruct it as a 3D volumetric image. Sensing of the 3D scene is carried out by obtaining elemental images optically using a pickup microlens array and a detector array. Reconstruction of volume pixels of the scene is accomplished by computationally simulating optical reconstruction according to ray optics. The entire pixels of the recorded elemental images contribute to volumetric reconstruction of the 3D scene. Image display planes at arbitrary distances from the display microlens array are computed and reconstructed by back propagating the elemental images through a computer synthesized pinhole array based on ray optics. We present experimental results of 3D image sensing and volume pixel reconstruction to test and verify the performance of the algorithm and the imaging system. The volume pixel values can be used for 3D image surface reconstruction.