Depth and RGB image alignment for hand gesture segmentation using Kinect

Abstract

This paper introduces a novel method for the depth map and RGB image alignment for Kinect. Genetic algorithm is used to estimate the key points from both depth and RGB images, and this method is robust to the uncertainties of the extracted point numbers. The experimental results demonstrated that the proposed method is capable of precisely aligning the depth and RGB images, contributes a great improvement for hand gesture segmentation, and will potentially improve the performance of hand gesture recognition in Human-Computer Interaction (HCI).