Application of Microsoft Kinect Sensor for Tracking Construction Workers

Abstract

The image processing based human recognition is yet a challenging task because of series of complications such as variations in pose, lighting conditions and complexity of background in the tracking environment. This study introduces a novel methodology to track construction workers using image processing techniques and depth information generated from the Microsoft Kinect sensor. Kinect is a new game controller technology introduced by Microsoft in November 2010. This automated real-time worker tracking system provides an opportunity to track the construction worker location and their movements in a specified indoor work area. The research study proposes a properly color coded "construction hardhat" as a key tracking object which can be used to differentiate site personnel (worker, supervisor, engineer, etc.). The proposed method detects construction workers in three major stages which includes human recognition, hardhat recognition and 3D localization. The human recognition is done by analysing human body parts. 3D positions of body joints are accurately predicted from a single depth image. The construction hardhat detection is based on characteristics of the hardhat such as unique shape and color. Template based template matching is used as the pattern recognition technique.