Sleep posture classification with multi-stream CNN using vertical distance map

Abstract

Sleep posture is closely related to sleep quality. Moreover, several studies reveal that an incorrect sleep position can result in physical pain. A non-invasive image-based method was proposed for identifying ten sleep postures with high accuracy. The positions of the legs and arms was considered and more complex but common sleep postures was classified, such as fatal left, yearner left, log left, fatal right, yearner right, log right, soldier down, faller down, soldier up, faller up. Input of depth images were preprocessed and a deep multi-stream convolutional neural network was adopted for classification. The work is available for natural scenarios in which people sleep with blanket or quilt covering. Finally, 22 subjects were participated for recording depth images of 10 types of sleep postures, and efficiency of the network was also evaluated.