Detection of Movements of Head and Mouth to Provide Computer Access for Disabled

Abstract

This paper analyzes the biometric identification and tracking related technologies of human-computer interaction. Based on Adaboost face detection algorithm, we propose a position-based head motion detection algorithm, which does not depend on the specific biometric identification and tracking. It uses feature classification method to detect mouth's opening and closing actions. We also design a software system to operate computer by image detection of head and mouth movements. The combinations of head and mouth movements, are mapped to various mouse events, including move, click and drag, and so on. This system can be used for the upper limb disabled who can not use the traditional mouse and keyboard. And further it can also be used for general computer users to do neck rehabilitation training, computer somatic games, etc.