Hands free interface for Human Computer Interaction

Abstract

At present, there are no adequate solutions which facilitate the interaction of computers to handicapped people. This research addresses that issue and it provides a comprehensive solution for the problem. The product provides an alternative to the conventional mouse using computer vision and voice recognition technologies as key techniques. The user can use his or her nose's relative movements to move the mouse pointer and use other mouse actions by voice commands. Enhanced template matching image processing technologies have used to track the nose position. Background light changes are rectified with using adoptive thresholds. The voice interaction is achieved by using Speech API calls and overall mouse events are passed to system using system API calls. The only additional hardware components used are, a web cam and a microphone which come by default in most laptop computers in built. And such external microphones and web cameras are available in very affordable price.