Human computer interaction based eye controlled mouse

Abstract

With advanced technologies in this digital era, there is always scope for development in the field of computing. Hands free computing is in demand as of today it addresses the needs of quadriplegics. This paper presents a Human computer interaction (HCI) system that is of great importance to amputees and those who have issues with using their hands. The system built is an eye based interface that acts as a computer mouse to translate eye movements such as blinking, gazing and squinting towards the mouse cursor actions. The system in discussion makes use of a simple webcam and its software requirements are Python(3.6), OpenCv, numpy and a few other packages which are necessary for face recognition. The face detector can be built using the HOG (Histogram of oriented Gradients) feature along with a linear classifier, and the sliding window technique. It is hands free and no external hardware or sensors are required.