Design and Development of Hand Gesture Based Virtual Mouse

Abstract

The technique of establishing a process of interaction between human and computer is evolving since the invention of computer technology. The mouse is an excellent invention in HCI (Human-Computer Interaction) technology. Though wireless or Bluetooth mouse technology is invented still, that technology is not completely device free. A Bluetooth mouse has the requirement of battery power and connecting dongle. Presence of extra devices in a mouse increases the difficulty to use it. The proposed mouse system is beyond this limitation. This paper proposes a virtual mouse system based on HCI using computer vision and hand gestures. Gestures captured with a built-in camera or webcam and processed with color segmentation & detection technique. The user will be allowed to control some of the computer cursor functions with their hands which bear colored caps on fingertips. Primarily, a user can perform left clicks, right clicks, and double clicks, scrolling up or down using their hand in different gestures. This system captures frames using a webcam or built-in cam and processes the frames to make them track-able and after that recognizes different gestures made by users and perform the mouse function. So the proposed mouse system eliminates device dependency in order to use a mouse. Therefore it can be proved beneficial in order to develop HCI technology.