Real time Indian Sign Language Recognition System to aid deaf-dumb people

P. Subha Rajam, Guha Balakrishnan

2011 · 124 citations · 10 references

Concepts

TL;DR

Sign language provides a communication method for deaf and mute individuals. The study proposes a foundation for a sign language recognition system tailored to a South Indian language. The system defines 32 signs using binary UP/DOWN positions of five fingers, processes palm‑side images of the right hand, extracts feature points, trains on 10 images per sign, and converts dynamic test images to text by detecting fingertip positions. The system achieved 98.125 % accuracy on 160 test images after training with 320 images.

Abstract

The Sign Language is a method of communication for deaf - dumb people. This paper proposes a method that provides a basis for the development of Sign Language Recognition system for one of the south Indian languages. In the proposed method, a set of 32 signs, each representing the binary `UP' & `DOWN' positions of the five fingers is defined. The images are of the palm side of right hand and are loaded at runtime i.e. dynamic loading. The method has been developed with respect to single user both in training and testing phase. The static images have been pre-processed using feature point extraction method and are trained with 10 numbers of images for each sign. The images are converted into text by identifying the finger tip position of static images using image processing techniques. The proposed method is able to identify the images of the signer which are captured dynamically during testing phase. The results with test images are presented, which show that the proposed Sign Language Recognition System is able to recognize images with 98.125% accuracy when trained with 320 images and tested with 160 images.

References

10