A Model for Real-Time Recognition and Textual Representation of Malaysian Sign Language through Image Processing

Abstract

In this paper we discuss a stand-alone system to allow the deaf or hard-of-hearing people and normal people to communicate with each other easily and fluently. We purpose a model for recognizing Malaysian Sign Language through image processing techniques and converting the visual information into textual information at real-time. In order to implement a real time hand gesture recognition system, video footage will be obtained from digital camera or cellphone camera, then hand position and location will be marked and cropping will be done to isolate them. Then the hand gestures will be recognized through image processing and matched to a prebuilt database of gestures which will be used for textual conversion on the screen. In the final step the normal person will type the text and its equivalent animation of hand gestures will be presented. Through this system, real-time recognition of Malaysian Sign Language and textual representation is done, giving more accurate results at least possible time. It will not only benefit the deaf and dumb people of Malaysia but also could be used in various applications in the technology field. This system provides the flexibility to learn Malaysian Sign Language at personal pace, at anytime and anywhere at home or at workplace.