Audio to Indian and American Sign Language Converter using Machine Translation and NLP Technique

Abstract

People with hearing loss use Sign Language as their mother tongue communication. Unlike acoustic hearing, sign language is a visual language that uses body language and physical communication to communicate effectively thoughts. It usually consists of hand gestures and facial expressions. Generally, communicating with different disabled people seems very difficult. This is because it takes a long time to learn the language, not just the language, people who are not disabled but also people who are. Establishment to communicate in such cases, both parties need to know sign language, or they use a human translator to make communication possible. Information Technologies with their own modern methods such as artificial intelligence, cloud computing has an amazing role to play in improving communication people with speech impairments and ordinary people. Sign language recognition can be done in two ways, glove-based or vision-based recognition. The solution proposed in this paper will produce software that takes over input in the form of speech and indicates appropriate Sign Language. The software is developed in Python platform to convert speech to Indian and American sign languages (ISL and ASL) which provides hearing impairment assistant. This software can be useful in many areas, such as in educational institutes, hospitals, police stations, and for general everyday life conversation.