Sensors · 2018 · 159 citations · 20 references
ComputingAmerican Sign LanguageComputer ScienceArtificial IntelligenceMachine LearningNatural Language ProcessingAction RecognitionDeep LearningGesture RecognitionLetter RecognitionPattern RecognitionSpeech RecognitionDynamic GesturesGesture Feature ExtractionSign Language RecognitionSupport Vector ClassificationSupport Vector Machine Classification
Sign language enables deaf and hard‑of‑hearing people to communicate, yet most research focuses on incomplete recognition; this study targets full American Sign Language, which includes 26 letters and 10 digits, noting that most letters are static while some require dynamic motion. The study aims to develop a Leap Motion Controller–based prototype that extracts finger and hand motion features to distinguish static from dynamic ASL gestures and achieve full recognition of 26 letters and 10 digits. The prototype uses the Leap Motion Controller to capture hand and finger motion data, from which features are extracted to differentiate static and dynamic gestures. The prototype achieved 93.81 % accuracy for 26 letters with a DNN (80.30 % with SVM) and 88.79 % for 26 letters plus 10 digits (72.79 % with SVM), demonstrating strong potential as an interpreter to bridge communication gaps for the deaf and hard‑of‑hearing.
Sign language is intentionally designed to allow deaf and dumb communities to convey messages and to connect with society. Unfortunately, learning and practicing sign language is not common among society; hence, this study developed a sign language recognition prototype using the Leap Motion Controller (LMC). Many existing studies have proposed methods for incomplete sign language recognition, whereas this study aimed for full American Sign Language (ASL) recognition, which consists of 26 letters and 10 digits. Most of the ASL letters are static (no movement), but certain ASL letters are dynamic (they require certain movements). Thus, this study also aimed to extract features from finger and hand motions to differentiate between the static and dynamic gestures. The experimental results revealed that the sign language recognition rates for the 26 letters using a support vector machine (SVM) and a deep neural network (DNN) are 80.30% and 93.81%, respectively. Meanwhile, the recognition rates for a combination of 26 letters and 10 digits are slightly lower, approximately 72.79% for the SVM and 88.79% for the DNN. As a result, the sign language recognition system has great potential for reducing the gap between deaf and dumb communities and others. The proposed prototype could also serve as an interpreter for the deaf and dumb in everyday life in service sectors, such as at the bank or post office.
20
Scikit-learn: Machine Learning in Python
Fabián Pedregosa, Gaël Varoquaux, Alexandre Gramfort et al. · arXiv (Cornell University) · 2012 · 63.7K citations · Full text
A survey of cross-validation procedures for model selection
2009 · 3.8K citations
A survey of cross-validation procedures for model selection
Statistics Surveys · 2010 · 3.3K citations · Full text