IEEE Sensors Journal · 2019 · 75 citations · 47 references
ComputingArabicComputer ScienceComputer VisionMachine LearningSensor FusionAction RecognitionMultimodal InteractionPattern RecognitionSpeech RecognitionBayesian Feature FusionContextual Evidence FusionDempster-shafer Evidence FusionGaussian Mixture ModelsLinear Discriminant AnalysisMixture ModelMotion ControllersSign Language Recognition
In this paper, we propose a dual leap motion controllers (LMC)-based Arabic sign language recognition system. More specifically, we introduce the concept of using both front and side LMCs to cater for the challenges of finger occlusions and missing data. For feature extraction, an optimum set of geometric features is selected from both controllers, while for classification, we used both a Bayesian approach with a Gaussian mixture model (GMM) and a simple linear discriminant analysis (LDA) approach. To combine the information from the two LMCs, we introduce an evidence-based fusion approach; namely, the Dempster-Shafer (DS) theory of evidence. Data were collected from two native adult signers, for 100 isolated Arabic dynamic signs. Ten observations were collected for each of the signs. The proposed framework uses an intelligent strategy to handle the case of missing data from one or both controllers. A recognition accuracy of about 92% was achieved. The proposed system outperforms state-of-the-art glove-based systems and single-sensor-based techniques.
47
Pattern Recognition and Machine Learning
Journal of Electronic Imaging · 2007 · 22.1K citations
Aleix M. Martı́nez, A.C. Kak · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2001 · 3.2K citations
Pattern recognition and machine learning
Choice Reviews Online · 2007 · 2.7K citations
Analysis of the Accuracy and Robustness of the Leap Motion Controller
Frank Weichert, Daniel Bachmann, Bartholomäus Rudak et al. · Sensors · 2013 · 906 citations · Full text
Engineering, Mechatronics Engineering, Robotics Engineering +8