ACS Sensors · 2021 · 57 citations · 38 references
EngineeringBiomedical EngineeringRobotics EngineeringAssistive TechnologyRoboticsSensorsEmbodied InteractionGesture AnalysisGesture RecognitionMultimodal InteractionSensor-based InteractionTactile SensingCapacitive SensorsDynamic Gesture RecognitionGesture RecognizersGesture SensingHand GesturesHuman Multimodal InteractionSensor-based Gesture RecognitionUser-independent Gesture Recognition
As 5G communication technology allows for speedier access to extended information and knowledge, a more sophisticated human-machine interface beyond touchscreens and keyboards is necessary to improve the communication bandwidth and overcome the interfacing barrier. However, the full extent of human interaction beyond operation dexterity, spatial awareness, sensory feedback, and collaborative capability to be replicated completely remains a challenge. Here, we demonstrate a hybrid-flexible wearable system, consisting of simple bimodal capacitive sensors and a customized low power interface circuit integrated with machine learning algorithms, to accurately recognize complex gestures. The 16 channel sensor array extracts spatial and temporal information of the finger movement (deformation) and hand location (proximity) simultaneously. Using machine learning, over 99 and 91% accuracy are achieved for user-independent static and dynamic gesture recognition, respectively. Our approach proves that an extremely simple bimodal sensing platform that identifies local interactions and perceives spatial context concurrently, is crucial in the field of sign communication, remote robotics, and smart manufacturing.
38
Sepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 98.1K citations
Speech recognition with deep recurrent neural networks
Alex Graves, Abdelrahman Mohamed, Geoffrey E. Hinton · 2013 · 8.8K citations
A highly stretchable, transparent, and conductive polymer
Yue Wang, Chenxin Zhu, Raphael Pfattner et al. · Science Advances · 2017 · 1.4K citations · Full text
Natural Sciences, Materials Engineering, Materials Science +17
Learning the signatures of the human grasp using a scalable tactile glove
Subramanian Sundaram, Petr Kellnhofer, Yunzhu Li et al. · Nature · 2019 · 1.1K citations
The GRASP Taxonomy of Human Grasp Types
Thomas Feix, Javier Romero, Heinz‐Bodo Schmiedmayer et al. · IEEE Transactions on Human-Machine Systems · 2015 · 994 citations