2012 · 40 citations · 13 references
ComputingCommunicationComputer ScienceComputer VisionMovement AnalysisNonverbal CommunicationEmbodied InteractionGesture RecognitionMotion CaptureMotion SensorsTracking SystemsVirtual RealityBodily Interaction AnalysisExpansionGesture SensingMeasurementMotion Capture AnalysisMotion SensingRespiratory RateRespiratory Rate Monitoring
We describe two approaches for unobtrusively sensing subtle nonverbal behaviors using a consumer-level depth sensing camera. The first signal, respiratory rate, is estimated by measuring the visual expansion and contraction of the user's chest cavity during inhalation and exhalation. Additionally, we detect a specific type of fidgeting behavior, known as “leg jiggling,” by measuring high-frequency vertical oscillations of the user's knees. Both of these techniques rely on the combination of skeletal tracking information with raw depth readings from the sensor to identify the cyclical patterns in jittery, low-resolution data. Such subtle nonverbal signals may be useful for informing models of users' psychological states during communication with virtual human agents, thereby improving interactions that address important societal challenges in domains including education, training, and medicine.
13
Robust hand gesture recognition with kinect sensor
Zhou Ren, Jingjing Meng, Junsong Yuan et al. · 2011 · 281 citations
FAAST: The Flexible Action and Articulated Skeleton Toolkit
Evan A. Suma, Belinda Lange, Albert Rizzo et al. · 2011 · 200 citations
Human action recognition using Dynamic Time Warping
Samsu Sempena, Nur Ulfa Maulidevi, Peb Ruswono Aryan · 2011 · 188 citations