2012 · 350 citations · 3 references
EngineeringPhysicsAcousticsNonverbal CommunicationSensorsAcoustic SensorsGesture AnalysisGesture RecognitionMobile Human-computer InteractionMobile SensingMultimodal InteractionGesture Recognition EvaluationGesture RecognizersGesture SensingGesture-based InterfacesHand GesturesIn-air Gesture InterfacesRobust Gesture RecognitionSensor-based Gesture Recognition
Gesture is becoming an increasingly popular means of interacting with computers. However, it is still relatively costly to deploy robust gesture recognition sensors in existing mobile platforms. We present SoundWave, a technique that leverages the speaker and microphone already embedded in most commodity devices to sense in-air gestures around the device. To do this, we generate an inaudible tone, which gets frequency-shifted when it reflects off moving objects like the hand. We measure this shift with the microphone to infer various gestures. In this note, we describe the phenomena and detection algorithm, demonstrate a variety of gestures, and present an informal evaluation on the robustness of this approach across different devices and people.
3
Joseph A. Paradiso, Craig Abler, Kai-yuh Hsiao et al. · 1997 · 183 citations · Full text
Sonar-based measurement of user presence and attention
Stephen P. Tarzia, Robert P. Dick, Peter A. Dinda et al. · 2009 · 82 citations