EngineeringPhysicsAcousticsComputational AcousticsGraspingAcoustic MeasurementAcoustic SensingAcoustic SensorsGesture RecognitionMobile Human-computer InteractionMultimodal InteractionGesture AcousticsGesture SensingGesture-based InterfacesSignalsSound SignalsStructure-borne SoundTouchscreen InteractionUser Interaction
Enabling touch gesture sensing on all surfaces of the mobile device, not limited to the touchscreen area, leads to new user interaction experiences. In this paper, we propose VSkin, a system that supports fine-grained gesture-sensing on the back of mobile devices based on acoustic signals. VSkin utilizes both the structure-borne sounds, i.e., sounds propagating through the structure of the device, and the air-borne sounds, i.e., sounds propagating through the air, to sense finger tapping and movements. By measuring both the amplitude and the phase of each path of sound signals, VSkin detects tapping events with an accuracy of 99.65% and captures finger movements with an accuracy of 3.59mm.
34
Chunyi Peng, Guobin Shen, Yongguang Zhang et al. · 2007 · 482 citations
Human respiration detection with commodity wifi devices
Hao Wang, Daqing Zhang, Junyi Ma et al. · 2016 · 478 citations
Engineering, Biomedical Engineering, Electrical Engineering +17
Rajalakshmi Nandakumar, Vikram Iyer, Desney Tan et al. · 2016 · 399 citations