2016 · 399 citations · 33 references
ComputingMechatronics EngineeringAcousticsMobile ComputingSensorsAcoustic TrackingMobile Human-computer InteractionMobile SensingMobile User ExperienceTracking SystemsWearable Health TechnologiesAccuracyHandheld Device TrackingMicrophonesOrthogonal Frequency-division MultiplexingSound SignalsWearable Mobile InteractionWearable SensingWireless Communication Systems
We present fingerIO, a novel fine-grained finger tracking solution for around-device interaction. FingerIO does not require instrumenting the finger with sensors and works even in the presence of occlusions between the finger and the device. We achieve this by transforming the device into an active sonar system that transmits inaudible sound signals and tracks the echoes of the finger at its microphones. To achieve sub-centimeter level tracking accuracies, we present an innovative approach that use a modulation technique commonly used in wireless communication called Orthogonal Frequency Division Multiplexing (OFDM). Our evaluation shows that fingerIO can achieve 2-D finger tracking with an average accuracy of 8 mm using the in-built microphones and speaker of a Samsung Galaxy S4. It also tracks subtle finger motion around the device, even when the phone is in the pocket. Finally, we prototype a smart watch form-factor fingerIO device and show that it can extend the interaction space to a 0.5×0.25 m2 region on either side of the device and work even when it is fully occluded from the finger.
33
The Cricket location-support system
Nissanka B. Priyantha, Anit Chakraborty, Hari Balakrishnan · 2000 · 3.7K citations
1983 · 2.7K citations
Whole-home gesture recognition using wireless signals
Qifan Pu, Sidhant Gupta, Shyamnath Gollakota et al. · 2013 · 1.1K citations
3D tracking via body radio reflections
Fadel Adib, Zachary Kabelac, Dina Katabi et al. · DSpace@MIT (Massachusetts Institute of Technology) · 2014 · 521 citations · Full text
David Kim, Otmar Hilliges, Shahram Izadi et al. · 2012 · 426 citations
Engineering, Mechatronics Engineering, Robotics Engineering +12