2011 · 21 citations · 24 references
ComputingComputer ScienceComputer GraphicsComputer VisionMachine VisionGesture RecognitionMotion AnalysisMotion EstimationOptical FlowPose EstimationScene UnderstandingAngular PrecisionBackground SubtractionHuman Motion AnalysisPointing MovementsVision-based Gesture Recognition
Vision-based prop-free pointing detection is challenging both from an algorithmic and a systems standpoint. From a computer vision perspective, accurately determining where multiple users are pointing is difficult in cluttered environments with dynamic scene content. Standard approaches relying on appearance models or background subtraction to segment users operate poorly in this domain. We propose a method that focuses on motion analysis to detect pointing gestures and robustly estimate the pointing direction. Our algorithm is self-initializing; as the user points, we analyze the observed motion from two cameras and infer rotation centers that best explain the observed motion. From these, we group pixel-level flow into dominant pointing vectors that each originate from a rotation center and merge across views to obtain 3D pointing vectors. However, our proposed algorithm is computationally expensive, posing systems challenges even with current computing infrastructure. We achieve interactive speeds by exploiting coarse-grained parallelization over a cluster of computers. In unconstrained environments, we obtain an average angular precision of 2.7°.
24
Jianbo Shi, Tomasi · 1994 · 6.9K citations · Full text
Richard A. Bolt · 1980 · 1.4K citations · Full text
3-D model-based tracking of humans in action: a multi-view approach
Dariu M. Gavrila, L.S. Davis · 1996 · 702 citations