ACM Transactions on Graphics · 2019 · 171 citations · 52 references
ComputingComputer ScienceRobotics EngineeringComputer VisionMachine VisionRobot Vision3D ReconstructionGesture InteractionGrasp DetectionMotion CapturePose EstimationScene Reconstruction3D Shape ReconstructionArticulated Pose EstimationHand Pose EstimationHand TrackingNonlinear Least SquaresReal-time ProcessingShapeShape Reconstruction
We present a novel method for real-time pose and shape reconstruction of two strongly interacting hands. Our approach is the first two-hand tracking solution that combines an extensive list of favorable properties, namely it is marker-less, uses a single consumer-level depth camera, runs in real time, handles inter- and intra-hand collisions, and automatically adjusts to the user's hand shape. In order to achieve this, we embed a recent parametric hand pose and shape model and a dense correspondence predictor based on a deep neural network into a suitable energy minimization framework. For training the correspondence prediction network, we synthesize a two-hand dataset based on physical simulations that includes both hand pose and shape annotations while at the same time avoiding inter-hand penetrations. To achieve real-time rates, we phrase the model fitting in terms of a nonlinear least-squares problem so that the energy can be optimized based on a highly efficient GPU-based Gauss-Newton optimizer. We show state-of-the-art results in scenes that exceed the complexity level demonstrated by previous work, including tight two-hand grasps, significant inter-hand occlusions, and gesture interaction. 1
52
Adam: A Method for Stochastic Optimization
Diederik P. Kingma, Jimmy Ba · UvA-DARE (University of Amsterdam) · 2014 · 84.8K citations · Full text
MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
Andrew Howard, Menglong Zhu, Bo Chen et al. · arXiv (Cornell University) · 2017 · 9.9K citations · Full text
Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising
Kai Zhang, Wangmeng Zuo, Yunjin Chen et al. · IEEE Transactions on Image Processing · 2017 · 8.8K citations · Full text
Javier Romero, Dimitrios Tzionas, Michael J. Black · ACM Transactions on Graphics · 2017 · 1K citations · Full text