2019 · 1.1K citations · 29 references
ComputingComputer ScienceComputer VisionMachine VisionRobot VisionPoint Cloud ProcessingPose EstimationRobotic VisionScene UnderstandingVisual LocalizationVisual Odometry3D Pose Estimation6D Object Pose Estimation6D Pose EstimationHuman Pose EstimationKeypoint DetectionKeypoint LocalizationObject Pose EstimationReal-time Estimation
This paper addresses the challenge of 6DoF pose estimation from a single RGB image under severe occlusion or truncation. Many recent works have shown that a two-stage approach, which first detects keypoints and then solves a Perspective-n-Point (PnP) problem for pose estimation, achieves remarkable performance. However, most of these methods only localize a set of sparse keypoints by regressing their image coordinates or heatmaps, which are sensitive to occlusion and truncation. Instead, we introduce a Pixel-wise Voting Network (PVNet) to regress pixel-wise vectors pointing to the keypoints and use these vectors to vote for keypoint locations. This creates a flexible representation for localizing occluded or truncated keypoints. Another important feature of this representation is that it provides uncertainties of keypoint locations that can be further leveraged by the PnP solver. Experiments show that the proposed approach outperforms the state of the art on the LINEMOD, Occlusion LINEMOD and YCB-Video datasets by a large margin, while being efficient for real-time pose estimation. We further create a Truncation LINEMOD dataset to validate the robustness of our approach against truncation. The code is available at https://zju3dv.github.io/pvnet/.
29
Deep Residual Learning for Image Recognition
Kaiming He, Xiangyu Zhang, Shaoqing Ren et al. · 2016 · 222.1K citations · Full text
Martin A. Fischler, Robert C. Bolles · Communications of the ACM · 1981 · 25.5K citations · Full text
YOLO9000: Better, Faster, Stronger
Joseph Redmon, Ali Farhadi · 2017 · 19K citations
Object recognition from local scale-invariant features
David Lowe · 1999 · 16.2K citations