arXiv (Cornell University) · 2022 · 22 citations · 0 references
ComputingComputer ScienceRobotics EngineeringComputer VisionMachine VisionRobot Vision3D ReconstructionAugmented RealityMotion CapturePose EstimationTracking SystemsVirtual Reality3D Pose EstimationBody Pose EstimationFitness TrackingFull-body Motion CaptureFull-body TrackingGround Truth Data CollectionHuman Pose EstimationOn-device Inference
We present BlazePose GHUM Holistic, a lightweight neural network pipeline for 3D human body landmarks and pose estimation, specifically tailored to real-time on-device inference. BlazePose GHUM Holistic enables motion capture from a single RGB image including avatar control, fitness tracking and AR/VR effects. Our main contributions include i) a novel method for 3D ground truth data acquisition, ii) updated 3D body tracking with additional hand landmarks and iii) full body pose estimation from a monocular image.