2023 · 21 citations · 35 references
ComputingComputer ScienceComputer VisionHuman BehaviorMotor DevelopmentAction RecognitionMotion AnalysisMotion EstimationPostureAction DetectionAction Pose EstimationAction SegmentationAction SequenceActivity RecognitionBenchmark DatasetsEarly Action RecognitionVideo Action Recognition
Automatic detection of infant actions from home videos could aid medical and behavioral specialists in the early detection of motor impairments in infancy. However, most computer vision approaches for action recognition are centered around adult subjects, following datasets and benchmarks in the field. In this work, we present a data-efficient pipeline for infant action recognition based on the idea of modeling an action as a time sequence consisting of two different stable postures with a transition period between them. The postures are detected frame-wise from the estimated 2D and 3D infant body poses and the action sequence is segmented based on the posture-driven low-dimensional features of each frame. To spur further research in the field, we also created and release the first-of-its-kind infant action dataset—InfAct—consisting of 200 fully annotated home videos representing a wide range of common infant actions, intended as a public benchmark. Among the ten more common classes of infant actions, our action recognition model achieved 78.0% accuracy when tested on InfAct, highlighting the promise of video-based infant action recognition as a viable monitoring tool for infant motor development <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">1</sup> .
35
Learning realistic human actions from movies
Ivan Laptev, Marcin Marszałek, Cordelia Schmid et al. · 2008 · 3.5K citations · Full text
NTU RGB+D: A Large Scale Dataset for 3D Human Activity Analysis
Amir Shahroudy, Jun Liu, Tian-Tsong Ng et al. · 2016 · 2.9K citations
2D Human Pose Estimation: New Benchmark and State of the Art Analysis
Mykhaylo Andriluka, Leonid Pishchulin, Peter Gehler et al. · 2014 · 2.8K citations
EM Algorithms for PCA and SPCA
Sam T. Roweis · 1997 · 737 citations
Rizwan Chaudhry, Avinash Ravichandran, Gregory D. Hager et al. · 2009 IEEE Conference on Computer Vision and Pattern Recognition · 2009 · 617 citations