Cell Reports · 2021 · 301 citations · 92 references
ComputingComputer ScienceZoologyAnimal BehaviorComputer VisionRoboticsAnimal TrackingLocomotion AnalysisMotion AnalysisMotion EstimationPose EstimationVisual Tracking3D Pose EstimationAnimal Motion CaptureAnimal Pose EstimationLeg DynamicsLeg KinematicsMarkerless CalibrationRegularizationRobust Triangulation
Quantifying movement is critical for understanding animal behavior, and recent computer‑vision advances enable markerless 2D tracking, though most animals move in 3D. The authors introduce Anipose, an open‑source toolkit for robust markerless 3D pose estimation. Anipose builds on DeepLabCut, providing a 3D calibration module, error‑resolving filters, a triangulation module with temporal and spatial regularization, and a pipeline for large‑scale video processing, along with tutorials and documentation. Anipose was validated on a calibration board and on mice, flies, and humans, and its 3D leg‑kinematics analysis revealed a key role for joint rotation in fly walking motor control.
Quantifying movement is critical for understanding animal behavior. Advances in computer vision now enable markerless tracking from 2D video, but most animals move in 3D. Here, we introduce Anipose, an open-source toolkit for robust markerless 3D pose estimation. Anipose is built on the 2D tracking method DeepLabCut, so users can expand their existing experimental setups to obtain accurate 3D tracking. It consists of four components: (1) a 3D calibration module, (2) filters to resolve 2D tracking errors, (3) a triangulation module that integrates temporal and spatial regularization, and (4) a pipeline to structure processing of large numbers of videos. We evaluate Anipose on a calibration board as well as mice, flies, and humans. By analyzing 3D leg kinematics tracked with Anipose, we identify a key role for joint rotation in motor control of fly walking. To help users get started with 3D tracking, we provide tutorials and documentation at http://anipose.org/.
92
Deep Residual Learning for Image Recognition
Kaiming He, Xiangyu Zhang, Shaoqing Ren et al. · 2016 · 222.1K citations · Full text
Adam: A Method for Stochastic Optimization
Diederik P. Kingma, Jimmy Ba · UvA-DARE (University of Amsterdam) · 2014 · 84.8K citations · Full text
Fiji: an open-source platform for biological-image analysis
Johannes Schindelin, Ignacio Arganda‐Carreras, Erwin Frise et al. · Nature Methods · 2012 · 70.9K citations
Scikit-learn: Machine Learning in Python
Fabián Pedregosa, Gaël Varoquaux, Alexandre Gramfort et al. · arXiv (Cornell University) · 2012 · 63.7K citations · Full text
SciPy 1.0: fundamental algorithms for scientific computing in Python
Nature Methods · 2020 · 37.9K citations · Full text