Nature · 2025 · 28 citations · 41 references
Life SciencesBiologyEntomologyBiomechanicsMotor ControlRoboticsFlight SimulationLocomotion BiomechanicsLocomotion ControlLocomotor BehaviorLocomotor ControlMotor System ModelingAdhesion ForcesAerial LocomotionDrosophila ModelsFlightFlight BiomechanicsLocomotionPhenomenological ModelsVisual Flight Guidance
Abstract The body of an animal influences how its nervous system generates behaviour 1 . Accurately modelling the neural control of sensorimotor behaviour requires an anatomically detailed biomechanical representation of the body. Here we introduce a whole-body model of the fruit fly Drosophila melanogaster in a physics simulator 2 . Designed as a general-purpose framework, our model enables the simulation of diverse fly behaviours, including both terrestrial and aerial locomotion. We validate its versatility by replicating realistic walking and flight behaviours. To support these behaviours, we develop phenomenological models for fluid and adhesion forces. Using data-driven, end-to-end reinforcement learning 3,4 , we train neural network controllers capable of generating naturalistic locomotion 5–7 along complex trajectories in response to high-level steering commands. Furthermore, we show the use of visual sensors and hierarchical motor control 8 , training a high-level controller to reuse a pretrained low-level flight controller to perform visually guided flight tasks. Our model serves as an open-source platform for studying the neural control of sensorimotor behaviour in an embodied context.
41
Fiji: an open-source platform for biological-image analysis
Johannes Schindelin, Ignacio Arganda‐Carreras, Erwin Frise et al. · Nature Methods · 2012 · 70.9K citations
MuJoCo: A physics engine for model-based control
Emanuel Todorov, Tom Erez, Yuval Tassa · 2012 · 4.4K citations
Engineering, Mechanical Engineering, Robotics Engineering +17
SLEAP: A deep learning system for multi-animal pose tracking
Talmo Pereira, Nathaniel Tabris, Arie Matsliah et al. · Nature Methods · 2022 · 904 citations · Full text
High-throughput ethomics in large groups of Drosophila
Kristin Branson, Alice A. Robie, John A. Bender et al. · Nature Methods · 2009 · 860 citations · Full text