bioRxiv (Cold Spring Harbor Laboratory) · 2020 · 25 citations · 111 references
Life SciencesNeuroscienceSpatial PlanningBehavioral NeurosciencePath PlanningSpatial ModelingCognitive ModelingDecision-making ModelsNavigation LearningNavigation PlanningSpatial CognitionSpatial NavigationDecision Making For NavigationGoal-driven NavigationMap-based PlanningMaze SolvingModel-based Motion PlanningNavigation DecisionsNavigation In HumansPredictive Navigation
Summary Much of our understanding of navigation comes from the study of individual species, often with specific tasks tailored to those species. Here, we provide a novel experimental and analytic framework, integrating across humans, rats and simulated reinforcement learning (RL) agents to interrogate the dynamics of behaviour during spatial navigation. We developed a novel open-field navigation task (ʻTartarus Maze’) requiring dynamic adaptation (shortcuts and detours) to frequently changing obstructions in the path to a hidden goal. Humans and rats were remarkably similar in their trajectories. Both species showed the greatest similarity to RL agents utilising a ʻsuccessor representation’, which creates a predictive map. Humans also displayed trajectory features similar to model-based RL agents, which implemented an optimal tree-search planning procedure. Our results help refine models seeking to explain mammalian navigation in dynamic environments, and highlight the utility of modelling the behaviour of different species to uncover the shared mechanisms that support behaviour.
111
Human-level control through deep reinforcement learning
Volodymyr Mnih, Koray Kavukcuoglu, David Silver et al. · Nature · 2015 · 30K citations
Reinforcement Learning: An Introduction
IEEE Transactions on Neural Networks · 2005 · 25.8K citations
Mastering the game of Go with deep neural networks and tree search
David Silver, Aja Huang, Chris J. Maddison et al. · Nature · 2016 · 15.8K citations
Mastering the game of Go without human knowledge
David Silver, Julian Schrittwieser, Karen Simonyan et al. · Nature · 2017 · 9.2K citations
Engineering, Educational Psychology, Cognitive Psychology +7