bioRxiv (Cold Spring Harbor Laboratory) · 2022 · 15 citations · 42 references
Life SciencesNeurobiologyNeuroscienceBehavioral NeurobiologyBehavioral NeuroscienceCognitive NeuroscienceAnimal Decision-makingDecision-making CircuitsDecision-making ModelsLearning In AnimalsReinforcement LearningReward ProcessingBelief UpdatingCerebral HemispheresChange-point EstimationProbabilistic Reward LearningReward LearningReward-based Decision MakingValue-based Decision MakingValue-based Decision-making
There are often sudden changes in the state of environment. For a decision maker, accurate prediction and detection of change points are crucial for optimizing performance. Still unclear, however, is whether rodents are simply reactive to reinforcements, or if they can be proactive to estimate future change points during value-based decision making. In this study, we characterize head-fixed mice performing a two-armed bandit task with probabilistic reward reversals. Choice behavior deviates from classic reinforcement learning, but instead suggests a strategy involving belief updating, consistent with the anticipation of change points to exploit the task structure. Excitotoxic lesion and optogenetic inactivation implicate the anterior cingulate and premotor regions of medial frontal cortex. Specifically, over-estimation of hazard rate arises from imbalance across frontal hemispheres during the time window before the choice is made. Collectively, the results demonstrate that mice can capitalize on their knowledge of task regularities, and this estimation of future changes in the environment may be a main computational function of the rodent dorsal medial frontal cortex.
42
Learning the value of information in an uncertain world
Timothy E.J. Behrens, Mark W. Woolrich, Mark E. Walton et al. · Nature Neuroscience · 2007 · 2.2K citations
Representation of Action-Specific Reward Values in the Striatum
Kazuyuki Samejima, Yasumasa Ueda, Kenji Doya et al. · Science · 2005 · 975 citations
Mesolimbic dopamine signals the value of work
Arif Hamid, Jeffrey R. Pettibone, Omar S. Mabrouk et al. · Nature Neuroscience · 2015 · 883 citations
Flow of Cortical Activity Underlying a Tactile Decision in Mice
Zengcai V. Guo, Nuo Li, Daniel Huber et al. · Neuron · 2013 · 810 citations · Full text