Cerebral Cortex · 2017 · 36 citations · 40 references
Life SciencesNeurosciencePsychologyBehavioral NeuroscienceCognitive NeuroscienceCognitive PsychologyBasal GangliaDecision-making ModelsError-based LearningNeural Basis Of LearningReinforcement LearningReward ProcessingFunctional Magnetic Resonance ImagingFunctional Magnetic Resonance Imaging CorrelatesReinforcement Learning ModelsReward FeedbackStriatal FunctionStriatal PhysiologyStriatal Reward ProcessingSurprise Effects
Humans naturally group the world into coherent categories defined by membership rules. Rules can be learned implicitly by building stimulus-response associations using reinforcement learning or by using explicit reasoning. We tested if the striatum, in which activation reliably scales with reward prediction error, would track prediction errors in a task that required explicit rule generation. Using functional magnetic resonance imaging during a categorization task, we show that striatal responses to feedback scale with a "surprise" signal derived from a Bayesian rule-learning model and are inconsistent with RL prediction error. We also find that striatum and caudal inferior frontal sulcus (cIFS) are involved in updating the likelihood of discriminative rules. We conclude that the striatum, in cooperation with the cIFS, is involved in updating the values assigned to categorization rules when people learn using explicit reasoning.
40
Reinforcement Learning: An Introduction
Richard S. Sutton, Andy Barto · IEEE Transactions on Neural Networks · 1998 · 27.1K citations
Model-Based Influences on Humans' Choices and Striatal Prediction Errors
Nathaniel D. Daw, Samuel J. Gershman, Ben Seymour et al. · Neuron · 2011 · 1.9K citations · Full text