Science · 2004 · 2.2K citations · 17 references
Life SciencesNeurosciencePsychologyAffective NeuroscienceBehavioral NeuroscienceCognitive NeuroscienceClassical ConditioningDecision-making ModelsOperant ConditioningReinforcement LearningReward PathwaysReward ProcessingDorsal Striatum OrganizationFunctional Magnetic Resonance ImagingMesolimbic Reward PathwayReinforcement Learning ModelsStriatal FunctionStriatal PhysiologyStriatal Reward ProcessingVentral Striatum Organization
Instrumental conditioning studies how animals and humans choose actions appropriate to the affective structure of an environment. According to recent reinforcement learning models, two distinct components are involved: a "critic," which learns to predict future reward, and an "actor," which maintains information about the rewarding outcomes of actions to enable better ones to be chosen more frequently. We scanned human participants with functional magnetic resonance imaging while they engaged in instrumental conditioning. Our results suggest partly dissociable contributions of the ventral and dorsal striatum, with the former corresponding to the critic and the latter corresponding to the actor.
17
Andrew G. Barto · IFAC Proceedings Volumes · 1998 · 3K citations
Temporal Difference Models and Reward-Related Learning in the Human Brain
John P. O’Doherty, Peter Dayan, Karl Friston et al. · Neuron · 2003 · 1.5K citations · Full text
Conditioning and Associative Learning
Winfred F. Hill, N. J. Mackintosh · The American Journal of Psychology · 1984 · 1.3K citations
Dissociation of reward anticipation and outcome with event-related fMRI
Brian Knutson, Grace Fong, Charles M. Adams et al. · Neuroreport · 2001 · 1.3K citations