Neuron · 2010 · 419 citations · 54 references
Life SciencesNeurobiologyNeuroscienceAnimal BehaviorBehavioral NeuroscienceDecision TheoryAnimal Decision-makingChoice BehaviorDecision-making CircuitsLearning In AnimalsReinforcement LearningReward PathwaysCausal RepresentationCausal ResponsibilityLearning In Decision-makingMulti-armed Bandit ExperimentsNeural Correlates Of Choice
Orbitofrontal cortex (OFC) is widely held to be critical for flexibility in decision-making when established choice values change. OFC's role in such decision making was investigated in macaques performing dynamically changing three-armed bandit tasks. After selective OFC lesions, animals were impaired at discovering the identity of the highest value stimulus following reversals. However, this was not caused either by diminished behavioral flexibility or by insensitivity to reinforcement changes, but instead by paradoxical increases in switching between all stimuli. This pattern of choice behavior could be explained by a causal role for OFC in appropriate contingent learning, the process by which causal responsibility for a particular reward is assigned to a particular choice. After OFC lesions, animals' choice behavior no longer reflected the history of precise conjoint relationships between particular choices and particular rewards. Nonetheless, OFC-lesioned animals could still approximate choice-outcome associations using a recency-weighted history of choices and rewards.
54
Reinforcement Learning: An Introduction
Richard S. Sutton, Andy Barto · IEEE Transactions on Neural Networks · 1998 · 27.1K citations
Reinforcement Learning: An Introduction
IEEE Transactions on Neural Networks · 2005 · 25.8K citations
Learning the value of information in an uncertain world
Timothy E.J. Behrens, Mark W. Woolrich, Mark E. Walton et al. · Nature Neuroscience · 2007 · 2.2K citations