Proceedings of the National Academy of Sciences · 2010 · 157 citations · 45 references
Life SciencesNeurosciencePsychologyBehavioral NeuroscienceCognitive NeuroscienceCognitive PsychologyDecision-making CircuitsDecision-making ModelsLearning In Neural SystemsReinforcement LearningReward PathwaysReward ProcessingBrain RegionsLearning In Decision-makingPrefrontal Cortex FunctionReinforcement Learning ModelsReward FeedbackReward LearningReward-based LearningVentromedial Prefrontal Cortex
Recent research in neuroeconomics has demonstrated that the reinforcement learning model of reward learning captures the patterns of both behavioral performance and neural responses during a range of economic decision-making tasks. However, this powerful theoretical model has its limits. Trial-and-error is only one of the means by which individuals can learn the value associated with different decision options. Humans have also developed efficient, symbolic means of communication for learning without the necessity for committing multiple errors across trials. In the present study, we observed that instructed knowledge of cue-reward probabilities improves behavioral performance and diminishes reinforcement learning-related blood-oxygen level-dependent (BOLD) responses to feedback in the nucleus accumbens, ventromedial prefrontal cortex, and hippocampal complex. The decrease in BOLD responses in these brain regions to reward-feedback signals was functionally correlated with activation of the dorsolateral prefrontal cortex (DLPFC). These results suggest that when learning action values, participants use the DLPFC to dynamically adjust outcome responses in valuation regions depending on the usefulness of action-outcome information.
45
Reinforcement Learning: An Introduction
Richard S. Sutton, Andy Barto · IEEE Transactions on Neural Networks · 1998 · 27.1K citations
Reinforcement Learning: An Introduction
IEEE Transactions on Neural Networks · 2005 · 25.8K citations
The Neural Basis of Economic Decision-Making in the Ultimatum Game
Alan G. Sanfey, James K. Rilling, Jessica A. Aronson et al. · Science · 2003 · 3.4K citations
Separate Neural Systems Value Immediate and Delayed Monetary Rewards
Samuel M. McClure, David Laibson, George Loewenstein et al. · Science · 2004 · 3.1K citations