eLife · 2018 · 62 citations · 64 references
Life SciencesNeuroscienceBehavioral EconomicsBehavioral NeuroscienceCognitive NeuroscienceBasal GangliaDecision-making CircuitsDecision-making ModelsNeural RepresentationReward ProcessingValue FunctionsAction Value RepresentationBasal Ganglia FunctionStriatal FunctionStriatal Reward Processing
It is generally believed that during economic decisions, striatal neurons represent the values associated with different actions. This hypothesis is based on studies, in which the activity of striatal neurons was measured while the subject was learning to prefer the more rewarding action. Here we show that these publications are subject to at least one of two critical confounds. First, we show that even weak temporal correlations in the neuronal data may result in an erroneous identification of action-value representations. Second, we show that experiments and analyses designed to dissociate action-value representation from the representation of other decision variables cannot do so. We suggest solutions to identifying action-value representation that are not subject to these confounds. Applying one solution to previously identified action-value neurons in the basal ganglia we fail to detect action-value representations. We conclude that the claim that striatal neurons encode action-values must await new experiments and analyses.
64
Reinforcement Learning: An Introduction
Richard S. Sutton, Andy Barto · IEEE Transactions on Neural Networks · 1998 · 27.1K citations
Spurious regressions in econometrics
Clive W. J. Granger, Paul Newbold · Journal of Econometrics · 1974 · 6.2K citations
Temporal Autocorrelation in Univariate Linear Modeling of FMRI Data
Mark W. Woolrich, B. D. Ripley, Michael Brady et al. · NeuroImage · 2001 · 3K citations
Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning
John P. O’Doherty, Peter Dayan, Johannes Schultz et al. · Science · 2004 · 2.2K citations · Full text