Journal of Abnormal Psychology · 2015 · 26 citations · 36 references
MedicinePsychiatryPsychologyBiological PsychologyMarkov Decision ProcessesNeuropsychiatryCognitive ModelingDecision-making ModelsLearning In Neural SystemsReinforcement LearningReinforcement Learning FoundationsReward ProcessingAction Selection ModelsNeurocognitive DeficitsPsychosis PredictionQ-learningReinforcement Learning ModelsReward-based Decision MakingReward-based LearningTrial-by-trial Learning
There is increasing evidence that schizophrenia (SZ) and bipolar disorder (BD) share a number of cognitive, neurobiological, and genetic markers. Shared features may be most prevalent among SZ and BD with a history of psychosis. This study extended this literature by examining reinforcement learning (RL) performance in individuals with SZ (n = 29), BD with a history of psychosis (BD+; n = 24), BD without a history of psychosis (BD-; n = 23), and healthy controls (HC; n = 24). RL was assessed through a probabilistic stimulus selection task with acquisition and test phases. Computational modeling evaluated competing accounts of the data. Each participant's trial-by-trial decision-making behavior was fit to 3 computational models of RL: (a) a standard actor-critic model simulating pure basal ganglia-dependent learning, (b) a pure Q-learning model simulating action selection as a function of learned expected reward value, and (c) a hybrid model where an actor-critic is "augmented" by a Q-learning component, meant to capture the top-down influence of orbitofrontal cortex value representations on the striatum. The SZ group demonstrated greater reinforcement learning impairments at acquisition and test phases than the BD+, BD-, and HC groups. The BD+ and BD- groups displayed comparable performance at acquisition and test phases. Collapsing across diagnostic categories, greater severity of current psychosis was associated with poorer acquisition of the most rewarding stimuli as well as poor go/no-go learning at test. Model fits revealed that reinforcement learning in SZ was best characterized by a pure actor-critic model where learning is driven by prediction error signaling alone. In contrast, BD-, BD+, and HC were best fit by a hybrid model where prediction errors are influenced by top-down expected value representations that guide decision making. These findings suggest that abnormalities in the reward system are more prominent in SZ than BD; however, current psychotic symptoms may be associated with reinforcement learning deficits regardless of a Diagnostic and Statistical Manual of Mental Disorders (5th Edition; American Psychiatric Association, 2013) diagnosis.
36
Reinforcement Learning: An Introduction
IEEE Transactions on Neural Networks · 2005 · 25.8K citations
Andrew G. Barto · IFAC Proceedings Volumes · 1998 · 3K citations
Disrupted prediction-error signal in psychosis: evidence for an associative account of delusions
Philip R. Corlett, Graham K. Murray, G.D. Honey et al. · Brain · 2007 · 454 citations · Full text
Negative Symptoms of Schizophrenia Are Associated with Abnormal Effort-Cost Computations
James M. Gold, Gregory P. Strauss, James A. Waltz et al. · Biological Psychiatry · 2013 · 426 citations · Full text
Medicine, Psychiatry, Psychology +11