Scientific Reports · 2016 · 20 citations · 27 references
Life SciencesNeurobiologyNeuroscienceBehavioral NeurobiologyBehavioral NeuroscienceMemoryChoice BehaviorDecision-making CircuitsDecision-making ModelsMemory In AnimalsReward PathwaysReward ProcessingAction Value RepresentationBrain OrganizationCredit AssignmentNeural Correlates Of ChoiceStriatal FunctionStriatal PhysiologyStriatal Reward ProcessingValue-based Action Selection
To investigate neural processes underlying temporal credit assignment in the striatum, we recorded neuronal activity in the dorsomedial and dorsolateral striatum (DMS and DLS, respectively) of rats performing a dynamic foraging task in which a choice has to be remembered until its outcome is revealed for correct credit assignment. Choice signals appeared sequentially, initially in the DMS and then in the DLS, and they were combined with action value and reward signals in the DLS when choice outcome was revealed. Unlike in conventional dynamic foraging tasks, neural signals for chosen value were elevated in neither brain structure. These results suggest that dynamics of striatal neural signals related to evaluating choice outcome might differ drastically depending on the requirement for temporal credit assignment. In a behavioral context requiring temporal credit assignment, the DLS, but not the DMS, might be in charge of updating the value of chosen action by integrating choice, action value, and reward signals together.
27
Reinforcement Learning: An Introduction
Richard S. Sutton, Andy Barto · IEEE Transactions on Neural Networks · 1998 · 27.1K citations
Reinforcement Learning: An Introduction
IEEE Transactions on Neural Networks · 2005 · 25.8K citations
Prediction of immediate and future rewards differentially recruits cortico-basal ganglia loops
Saori Tanaka, Kenji Doya, Go Okada et al. · Nature Neuroscience · 2004 · 793 citations