Science Advances · 2021 · 23 citations · 38 references
Life SciencesNeurosciencePsychologyBehavioral NeuroscienceBiological PsychologyCognitive NeuroscienceBasal GangliaBehavioral InhibitionDopaminergic SignalingReward PathwaysReward ProcessingDopaminergic ModulationDopaminergic NeuronsDopaminergic PathwaysDopaminergic Reward CircuitryMesolimbic Reward PathwayNeural Basis Of BehaviorStriatal FunctionStriatal Reward Processing
Balancing instant gratification versus delayed but better gratification is important for optimizing survival and reproductive success. Although delayed gratification has been studied through human psychological and brain activity monitoring and animal research, little is known about its neural basis. We successfully trained mice to perform a waiting-for-water-reward delayed gratification task and used these animals in physiological recording and optical manipulation of neuronal activity during the task to explore its neural basis. Our results showed that the activity of dopaminergic (DAergic) neurons in the ventral tegmental area increases steadily during the waiting period. Optical activation or silencing of these neurons, respectively, extends or reduces the duration of waiting. To interpret these data, we developed a reinforcement learning model that reproduces our experimental observations. Steady increases in DAergic activity signal the value of waiting and support the hypothesis that delayed gratification involves real-time deliberation.
38
Ultrasensitive fluorescent proteins for imaging neuronal activity
Tsai‐Wen Chen, Trevor J. Wardill, Yi Sun et al. · Nature · 2013 · 7.1K citations · Full text
On-line Q-learning Using Connectionist Systems
G. A. Rummery · 1994 · 1.5K citations
Computing, Educational Technology, Artificial Intelligence +7
Neuron-type-specific signals for reward and punishment in the ventral tegmental area
Jeremiah Y. Cohen, Sebastian Haesler, Linh Vong et al. · Nature · 2012 · 1.4K citations · Full text
Phasic Firing in Dopaminergic Neurons Is Sufficient for Behavioral Conditioning
Hsing-Chen Tsai, Feng Zhang, Antoine Adamantidis et al. · Science · 2009 · 1.3K citations · Full text