bioRxiv (Cold Spring Harbor Laboratory) · 2019 · 17 citations · 50 references
Life SciencesNeurobiologyNeuroscienceBehavioral NeuroscienceMolecular NeuroscienceSignal TransductionDopaminergic SignalingNeural Basis Of LearningNeurotransmissionReward PathwaysReward ProcessingSynaptic TransmissionFiber PhotometryFluorescence LifetimeFluorescence Lifetime ImagingFluorescence Lifetime MeasurementsPhotometryProjection NeuronsReward Prediction Error SignalingSpiny Projection Neuron Physiology
Summary Canonical reinforcement learning models postulate that dopamine neurons encode reward prediction error (RPE) and provide a teaching signal to striatal spiny projection neurons (SPNs) in the form of dopamine (DA) release. DA is thought to guide learning via dynamic modulation of protein kinase A (PKA) in SPNs. However, this fundamental assumption remains untested in behaving animals. Here we utilized multi-channel fiber photometry and fluorescence lifetime photometry (FLiP) to monitor the activity of DA neurons, extracellular DA levels, and net PKA activity in SPNs in the nucleus accumbens during learning. We found dynamic encoding of RPE in the activity of DA neurons, which is both necessary and sufficient to explain striatal DA levels and SPN PKA activity. The modulation of PKA in SPNs that express type-1 (D1R-SPNs) and type-2 (D2R-SPNs) DA receptors was dichotomous such that in each cell class it is selectively sensitive to increases and decreases in DA, respectively, and occur at and support different phases of learning. Thus, PKA-dependent pathways in D1R- and D2R-SPNs are asynchronously engaged by RPE-encoding DA signals to promote different aspects of reinforcement learning: the former responsible for the initial association between action and outcome and the latter responsible for refining the learned association.
50
Ultrasensitive fluorescent proteins for imaging neuronal activity
Tsai‐Wen Chen, Trevor J. Wardill, Yi Sun et al. · Nature · 2013 · 7.1K citations · Full text
Neuron-type-specific signals for reward and punishment in the ventral tegmental area
Jeremiah Y. Cohen, Sebastian Haesler, Linh Vong et al. · Nature · 2012 · 1.4K citations · Full text
Phasic Firing in Dopaminergic Neurons Is Sufficient for Behavioral Conditioning
Hsing-Chen Tsai, Feng Zhang, Antoine Adamantidis et al. · Science · 2009 · 1.3K citations · Full text
RETRACTED: A mathematical model explains saturating axon guidance responses to molecular gradients
Huyen Nguyen, Peter Dayan, Zac Pujic et al. · eLife · 2016 · 1.3K citations · Full text
Dichotomous Dopaminergic Control of Striatal Synaptic Plasticity
Weixing Shen, Marc Flajolet, Paul Greengard et al. · Science · 2008 · 1.2K citations · Full text