Journal of Neuroscience · 2010 · 108 citations · 93 references
Life SciencesNeurobiologyNeuroscienceAnimal BehaviorBehavioral NeuroscienceSystems NeuroscienceLearning In Neural SystemsNeural CodingOlfactory NeuroscienceReward PathwaysReward ProcessingAssociative ProcessingLocal Field PotentialsNeural Basis Of BehaviorNeural Signal EncodingOlfactory Temporal CodingOscillatory Phase LockingPhase LockingTheta Oscillations
The expectancy of a rewarding outcome following actions and cues is coded by a network of brain structures including the orbitofrontal cortex. Thus far, predicted reward was considered to be coded by time-averaged spike rates of neurons. However, besides firing rate, the precise timing of action potentials in relation to ongoing oscillations in local field potentials is thought to be of importance for effective communication between brain areas. We performed multineuron and field potential recordings in orbitofrontal cortex of rats performing olfactory discrimination learning to study the temporal structure of coding predictive of outcome. After associative learning, field potentials were marked by theta oscillations, both in advance and during delivery of reward. Orbitofrontal neurons, especially those coding information about upcoming reward with their firing rate, phase locked to these oscillations in anticipation of reward. When established associations were reversed, phase locking collapsed in the anticipatory task phase, but returned when reward became predictable again after relearning. Behaviorally, the outcome anticipation phase was marked by licking responses, but the frequency of lick responses was dissociated from the strength of theta-band phase locking. The strength of theta-band phase locking by orbitofrontal neurons robustly follows the dynamics of associative learning as measured by behavior and correlates with the rat's current outcome expectancy. Theta-band phase locking may facilitate communication of outcome-related information between reward-related brain areas and offers a novel mechanism for coding value signals during reinforcement learning.
93
Reinforcement Learning: An Introduction
IEEE Transactions on Neural Networks · 2005 · 25.8K citations
Insensitivity to future consequences following damage to human prefrontal cortex
Antoine Bechara, António R. Damásio, Hanna Damásio et al. · Cognition · 1994 · 6.1K citations
Regulation of Synaptic Efficacy by Coincidence of Postsynaptic APs and EPSPs
Henry Markram, Joachim Lübke, Michael Frotscher et al. · Science · 1997 · 3.9K citations · Full text
Andrew G. Barto · IFAC Proceedings Volumes · 1998 · 3K citations