Philosophical Transactions of the Royal Society B Biological Sciences · 2007 · 462 citations · 78 references
Life SciencesBehavioral SciencesNeuroscienceCognitive NeuroscienceComputational NeuroscienceMotor ControlBasal GangliaCognitive ControlCognitive ModelingExecutive FunctionFrontal Lobe FunctionsWorking MemoryBasal Ganglia FunctionBasal Ganglia Motor CircuitsBasal Ganglia Motor ControlComputational Neuroscience ModelsExecutive Function ModelsPrefrontal Cortex FunctionPrefrontal Cortex InvolvementTrial-to-trial Learning
The prefrontal cortex (PFC) has long been thought to serve as an 'executive' that controls the selection of actions and cognitive functions more generally. However, the mechanistic basis of this executive function has not been clearly specified often amounting to a homunculus. This paper reviews recent attempts to deconstruct this homunculus by elucidating the precise computational and neural mechanisms underlying the executive functions of the PFC. The overall approach builds upon existing mechanistic models of the basal ganglia (BG) and frontal systems known to play a critical role in motor control and action selection, where the BG provide a 'Go' versus 'NoGo' modulation of frontal action representations. In our model, the BG modulate working memory representations in prefrontal areas to support more abstract executive functions. We have developed a computational model of this system that is capable of developing human-like performance on working memory and executive control tasks through trial-and-error learning. This learning is based on reinforcement learning mechanisms associated with the midbrain dopaminergic system and its activation via the BG and amygdala. Finally, we briefly describe various empirical tests of this framework.
78
Reinforcement Learning: An Introduction
Richard S. Sutton, Andy Barto · IEEE Transactions on Neural Networks · 1998 · 27.1K citations
Reinforcement Learning: An Introduction
IEEE Transactions on Neural Networks · 2005 · 25.8K citations
Advances in neural information processing systems 7
Computers & Mathematics with Applications · 1996 · 14.4K citations