Current Opinion in Behavioral Sciences · 2021 · 85 citations · 68 references
Life SciencesNeurosciencePsychologyBehavioral NeuroscienceCognitive NeuroscienceCognitive PsychologyCognitive ModelingDecision Under UncertaintyDecision-making ModelsDecision-making Under UncertaintyInformation ProcessingNeurocognitive FunctionCognitive Process AnalysisComputational PrecisionHuman IntelligenceLearning In Decision-makingLearning Under UncertaintyNeural Circuit FunctionNeural Noise ModelingUncertainty Processing
Making sense of uncertain and volatile environments, a cognitive process modeled across domains as statistical inference, constitutes a difficult yet ubiquitous challenge for human intelligence. Beside sensory errors and exploratory choices, recent research has identified the limited computational precision of cognitive inference as a surprisingly large contributor to the variability and suboptimality of perceptual and reward-guided decisions made under uncertainty. This focused review discusses the theoretical and experimental evidence scattered across psychology and neuroscience which, taken together, provides key insights into the origin, impact and function of this ‘computation noise’ for learning and decision-making. Moving beyond the classical description of internal noise as performance-limiting constraint on neural function and cognition, we outline the possible emergent benefits of computation noise for adaptive behavior in adverse conditions and highlight open questions for future research.
68
Reinforcement Learning: An Introduction
Richard S. Sutton, Andy Barto · IEEE Transactions on Neural Networks · 1998 · 27.1K citations
Reinforcement Learning: An Introduction
IEEE Transactions on Neural Networks · 2005 · 25.8K citations
Cortical substrates for exploratory decisions in humans
Nathaniel D. Daw, John P. O’Doherty, Peter Dayan et al. · Nature · 2006 · 2.3K citations · Full text
Learning the value of information in an uncertain world
Timothy E.J. Behrens, Mark W. Woolrich, Mark E. Walton et al. · Nature Neuroscience · 2007 · 2.2K citations
Context-dependent computation by recurrent dynamics in prefrontal cortex
Valerio Mante, David Sussillo, Krishna V. Shenoy et al. · Nature · 2013 · 2.1K citations