2019 · 33 citations · 41 references
Social SciencesBehavioral SciencesPsychologyCognitive PsychologyExperimental PsychologyPhilosophy Of ScienceExploration-exploitation TradeoffRational ChoiceCausal StructureCausal Structure AnalysisComplexityCuriosity-driven ExplorationCuriosity-driven LearningLearning From ExplorationLearning Under UncertaintyRational Agents
Curiosity is central to science and cognition, yet theories diverge: novelty-based accounts link it to highly uncertain stimuli, while complexity-based accounts associate it with intermediate uncertainty. The study aims to determine what drives curiosity by offering a rational analysis that unifies novelty- and complexity-based accounts within a common computational framework. The authors model curiosity as a rational agent’s drive to explore stimuli that maximally increase knowledge usefulness, treating curiosity as the mechanism approximating this rational behavior. The analysis reveals that environmental causal structure dictates whether curiosity is triggered by high or moderate uncertainty, unifying prior theories as special cases, and experimental data confirm the model’s predictions, explaining the subjectivity and malleability of human curiosity.
Curiosity is considered to be the essence of science and an integral component of cognition. What prompts curiosity in a learner? Previous theoretical accounts of curiosity remain divided – novelty-based theories propose that new and highly uncertain stimuli pique curiosity whereas complexity-based theories propose that stimuli with an intermediate degree of uncertainty stimulate curiosity. In this article, we present a rational analysis of curiosity by considering the computational problem underlying curiosity, which allows us to model these distinct accounts of curiosity in a common framework. Our approach posits that a rational agent should explore stimuli that maximally increase the usefulness of its knowledge and that curiosity is the mechanism by which humans approximate this rational behavior. Critically, our analysis shows that the causal structure of the environment can determine whether curiosity is driven by either highly uncertain or moderately uncertain stimuli. This suggests that previous theories need not be in contention but are special cases of a more general account of curiosity. Experimental results confirm our predictions and demonstrate that our theory explains a wide range of findings about human curiosity, including its subjectivity and malleability.
41
Cortical substrates for exploratory decisions in humans
Nathaniel D. Daw, John P. O’Doherty, Peter Dayan et al. · Nature · 2006 · 2.3K citations · Full text
Ronald A. Howard · IEEE Transactions on Systems Science and Cybernetics · 1966 · 1K citations