Topics in Cognitive Science · 2015 · 18 citations · 12 references
Social SciencesBehavioral SciencesPsychologyAnimal BehaviorEnvironmental ChangeExperimental PsychologyAdaptive BehaviorBehavior ChangeBehavioral ChangeCounterfactual ReasoningLearning In AnimalsReinforcement LearningAdaptive CognitionCounterfactual LearningLearning In Decision-makingReinforcement Learning Models
Animals routinely adapt to changes in the environment in order to survive. Though reinforcement learning may play a role in such adaptation, it is not clear that it is the only mechanism involved, as it is not well suited to producing rapid, relatively immediate changes in strategies in response to environmental changes. This research proposes that counterfactual reasoning might be an additional mechanism that facilitates change detection. An experiment is conducted in which a task state changes over time and the participants had to detect the changes in order to perform well and gain monetary rewards. A cognitive model is constructed that incorporates reinforcement learning with counterfactual reasoning to help quickly adjust the utility of task strategies in response to changes. The results show that the model can accurately explain human data and that counterfactual reasoning is key to reproducing the various effects observed in this change detection paradigm.
12
An Integrated Theory of the Mind.
John R. Anderson, Daniel Bothell, Michael D. Byrne et al. · Psychological Review · 2004 · 2.9K citations
Learning the value of information in an uncertain world
Timothy E.J. Behrens, Mark W. Woolrich, Mark E. Walton et al. · Nature Neuroscience · 2007 · 2.2K citations
Variance and the Value of Information
David W. Stephens · The American Naturalist · 1989 · 1.1K citations