Psychological Science · 2014 · 79 citations · 27 references
Public HealthBehavioral SciencesPsychologyDecision TheoryExperimental DesignExperimental PsychologyExploration-exploitation TradeoffOperant ConditioningReinforcement LearningControllabilityExplorationLearning From ExplorationPerceived ControllabilityReinforcement
Exposure to uncontrollable outcomes has been found to trigger learned helplessness, a state in which the agent, because of lack of exploration, fails to take advantage of regained control. Although the implications of this phenomenon have been widely studied, its underlying cause remains undetermined. One can learn not to explore because the environment is uncontrollable, because the average reinforcement for exploring is low, or because rewards for exploring are rare. In the current research, we tested a simple experimental paradigm that contrasts the predictions of these three contributors and offers a unified psychological mechanism that underlies the observed phenomena. Our results demonstrate that learned helplessness is not correlated with either the perceived controllability of one's environment or the average reward, which suggests that reward prevalence is a better predictor of exploratory behavior than the other two factors. A simple computational model in which exploration decisions were based on small samples of past experiences captured the empirical phenomena while also providing a cognitive basis for feelings of uncontrollability.
27
Journal of social behavior and personality
Personality and Individual Differences · 1986 · 6.8K citations
Decisions from Experience and the Effect of Rare Events in Risky Choice
Ralph Hertwig, Greg Barron, Elke U. Weber et al. · Psychological Science · 2004 · 1.7K citations · Full text