Nature Communications · 2011 · 74 citations · 21 references
BusinessBehavioral SciencesPsychologyDecision TheoryMarkov Decision ProcessesSport PsychologyAthletic PerformanceLearning From DemonstrationLearning In ExperimentsReinforcement LearningReinforcement Learning FoundationsPlay GeneralizationPlayer Motivation
Reinforcement learning in complex natural environments is a challenging task because the agent should generalize from the outcomes of actions taken in one state of the world to future actions in different states of the world. The extent to which human experts find the proper level of generalization is unclear. Here we show, using the sequences of field goal attempts made by professional basketball players, that the outcome of even a single field goal attempt has a considerable effect on the rate of subsequent 3 point shot attempts, in line with standard models of reinforcement learning. However, this change in behaviour is associated with negative correlations between the outcomes of successive field goal attempts. These results indicate that despite years of experience and high motivation, professional players overgeneralize from the outcomes of their most recent actions, which leads to decreased performance. Reinforcement learning quantifies the change in behaviour in response to past experience. Using field goal attempt data from basketball, Neiman and Loewenstein demonstrate that even one failed or made attempt has an impact on subsequent attempts, showing that players overgeneralize from their most recent actions.
21
Reinforcement Learning: An Introduction
Richard S. Sutton, Andy Barto · IEEE Transactions on Neural Networks · 1998 · 27.1K citations
Reinforcement Learning: An Introduction
IEEE Transactions on Neural Networks · 2005 · 25.8K citations
Cortical substrates for exploratory decisions in humans
Nathaniel D. Daw, John P. O’Doherty, Peter Dayan et al. · Nature · 2006 · 2.3K citations · Full text
Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning
John P. O’Doherty, Peter Dayan, Johannes Schultz et al. · Science · 2004 · 2.2K citations · Full text