PLoS Computational Biology · 2014 · 232 citations · 44 references
Social SciencesEconomicsPsychologyBehavioral EconomicsDecision TheoryExperimental EconomicsBayesian Decision TheoryBayesian GamesBayesian InferenceBayesian LearningBehavioral Decision-makingReinforcement LearningBayesian Game TheoryHierarchical Reinforcement LearningLottery ChoiceLottery Choice BehaviorMisleading InformationReinforcement Learning In GamesReinforcement ProcessesTrial-by-trial Learning
Inferring on others' (potentially time-varying) intentions is a fundamental problem during many social transactions. To investigate the underlying mechanisms, we applied computational modeling to behavioral data from an economic game in which 16 pairs of volunteers (randomly assigned to "player" or "adviser" roles) interacted. The player performed a probabilistic reinforcement learning task, receiving information about a binary lottery from a visual pie chart. The adviser, who received more predictive information, issued an additional recommendation. Critically, the game was structured such that the adviser's incentives to provide helpful or misleading information varied in time. Using a meta-Bayesian modeling framework, we found that the players' behavior was best explained by the deployment of hierarchical learning: they inferred upon the volatility of the advisers' intentions in order to optimize their predictions about the validity of their advice. Beyond learning, volatility estimates also affected the trial-by-trial variability of decisions: participants were more likely to rely on their estimates of advice accuracy for making choices when they believed that the adviser's intentions were presently stable. Finally, our model of the players' inference predicted the players' interpersonal reactivity index (IRI) scores, explicit ratings of the advisers' helpfulness and the advisers' self-reports on their chosen strategy. Overall, our results suggest that humans (i) employ hierarchical generative models to infer on the changing intentions of others, (ii) use volatility estimates to inform decision-making in social interactions, and (iii) integrate estimates of advice accuracy with non-social sources of information. The Bayesian framework presented here can quantify individual differences in these mechanisms from simple behavioral readouts and may prove useful in future clinical studies of maladaptive social cognition.
44
Monte Carlo sampling methods using Markov chains and their applications
W. Keith Hastings · Biometrika · 1970 · 15.2K citations
Robert E. Kass, Adrian E. Raftery · Journal of the American Statistical Association · 1995 · 12.3K citations
Natural Sciences, Behavioral Sciences, Bayesian Biostatistics +11
Risk, Ambiguity, and the Savage Axioms
Daniel Ellsberg · The Quarterly Journal of Economics · 1961 · 7.9K citations
Business, Mathematics, Philosophy +12