Psychological Review · 2014 · 114 citations · 58 references
Social SciencesBehavioral SciencesPsychologyCognitive PsychologyExperimental PsychologyProbability TheoryBayesian InferenceBayesian StatisticsCognitive ModelingPerceived ProbabilityPsychophysicsStatistical InferenceBayesian UpdatingFrequency-probability MappingJoint Distribution EstimationProbability PerceptionPsychometric Function EstimationPsychometric Function FittingPsychometric Function Modeling
We present a computational model to explain the results from experiments in which subjects estimate the hidden probability parameter of a stepwise nonstationary Bernoulli process outcome by outcome. The model captures the following results qualitatively and quantitatively, with only 2 free parameters: (a) Subjects do not update their estimate after each outcome; they step from one estimate to another at irregular intervals. (b) The joint distribution of step widths and heights cannot be explained on the assumption that a threshold amount of change must be exceeded in order for them to indicate a change in their perception. (c) The mapping of observed probability to the median perceived probability is the identity function over the full range of probabilities. (d) Precision (how close estimates are to the best possible estimate) is good and constant over the full range. (e) Subjects quickly detect substantial changes in the hidden probability parameter. (f) The perceived probability sometimes changes dramatically from one observation to the next. (g) Subjects sometimes have second thoughts about a previous change perception, after observing further outcomes. (h) The frequency with which they perceive changes moves in the direction of the true frequency over sessions. (Explaining this finding requires 2 additional parametric assumptions.) The model treats the perception of the current probability as a by-product of the construction of a compact encoding of the experienced sequence in terms of its change points. It illustrates the why and the how of intermittent Bayesian belief updating and retrospective revision in simple perception. It suggests a reinterpretation of findings in the recent literature on the neurobiology of decision making.
58
Information theory, inference, and learning algorithms
Choice Reviews Online · 2004 · 6.6K citations
Andrew G. Barto · IFAC Proceedings Volumes · 1998 · 3K citations
Learning the value of information in an uncertain world
Timothy E.J. Behrens, Mark W. Woolrich, Mark E. Walton et al. · Nature Neuroscience · 2007 · 2.2K citations