Bayesian integration of visual and vestibular signals for heading

John S. Butler, Stuart Smith, Jennifer L. Campos, HH Bülthoff

Journal of Vision · 2010 · 254 citations · 56 references

DOIFull text

Open access

Concepts

TL;DR

Self‑motion relies on a combination of visual and vestibular signals. The study examined how visual and vestibular cues are weighted during self‑motion. Participants performed a two‑interval forced‑choice task across vestibular‑only, visual‑only (four headings), and combined conditions with ±6° or ±10° inter‑sensory conflicts. Even with large cue conflicts, participants reduced variance optimally, but the combined‑cue weights were not predicted by unimodal reliabilities and favored the vestibular cue.

Abstract

Self-motion through an environment involves a composite of signals such as visual and vestibular cues. Building upon previous results showing that visual and vestibular signals combine in a statistically optimal fashion, we investigated the relative weights of visual and vestibular cues during self-motion. This experiment was comprised of three experimental conditions: vestibular alone, visual alone (with four different standard heading values), and visual–vestibular combined. In the combined cue condition, inter-sensory conflicts were introduced (Δ = ±6° or ±10°). Participants performed a 2-interval forced choice task in all conditions and were asked to judge in which of the two intervals they moved more to the right. The cue-conflict condition revealed the relative weights associated with each modality. We found that even when there was a relatively large conflict between the visual and vestibular cues, participants exhibited a statistically optimal reduction in variance. On the other hand, we found that the pattern of results in the unimodal conditions did not predict the weights in the combined cue condition. Specifically, visual–vestibular cue combination was not predicted solely by the reliability of each cue, but rather more weight was given to the vestibular cue.

References

56