Near-optimal integration of orientation information across saccades

Elad Ganmor, Michael S. Landy, Eero P. Simoncelli

Journal of Vision · 2015 · 94 citations · 43 references

DOIFull text

Open access

Concepts

TL;DR

We perceive a stable environment despite visual information being acquired in snapshots separated by saccades, with varying resolution from fovea to periphery, so stable perception likely relies on fusing information across resolutions. To test whether and how foveal and peripheral information are integrated, we examined human orientation discrimination across saccades. We assessed orientation discrimination before and after saccades, comparing foveal and peripheral presentations, and used perturbation analysis to model integration as a weighted sum. Humans perform best when a target is seen both peripherally before and foveally after a saccade, integrating the two views via a weighted sum based on relative precision, but they overweight the fovea, making integration slightly suboptimal.

Abstract

We perceive a stable environment despite the fact that visual information is essentially acquired in a sequence of snapshots separated by saccadic eye movements. The resolution of these snapshots varies—high in the fovea and lower in the periphery—and thus the formation of a stable percept presumably relies on the fusion of information acquired at different resolutions. To test if, and to what extent, foveal and peripheral information are integrated, we examined human orientation-discrimination performance across saccadic eye movements. We found that humans perform best when an oriented target is visible both before (peripherally) and after a saccade (foveally), suggesting that humans integrate the two views. Integration relied on eye movements, as we found no evidence of integration when the target was artificially moved during stationary viewing. Perturbation analysis revealed that humans combine the two views using a weighted sum, with weights assigned based on the relative precision of foveal and peripheral representations, as predicted by ideal observer models. However, our subjects displayed a systematic overweighting of the fovea, relative to the ideal observer, indicating that human integration across saccades is slightly suboptimal.

References

43