How Colorful Was Your Day? Why Questionnaires Cannot Assess Presence in Virtual Environments

Mel Slater

PRESENCE Virtual and Augmented Reality · 2004 · 386 citations · 18 references

Concepts

TL;DR

Presence in virtual environments cannot be scientifically validated solely through post‑experience questionnaires, as they provide no evidence of real‑time mental activity or behavior. The authors illustrate their argument by creating a hypothetical attribute, “colorfulness of the experience,” and surveying 74 participants with an online questionnaire. The study found that perceived colorfulness correlated with task success and pleasantness, but the analysis demonstrates that such questionnaire‑based methods can fabricate the notion of presence, leading the authors to call for reduced reliance on questionnaires in presence research.

Abstract

This paper argues that a scientific basis for “presence” as it's usually understood in virtual environments research, can not be established on the basis of postexperience presence questionnaires alone. To illustrate the point, an arbitrary mental attribute called “colorfulness of the experience” is conjured up, and a set of questions administered to 74 respondents with an online questionnaire. The results suggested that colorfulness of yesterday's experiences was associated with the extent to which a person accomplished their tasks, and also associated with yesterday being a “good”, “pleasant”, but not frustrating day. The meaning lessness of this analysis illustrates that the equivalent methodology used by presence researchers, may, similarly, bring into being the idea of presence in the minds of VE participants. However, it is argued that there can be no evidence on this methodological basis that presence played any role in their actual mental activity or behavior at the time of the experience. It is concluded that presence researchers must move away from heavy reliance on questionnaires in order to make any progress in this area.

References

18