The Accuracy of Self-Reported Internet Use—A Validation Study Using Client Log Data

Michael Scharkow

Communication Methods and Measures · 2016 · 430 citations · 25 references

Concepts

TL;DR

Most research on online communication relies on self‑report measures, which are often inaccurate with common over‑ and under‑reporting. The study seeks to compare self‑reported Internet use with client log files from a large household sample and to demonstrate the consequences of biased self‑reports while proposing possible solutions. The authors compare self‑reports to client log data collected from a large household sample. Self‑reported frequency and duration of Internet use are only moderately correlated with log data, show systematic over‑reporting, and are less accurate than self‑reports of specific content such as social networks or video platforms.

Abstract

The vast majority of empirical research on online communication, or media use in general, relies on self-report measures instead of behavioral data. Previous research has shown that the accuracy of these self-report measures can be quite low, and both over- and underreporting of media use are commonplace. This study compares self-reports of Internet use with client log files from a large household sample. Results show that the accuracy of self-reported frequency and duration of Internet use is quite low, and that survey data are only moderately correlated with log file data. Moreover, there are systematic patterns of misreporting, especially overreporting, rather than random deviations from the log files. Self-reports for specific content such as social network sites or video platforms seem to be more accurate and less consistently biased than self-reports of generic frequency or duration of Internet use. The article closes by demonstrating the consequences of biased self-reports and discussing possible solutions to the problem.

References

25