The Development and Validation of the Game User Experience Satisfaction Scale (GUESS)

TLDR

Playtesting is used to improve games, yet obtaining quality feedback is difficult without a validated gaming assessment tool. The study aims to develop and validate a comprehensive, psychometrically sound scale for measuring video game satisfaction to support playtesting and game evaluation. The authors employed a mixed‑method design involving item generation, expert review, pilot testing, exploratory factor analysis on 629 participants, and confirmatory factor analysis on 729 participants to create the scale. The resulting GUESS demonstrated strong validity and reliability across more than 450 games and can be used to assess and debrief user satisfaction for diverse game types.

Abstract

The aim of this study was to develop and psychometrically validate a new instrument that comprehensively measures video game satisfaction based on key factors.Playtesting is often conducted in the video game industry to help game developers build better games by providing insight into the players' attitudes and preferences. However, quality feedback is difficult to obtain from playtesting sessions without a quality gaming assessment tool. There is a need for a psychometrically validated and comprehensive gaming scale that is appropriate for playtesting and game evaluation purposes.The process of developing and validating this new scale followed current best practices of scale development and validation. As a result, a mixed-method design that consisted of item pool generation, expert review, questionnaire pilot study, exploratory factor analysis (N = 629), and confirmatory factor analysis (N = 729) was implemented.A new instrument measuring video game satisfaction, called the Game User Experience Satisfaction Scale (GUESS), with nine subscales emerged. The GUESS was demonstrated to have content validity, internal consistency, and convergent and discriminant validity.The GUESS was developed and validated based on the assessments of over 450 unique video game titles across many popular genres. Thus, it can be applied across many types of video games in the industry both as a way to assess what aspects of a game contribute to user satisfaction and as a tool to aid in debriefing users on their gaming experience.The GUESS can be administered to evaluate user satisfaction of different types of video games by a variety of users.