User experience evaluation methods

TLDR

User experience has become central to product design, yet a clear overview of available UX evaluation methods is missing due to a lack of consensus on UX characteristics. The paper aims to provide a comprehensive overview of UX evaluation methods. The authors collected 96 methods over several years using literature reviews, workshops, SIG sessions, and an online survey, then analyzed them by product development phase and experience period. The analysis identifies development needs for UX evaluation methods, including early‑stage techniques, social and collaborative evaluation approaches, improved practicability and scientific quality, and a deeper understanding of UX.

Abstract

The recent shift of emphasis to user experience (UX) has rendered it a central focus of product design and evaluation. A multitude of methods for UX design and evaluation exist, but a clear overview of the current state of the available UX evaluation methods is missing. This is partly due to a lack of agreement on the essential characteristics of UX. In this paper, we present the results of our multi-year effort of collecting UX evaluation methods from academia and industry with different approaches such as literature review, workshops, Special Interest Groups sessions and an online survey. We have collected 96 methods and analyzed them, among other criteria, based on the product development phase and the studied period of experience. Our analysis reveals development needs for UX evaluation methods, such as early-stage methods, methods for social and collaborative UX evaluation, establishing practicability and scientific quality, and a deeper understanding of UX.