Understanding the applicability of sequential data analysis techniques for analysing usability data

Abstract

Abstract The applicability of sequential data analysis (SDA) techniques for analysing usability test data is examined. SDA techniques include transition matrix analysis, lag sequential analysis, frequency of cycles, graphical summarization techniques, and pattern analysis techniques. A subset of each was used in analysing the data from three usability studies. The encoding schemes used, the analysis routines run, software tools to support encoding and analysis (SHAPA and the Maximal Repeating Pattern analysis tool), and their interactions are discussed. The different types of usability problems which can be extracted from the data when analysed with SDA techniques are illustrated. It is concluded that the SDA techniques will be useful once the state-of-the-art in software support is able to provide the analyst greater flexibility in applying the analysis routines. Without the ability to apply analysis routines to multiple data levels, too much work is involved in obtaining a complete analysis of usability problems at all levels.