Evaluation of Adaptive Systems

Abstract

Adaptive systems are usually interactive systems. As such they stand to benefit considerably from a development lifecycle that ensures user involvement from the early design stages, and embraces evaluation, in both formative and summative forms. Evaluating an adaptive system involves a number of specific problems and pitfalls that need to be addressed by the selection of specific methods, techniques and criteria. This tutorial aims to introduce participants to the peculiarities that arise when evaluating adaptive interactive systems. A layered evaluation framework is used to separate the evaluation process into a number of different aspects which can be applied at different stages throughout the development life-cycle.