A Guide for Developers and Users of Observation Systems and Manuals

Abstract

To guide users and developers of observation systems and manuals, a set of criteria was developed. The criteria were collected and revised during the construction of a system, the System for Analysing Lessons 2, and revised during its use in the field. Thirty-three criteria which observation systems should meet were identified and sorted into three main types: identifying, validity, and practicality criteria. Identifying criteria enable users to select the correct instrument for their purposes. Validity criteria, which include criteria pertaining to the degree of inference, context, reliability and validity, relate to the accuracy with which the instrument represents the observed events. Practicality criteria provide information about the ease of administration and dissemination of results. Examples are provided.