The Reliability of the Situation Analysis Observation Guide

Abstract

The use of direct observation to assess the quality of family planning services is a central element of situation analysis studies. The interrater reliability of observational data from a study in Turkey was assessed using teams of multiple observers. Overall, the findings suggest a strong degree of reliability. Observers were more likely to agree when rating physical actions than verbal cues and when both observers were of similar backgrounds. The high degree of reliability in the situation analysis observation guide is considered to be due to a relatively low level of measurement and the use of crude indicators for several dimensions of quality. The guide's reliability makes this sort of study particularly valuable to family planning clinicians, program managers, and policymakers.