Journal of Evaluation in Clinical Practice · 2001 · 76 citations · 27 references
ComputingHealth InformaticsInformation SystemsClinical Decision SupportClinical InformaticsClinical Information SystemsClinical Decision Support EvaluationDecision Support System EvaluationHealth Information System EvaluationOutcome EvaluationPerformance EvaluationProcess EvaluationDecision Support EvaluationDecision Support InterfacesPatient Outcome EvaluationPatient Outcome MeasurementSoftware Development Methodology
The evaluation of clinical information systems is essential because they are increasingly used in routine care and can influence patient outcomes through reminders and decision support, prompting a discussion of goals, methods, and results in a common context. The paper aims to answer what to evaluate, how to evaluate, and how to interpret results by comparing objectivist and subjectivist approaches and illustrating the evaluation process across software development phases. The authors illustrate the evaluation process using four practical examples from diverse settings, detailing phases of software development and potential techniques to achieve defined goals with limited resources. The study demonstrates that different evaluation methods vary in advantages, limitations, and costs when applied to clinical information systems.
The evaluation of clinical information systems is essential as they are increasingly used in clinical routine and may even influence patient outcome on the basis of reminder functions and decision support. Therefore we try to answer three questions in this paper: what to evaluate; how to evaluate; how to interpret the results. Those key questions lead to the discussion of goals, methods and results of evaluation studies in a common context. We will compare the objectivist and the subjectivist evaluation approach and illustrate the evaluation process itself in some detail, discussing different phases of software development and potential evaluation techniques in each phase. We use four different practical examples of evaluation studies that were conducted in various settings to demonstrate how defined evaluation goals may be achieved with a limited amount of resources. This also illustrates advantages, limitations and costs of the different evaluation methods and techniques that may be used when evaluating clinical information systems.
27
Performance of Four Computer-Based Diagnostic Systems
Eta S. Berner, George D. Webster, Alwyn A. Shugerman et al. · New England Journal of Medicine · 1994 · 330 citations
Gary S. Nickell, John N. Pinto · Computers in Human Behavior · 1986 · 271 citations