Design of a Cooperative Problem-Solving System for En-Route Flight Planning: An Empirical Evaluation

Charles Layton, Philip J. Smith, C. Elaine McCoy

Human Factors The Journal of the Human Factors and Ergonomics Society · 1994 · 158 citations · 15 references

DOIFull text

Open access

Concepts

TL;DR

Optimization techniques and expert systems are widely used for complex problem solving, but their incomplete models lead to brittleness, prompting the proposal of cooperative systems that explicitly enhance human–computer collaboration. The study evaluates how alternative design concepts affect the performance of 30 airline pilots using a cooperative en‑route flight‑planning system. Using think‑aloud protocols, the authors developed cognitive models linking system features to pilots’ exploration and decision‑making in various scenarios. The study shows that design concepts strongly affect pilots’ cognitive processes and performance, and the findings inform recommendations for cooperative system design.

Abstract

Both optimization techniques and expert systems technologies are popular approaches for developing tools to assist in complex problem-solving tasks. Because of the underlying complexity of many such tasks, however, the models of the world implicitly or explicitly embedded in such tools are often incomplete and the problem-solving methods fallible. The result can be "brittleness" in situations that were not anticipated by the system designers. To deal with this weakness, it has been suggested that "cooperative" rather than "automated" problem-solving systems be designed. Such cooperative systems are proposed to explicitly enhance the collaboration of the person (or a group of people) and the computer system. This study evaluates the impact of alternative design concepts on the performance of 30 airline pilots interacting with such a cooperative system designed to support en-route flight planning. The results clearly demonstrate that different system design concepts can strongly influence the cognitive processes and resultant performances of users. Based on think-aloud protocols, cognitive models are proposed to account for how features of the computer system interacted with specific types of scenarios to influence exploration and decision making by the pilots. The results are then used to develop recommendations for guiding the design of cooperative systems.

References

15