A systems-theoretic approach to safety in software-intensive systems

Nancy G. Leveson

IEEE Transactions on Dependable and Secure Computing · 2004 · 123 citations · 19 references

Concepts

TL;DR

Traditional accident models explain losses from physical device failures in simple systems, but they are less useful for software‑intensive systems and for nontechnical aspects such as organizational culture and human decision‑making. This paper proposes using systems theory to develop new accident models that better explain system accidents arising from component interactions, software‑related accidents, and the role of human decision‑making. The proposed models treat social and technical aspects as an integrated process, illustrated by the Milstar satellite loss case, and may also apply to emergent properties such as security.

Abstract

Traditional accident models were devised to explain losses caused by failures of physical devices in relatively simple systems. They are less useful for explaining accidents in software-intensive systems and for nontechnical aspects of safety such as organizational culture and human decision-making. This paper describes how systems theory can be used to form new accident models that better explain system accidents (accidents arising from the interactions among components rather than individual component failure), software-related accidents, and the role of human decision-making. Such models consider the social and technical aspects of systems as one integrated process and may be useful for other emergent system properties such as security. The loss of a Milstar satellite being launched by a Titan/Centaur launch vehicle is used as an illustration of the approach.

References

19