Designing Ethical Algorithms

Kirsten Martin

MIS Quarterly Executive · 2019 · 132 citations · 2 references

DOIFull text

Open access

Concepts

TL;DR

Algorithms drive critical decisions such as patient triage or insurance offers, yet they are inherently biased and prone to mistakes. The article examines how developers and users must take responsibility to ensure algorithms support good decisions and manage mistakes. The authors find that ignoring or fostering mistakes is unethical, and that making algorithms inscrutable can prompt developers to voluntarily assume accountability for their role in decisions.

Abstract

Algorithms drive critical decisions such as which patient is seen or who is offered insurance. Such algorithmic decisions, like all decisions, are biased and make mistakes. Yet, who is responsible for managing those mistakes? This article focuses on the responsibility of developers and users of algorithms to ensure algorithms support good decisions — including managing mistakes. First, while mistakes may be unintentional, ignoring or even fostering mistakes is unethical. Second, by creating inscrutable algorithms, which are difficult to understand or govern in use, developers may voluntarily take on accountability for the role of the algorithm in a decision.

References

2