Our Bodies in the Trolley’s Path, or Why Self-driving Cars Must *Not* Be Programmed to Kill

Nassim JafariNaimi

Science Technology & Human Values · 2017 · 88 citations · 22 references

Concepts

TL;DR

Self‑driving cars are promoted for accident reduction, yet proponents accept that they will inevitably cause fatal incidents where moral algorithms decide outcomes, framing this trade‑off as necessary to reap technological benefits. The article critiques the prevailing optimism, arguing that it obscures the stakes and proposes that a caring concern for lives lost—beyond binary trade‑offs and systemic biases—should guide mobility, city design, community well‑being, and planetary futures. The author engages the debate by demonstrating how undue optimism masks critical issues and by outlining how moving beyond utilitarian framing can foster ethical inquiry and innovative design.

Abstract

The discourse around self-driving cars has been dominated by an emphasis on their potential to reduce the number of accidents. At the same time, proponents acknowledge that self-driving cars would inevitably be involved in fatal accidents where moral algorithms would decide the fate of those involved. This is a necessary trade-off, proponents suggest, in order to reap the benefits of this new technology. In this article, I engage this argument, demonstrating how an undue optimism and enthusiasm about this technology is obscuring our ability to see what is at stake and explaining how moving beyond the dominant utilitarian framings around this technology opens up a space for both ethical inquiry and innovative design. I suggest that a genuine caring concern for the many lives lost in car accidents now and in the future—a concern that transcends false binary trade-offs and that recognizes the systemic biases and power structures that make certain groups more vulnerable than others—could serve as a starting point to rethink mobility, as it connects to the design of our cities, the well-being of our communities, and the future of our planet.

References

22