Transportation Research Record Journal of the Transportation Research Board · 2014 · 289 citations · 25 references
Artificial IntelligenceEngineeringSafety ScienceLawAdvanced Driver-assistance SystemIntelligent SystemsAccident InvestigationAutonomous VehiclesTransport AccidentEthical AnalysisSystems EngineeringAi Safety EducationArtificial Intelligence ApproachAutomated VehiclesComputer ScienceAutonomous DrivingAutomated Decision-makingAutomated Vehicle CrashesAutomationAutomated Vehicle
Automated vehicles promise reduced crashes and improved efficiency, yet they are expected to crash occasionally, and when a human cannot intervene, the vehicle’s pre‑crash decisions—chosen from multiple trajectory alternatives—must balance safety and moral considerations. The paper proposes a three‑phase framework to develop ethical crashing algorithms that combine rational analysis, artificial intelligence, and natural‑language requirements. The framework is theoretical, outlining rational, AI, and natural‑language phases that will be implemented as the technology matures. The study found that automated vehicles will almost certainly crash, that pre‑crash decisions carry moral weight, and that complex human morals cannot yet be effectively encoded in software.
Automated vehicles have received much attention recently, particularly the Defense Advanced Research Projects Agency Urban Challenge vehicles, Google's self-driving cars, and various others from auto manufacturers. These vehicles have the potential to reduce crashes and improve roadway efficiency significantly by automating the responsibilities of the driver. Still, automated vehicles are expected to crash occasionally, even when all sensors, vehicle control components, and algorithms function perfectly. If a human driver is unable to take control in time, a computer will be responsible for precrash behavior. Unlike other automated vehicles, such as aircraft, in which every collision is catastrophic, and unlike guided track systems, which can avoid collisions only in one dimension, automated roadway vehicles can predict various crash trajectory alternatives and select a path with the lowest damage or likelihood of collision. In some situations, the preferred path may be ambiguous. The study reported here investigated automated vehicle crashing and concluded the following: (a) automated vehicles would almost certainly crash, (b) an automated vehicle's decisions that preceded certain crashes had a moral component, and (c) there was no obvious way to encode complex human morals effectively in software. The paper presents a three-phase approach to develop ethical crashing algorithms; the approach consists of a rational approach, an artificial intelligence approach, and a natural language requirement. The phases are theoretical and should be implemented as the technology becomes available.
25
Artificial intelligence: a modern approach
Choice Reviews Online · 1995 · 22.2K citations · Full text
Artificial intelligence: A modern approach
Nils J. Nilsson · Artificial Intelligence · 1996 · 10.7K citations
Artificial Intelligence, Engineering, Applied Intelligent System +4
Moral machines: teaching robots right from wrong
Choice Reviews Online · 2009 · 799 citations