Inference of Intention and Permissibility in Moral Decision Making.

Abstract

The actions of a rational agent reveal information about its mental states. These inferred mental states, particularly the agent’s intentions, play an important role in the evaluation of moral permissibility. While previous computational models have shown that beliefs and desires can be inferred from be-havior under the assumption of rational action they have crit-ically lacked a third mental state, intentions. In this work, we develop a novel formalism for intentions and show how they can be inferred as counterfactual contrasts over influence dia-grams. This model is used to quantitatively explain judgments about intention and moral permissibility in classic and novel trolley problems.