Trust in Smart Systems

TLDR

Trust is a key determinant of the acceptability of automation technologies. The study investigates whether trust in smart systems develops like trust in humans and how automation level influences trustworthiness and acceptability. The authors conducted an experiment with 57 participants who evaluated descriptions of three adaptive cruise control systems varying in automation level and whether they shared the driver’s goals, measuring trustworthiness and acceptability. Results show that adaptive cruise control systems that share the driver’s goals and provide information when taking over tasks are perceived as more trustworthy and acceptable, with trustworthiness mediating the influence of goal sharing and automation level on acceptability.

Abstract

We examine whether trust in smart systems is generated analogously to trust in humans and whether the automation level of smart systems affects trustworthiness and acceptability of those systems.Trust is an important factor when considering acceptability of automation technology. As shared goals lead to social trust, and intelligent machines tend to be treated like humans, the authors expected that shared driving goals would also lead to increased trustworthiness and acceptability of adaptive cruise control (ACC) systems.In an experiment, participants (N = 57) were presented with descriptions of three ACCs with different automation levels that were described as systems that either shared their driving goals or did not. Trustworthiness and acceptability of all the ACCs were measured.ACCs sharing the driving goals of the user were more trustworthy and acceptable than were ACCs not sharing the driving goals of the user. Furthermore, ACCs that took over driving tasks while providing information were more trustworthy and acceptable than were ACCs that took over driving tasks without providing information. Trustworthiness mediated the effects of both driving goals and automation level on acceptability of ACCs.As when trusting other humans, trusting smart systems depends on those systems sharing the user's goals. Furthermore, based on their description, smart systems that take over tasks are judged more trustworthy and acceptable when they also provide information.For optimal acceptability of smart systems, goals of the user should be shared by the smart systems, and smart systems should provide information to their user.