Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · 2023 · 15 citations · 70 references
EngineeringComputer ScienceSystems EngineeringAutomationHuman-computer InteractionUser Experience DesignAutomation System DesignAutomation SystemsBuilding AutomationBuilding Automation SystemsInteraction PatternsBehavior Change ModelsConfiguration AutomationEnd-user AutomationHome Automation SystemsIterative CouplingIterative Design ProcessSmart Home ApplicationsSmart Home Interaction
Programming a smart home is an iterative process in which users configure and test the automation during the in-situ experience with IoT space. However, current end-user programming mechanisms are primarily preset configurations on GUI and fail to leverage in-situ behaviors and context. This paper proposed in-situ programming (ISP) as a novel programming paradigm for AIoT automation that extensively leverages users' natural in-situ interaction with the smart environment. We built a Wizard-of-Oz system and conducted a user-enactment study to explore users' behavior models in this paradigm. We identified a dynamic programming flow in which participants iteratively configure and confirm through query, control, edit, and test. We especially identified a novel method "snapshot" for automation configuration and a novel method "simulation" for automation testing, in which participants leverage ambient responses and in-situ interaction. Based on our findings, we proposed design spaces on dynamic programming flow, coherency and clarity of interface, and state and scene management to build an ideal in-situ programming experience.
70
Guidelines for Human-AI Interaction
Saleema Amershi, Dan Weld, Mihaela Vorvoreanu et al. · 2019 · 1.9K citations
Computing, Computer Science, Design +17
Ewa Luger, Abigail Sellen · 2016 · 1.1K citations
A. J. Bernheim Brush, Bongshin Lee, Ratul Mahajan et al. · 2011 · 461 citations
Till Ballendat, Nicolai Marquardt, Saul Greenberg · 2010 · 401 citations
Arts, Communication, Design +17
Practical trigger-action programming in the smart home
Blase Ur, Elyse McManus, Melwyn Pak Yong Ho et al. · 2014 · 382 citations