Sensors · 2020 · 37 citations · 26 references
EngineeringCommunicationComputer ScienceHuman-robot InteractionInteraction DesignRoboticsConversational InterfacesDialogue SystemsHuman-robot CommunicationHuman-robot Interaction DesignMultimodal CommunicationMultimodal InteractionConversational AgentsDialog SystemsHuman InteractionsHuman-robot DialogueMultimodal ConversationMultimodal Dialogue SystemsMultimodal Human-robot InteractionRobot Multimodal Interaction
Social Robots need to communicate in a way that feels natural to humans if they are to effectively bond with the users and provide an engaging interaction. Inline with this natural, effective communication, robots need to perceive and manage multimodal information, both as input and output, and respond accordingly. Consequently, dialogue design is a key factor in creating an engaging multimodal interaction. These dialogues need to be flexible enough to adapt to unforeseen circumstances that arise during the conversation but should also be easy to create, so the development of new applications gets simpler. In this work, we present our approach to dialogue modelling based on basic atomic interaction units called Communicative Acts. They manage basic interactions considering who has the initiative (the robot or the user), and what is his/her intention. The two possible intentions are either ask for information or give information. In addition, because we focus on one-to-one interactions, the initiative can only be taken by the robot or the user. Communicative Acts can be parametrised and combined in a hierarchical manner to fulfil the needs of the robot's applications, and they have been equipped with built-in functionalities that are in charge of low-level communication tasks. These tasks include communication error handling, turn-taking or user disengagement. This system has been integrated in Mini, a social robot that has been created to assist older adults with cognitive impairment. In a case of use, we demonstrate the operation of our system as well as its performance in real human-robot interactions.
26
Response time in man-computer conversational transactions
Robert B. Miller · 1968 · 923 citations · Full text
A Network-based End-to-End Trainable Task-oriented Dialogue System
Tsung-Hsien Wen, David Vandyke, Nikola Mrkšić et al. · 2017 · 806 citations · Full text
Example-based dialog modeling for practical multi-domain dialog system
Cheongjae Lee, Sangkeun Jung, Seokhwan Kim et al. · Speech Communication · 2009 · 144 citations
Continuously Learning Neural Dialogue Management
Pei-Hao Su, Milica Gašić, Nikola Mrkšić et al. · arXiv (Cornell University) · 2016 · 105 citations · Full text