2019 · 16 citations · 25 references
EngineeringComputer ScienceRobotics EngineeringHuman-robot InteractionHumanoid RoboticsRoboticsGesture RecognitionHuman-robot CollaborationHuman-robot CommunicationMultimodal CommunicationMultimodal InteractionSocially Assistive RoboticsAssistive RobotsCollaborative Multimodal InteractionCollaborative Task PlanningHuman-robot DialogueHuman-robot Interaction ArchitecturesMultimodal Human-robot InteractionRobot Multimodal InteractionTask-oriented Dialogue
With rapid advances in social robotics, humanoids and autonomy, robot assistants appear to be within reach. However, robots are still unable to effectively interact with humans in activities of daily living. One of the challenges is in the frequent use of multiple communication modalities when humans engage in collaborative activities. In this paper, we propose a Multimodal Interaction Manager, a framework for an assistive robot that maintains an active multimodal interaction with a human partner while performing physical collaborative tasks. The heart of our framework is a Hierarchical Bipartite Action-Transition Network (HBATN), which allows the robot to infer the state of the task and the dialogue given spoken utterances and observed pointing gestures from a human partner, and to plan its next actions. Finally, we implemented this framework on a robot to provide preliminary evidence that the robot can successfully participate in a task-oriented multimodal interaction.
25
Deep Residual Learning for Image Recognition
Kaiming He, Xiangyu Zhang, Shaoqing Ren et al. · 2016 · 222.1K citations · Full text
Artificial intelligence: A modern approach
Nils J. Nilsson · Artificial Intelligence · 1996 · 10.7K citations
Dialogue Act Modeling for Automatic Tagging and Recognition of Conversational Speech
Andreas Stolcke, Klaus Ries, Noah Coccaro et al. · Computational Linguistics · 2000 · 1.1K citations · Full text
HTN planning: complexity and expressivity
Kutluhan Erol, James Hendler, Dana Nau · 1994 · 621 citations