2006 · 14 citations · 8 references
ComputingCommunicationComputer ScienceHuman-computer InteractionInteraction DesignNatural Language ProcessingConversational InterfacesConversational User InterfacesDialogue SystemsMultimodal CommunicationMultimodal InteractionSpeech InteractionDialogue ManagementInteractive Dialogue SystemsMultimodal ConversationMultimodal Dialogue SystemsMultimodal InterfacesMultimodal User InterfacesSpoken Dialogue SystemsSystem Efficiency Analysis
Multimodal, speech-enabled systems pose different research problems when compared to unimodal, voice-only dialogue systems. One of the important issues is the question of how a multimodal interface should look like in order to make the multimodal interaction natural and smooth, while keeping it manageable from the system perspective. Another central issue concerns algorithms for multimodal dialogue management. This paper presents a solution that relies on adapting an existing unimodal, vocal dialogue management framework to make it able to cope with multimodality. An experimental multimodal system, Archivus, is described together with discussion of the required changes to the unimodal dialogue management algorithms. Results of pilot Wizard of Oz experiments with Archivus focusing on system efficiency and user behaviour are presented1.
8
Nils Dahlbäck, Arne Jönsson, Lars Ahrenberg · 1993 · 737 citations
Mutual disambiguation of recognition errors in a multimodel architecture
Sharon Oviatt · 1999 · 315 citations
A generic platform for addressing the multimodal challenge
Laurence Nigay, Joëlle Coutaz · 1995 · 195 citations
The role of natural language in a multimodal interface
Philip R. Cohen · 1992 · 171 citations · Full text
Context based multimodal fusion
Norbert Pfleger · 2004 · 48 citations