1996 · 19 citations · 15 references
ComputingCommunicationComputer ScienceHuman-computer InteractionInteraction DesignUser Experience DesignConversational InterfacesConversational User InterfacesInput ModalitiesInterface DesignMultimodal CommunicationMultimodal InteractionHuman CommunicationIntent ClassificationMultimodal Communication SystemsMultimodal ConversationMultimodal Interface DesignMultimodal InterfacesMultimodal User InterfacesUser Intent Detection
While human-to-human communication takes advantage of an abundance of information and cues, human-computer interaction is limited to only a few input modalities (usually only keyboard and mouse) and provides little flexibility as to choice of communication modality. In this paper, we present an overview of a family of research projects we are undertaking at Carnegie Mellon and Karlsruhe University to overcome some of these human-computer communication barriers. Multimodal interfaces are to include not only typing, but speech, lip-reading, eye-tracking, face recognition and tracking, and gesture and handwriting recognition. Initial experiments aimed at exploiting the complementary nature of these alternate modalities in interpreting user intent in a user interface are discussed. KEYWORDS: Multiple modalities, multimodal interface, speech recognition, lip-reading, eye-tracking, gesture recognition, handwriting recognition. 1. INTRODUCTION With multimedia workstations and high-speed dat...
15
An evaluation of an eye tracker as a device for computer input2
Colin Ware, H. H. Mikaelian · 1986 · 381 citations · Full text
The SPHINX-II speech recognition system: an overview
Xuedong Huang, F. Alleva, Hsiao-Wuen Hon et al. · Computer Speech & Language · 1993 · 370 citations
Speech and gestures for graphic image manipulation
Alexander G. Hauptmann · 1989 · 169 citations