2001 · 35 citations · 18 references
ArtsDesignHuman-computer InteractionInteraction DesignUser Experience DesignConversational InterfacesConversational User InterfacesEmbodied InteractionGesture RecognitionMultimodal InteractionSpeech InteractionGesture InterfacesHand GesturesHuman InteractionsHuman Multimodal InteractionMicrophonesMultimodal Interface DesignMultimodal InterfacesMultimodal User Interfaces
Progress in computer vision and speech recognition technologies has recently enabled multimodal interfaces that use speech and gestures. These technologies o er promising alternatives to existing interfaces because they emulate the natural way in which humans communicate. However, no systematic work has been reported that formally evaluates the new speech/gesture interfaces. This paper is concerned with formal experimental evaluation of new human-computer interactions enabled by speech and hand gestures.The paper describes an experiment conducted with 23 subjects that evaluates selection strategies for interaction with large screen displays. The multimodal interface designed for this experiment does not require the user to be in physical contact with any device. Video cameras and long range microphones are used as input for the system. Three selection strategies are evaluated and results for Different target sizes and positions are reported in terms of accuracy, selection times and user preference. Design implications for vision/speech based interfaces are inferred from these results. This study also raises new question and topics for future research.
18
The vocabulary problem in human-system communication
George W. Furnas, Thomas K. Landauer, Louis M. Gomez et al. · Communications of the ACM · 1987 · 1.5K citations · Full text
Computing, Computer Science, Design +15
Richard A. Bolt · 1980 · 1.4K citations · Full text
Richard A. Bolt · ACM SIGGRAPH Computer Graphics · 1980 · 904 citations
International Organisation for Standardisation
Nature · 1947 · 522 citations