2006 · 52 citations · 22 references
ComputingVisualizationHuman-computer InteractionInteraction DesignUser Experience DesignAugmented RealityContext-aware Augmented RealityEmbodied InteractionGesture InteractionGesture-based InteractionMultimodal InteractionAugmented Reality InterfacesInterface ArchitectureMultimodal FusionMultimodal User InterfacesObject PropertiesUser ContextUser Context IntegrationUser Context Modeling
This paper describes an augmented reality (AR) multimodal interface that uses speech and paddle gestures for interaction. The application allows users to intuitively arrange virtual furniture in a virtual room using a combination of speech and gestures from a real paddle. Unlike other multimodal AR applications, the multimodal fusion is based on the combination of time-based and semantic techniques to disambiguate a users speech and gesture input. We describe our AR multimodal interface architecture and discuss how the multimodal inputs are semantically integrated into a single interpretation by considering the input time stamps, the object properties, and the user context.
22
Richard A. Bolt · 1980 · 1.4K citations · Full text
Virtual object manipulation on a table-top AR environment
Hirokazu Kato, Mark Billinghurst, Ivan Poupyrev et al. · 2002 · 579 citations
Philip R. Cohen, Michael Johnston, David R. McGee et al. · 1997 · 464 citations · Full text
Volkert Buchmann, Stephen Violich, Mark Billinghurst et al. · 2004 · 253 citations
Computing, Urban Planning, Grasping +16