1998 · 13 citations · 7 references
Open access
ComputingComputer ScienceHuman-computer InteractionInteraction DesignVisual PerceptionEmbodied InteractionGesture AnalysisGesture-based InteractionMultimodal AnalysisMultimodal CommunicationMultimodal InteractionGestural UnderstandingGesture InterpretationHuman Multimodal InteractionMultimodal Input ProcessingMultimodal InterfacesMultimodal User InterfacesPerceptual Organization Of ShapeSimulation Experiment Design
Following the ecological approach to visual perception, this paper investigates multimodal referring acts in Human-Computer Interaction. Preliminary results from a simulation experiment allow to: (a) clarify the effect perceptual organization on multimodal communication; (b) provide guidelines for designing effective multimodal interfaces. Demonstrating that both the verbal and the gestural part of a referential act are influenced by perception, we confirm the need and the utility of taking into account perceptual organization to analyze referential expressions in a more robust way. As a conclusion, we show how these results can lead to an actual implementation of a gesture interpretation module directed by the reference analysis process.
7
The Ecological Approach to Visual Perception
Marc H. Bornstein, James J. Gibson · Journal of Aesthetics and Art Criticism · 1980 · 23.2K citations
Medicine, Psychology, Vision Science +17
Norman Fraser, Nigel Gilbert · Computer Speech & Language · 1991 · 436 citations
Applying electric field sensing to human-computer interfaces
Thomas G. Zimmerman, Joshua R. Smith, Joseph A. Paradiso et al. · 1995 · 249 citations