2006 · 23 citations · 5 references
ArtsCommunicationDesignDiagrammingInteraction DesignUser Experience DesignInteraction TechniquesInterface DesignMultimodal CommunicationMultimodal InteractionVirtual WorldsGraphical NotationMulti-user InteractionMultimodal Interaction DesignMultimodal Interface DesignMultimodal InterfacesMultimodal User InterfacesShared Virtual EnvironmentsUser Interaction
The past few years, multimodal interaction has been gaining importance in virtual environments. Although multimodality makes interaction with the environment more intuitive and natural, the development cycle of such an environment is often a long and expensive process. In our overall field of research, we investigate how model-based design can help shorten this process by designing the application with the use of high-level diagrams. In this scope, we present 'NiMMiT', a graphical notation suitable for expressing multimodal user interaction. We elaborate on the NiMMiT primitives and illustrate the notation in practice with a comprehensive example.
5
Statecharts: a visual formalism for complex systems
David Harel · Science of Computer Programming · 1987 · 6.7K citations
Pablo Figueroa, Mark Green, H. James Hoover · 2002 · 84 citations
Multisensory interaction metaphors with haptics and proprioception in virtual environments
Joan De Boeck, Erwin Cuppens, Tom De Weyer et al. · 2004 · 22 citations
Arts, Design, 3D Modeling +14
The effect of prolonged use on multimodal interaction
Janienke Sturm, Ilse Bakx, Bert Cranen et al. · Lirias (KU Leuven) · 2002 · 11 citations · Full text