2002 · 11 citations · 9 references
ComputingRadiologyVisualizationDiagnostic ImagingDiagnostic RadiologyMedical VisualizationConversational User InterfacesMultimodal InteractionSpeech InteractionVirtual RealityVirtual Reality In MedicineVirtual World NavigationCommandsDecoder DesignInteractive Medical VisualizationMultimodal Speech InteractionSpeech InputSpeech-based InteractionVirtual Environment NavigationVirtual Navigation
A system for the visualization of three-dimensional anatomical data, derived from magnetic resonance imaging (MRI) or computed tomography (CT), enables the physician to navigate through and interact with the patient's 3D scans in a virtual environment. This paper presents the multimodal human-machine interaction focusing the speech input. For the concerned task, a speech understanding front-end using a special kind of semantic decoder was successfully adopted. Now, the navigation as well as certain parameters and functions can be directly accessed by spoken commands. Using the implemented interaction modalities, the speed and efficiency of the diagnosis could be considerably improved.
9
Multimodal interfaces for dynamic interactive maps
Sharon Oviatt · 1996 · 179 citations
Unification-based multimodal integration
Michael Johnston, Philip R. Cohen, David R. McGee et al. · 1997 · 175 citations · Full text