ComputingComputer SystemsAcousticsInteraction DesignNonverbal CommunicationConversational InterfacesConversational User InterfacesMultimodal InteractionSpeech InteractionSpeech RecognitionVoice ControlInteractive Voice InterfacesParameter ControlSpeech Recognition InterfacesVocal Interaction ControlVoice InteractionVoice RecognitionVoice User InterfacesVoice-controlled Interfaces
Traditional speech recognition interfaces rely on an indirect conversational model where the user gives a direction and the system performs an operation. The study aims to use non‑verbal voice features such as pitch and volume to enable direct, immediate control of interactive applications. The authors develop prototype interaction techniques—including continuous voice control, pitch‑rate parameter control, and tonguing‑based discrete control—to realize direct voice‑as‑sound interaction. Prototype implementations indicate that voice‑as‑sound techniques can enhance traditional voice recognition approaches.
We describe the use of non-verbal features in voice for direct control of interactive applications. Traditional speech recognition interfaces are based on an indirect, conversational model. First the user gives a direction and then the system performs certain operation. Our goal is to achieve more direct, immediate interaction like using a button or joystick by using lower-level features of voice such as pitch and volume. We are developing several prototype interaction techniques based on this idea, such as "control by continuous voice", "rate-based parameter control by pitch," and "discrete parameter control by tonguing. We have implemented several prototype systems, and they suggest that voice-as-sound techniques can enhance traditional voice recognition approach.
8
Proceedings of EUROSPEECH-1991.
R. J. Lickley, Richard Shillcock, Ellen Gurman Bard · 1991 · 374 citations
Speed-dependent automatic zooming for browsing large documents
Takeo Igarashi, Ken Hinckley · 2000 · 302 citations · Full text