The Vocal Joystick Demo at UIST 05 : A Voice-Based Human-Computer Interface
We will demonstrate a novel voice-based human-computer interface we call the Vocal Joystick (VJ), designed to enable individuals with motor impairments to use vocal parameters for both discrete and continuous control tasks. Since discrete spoken commands are not ideally suited to such tasks, our methodology exploits a large set of continuous acoustic-phonetic parameters like pitch, loudness, vowel quality, etc. Their selection is optimized with respect to automatic recognizability, communication bandwidth, learnability, suitability, and ease of use. These parameters are extracted continually in real time, transformed via adaptation and acceleration, and converted into continuous control signals. Our UIST’2005 demo will allow the user to try out the vocal joystick on arbitrary web-browsing tasks, VJ-enabled games, and other VJ-based applications.