A Vocal Mouse?

University of Washington researchers have developed a vocal mouse that moves the cursor around the screen with clicks and phonemes:

The Internet offers wide appeal to people with disabilities. But many of those same people find it frustrating or impossible to use a handheld mouse. Software developed at the University of Washington provides an alternative using the oldest and most versatile mode of communication: the human voice.

"There are many people who have perfect use of their voice who don't have use of their hands and arms," said Jeffrey Bilmes, a UW associate professor of electrical engineering. "I think there are several reasons why Vocal Joystick might be a better approach, or at least a viable alternative, to brain-computer interfaces." The tool's latest developments will be presented this month in Tempe, Ariz. at the Assets Conference on Computers and Accessibility.

Vocal Joystick detects sounds 100 times a second and instantaneously turns that sound into movement on the screen. Different vowel sounds dictate the direction: "ah," "ee," "aw" and "oo" and other sounds move the cursor one of eight directions. Users can transition smoothly from one vowel to another, and louder sounds make the cursor move faster. The sounds "k" and "ch" simulate clicking and releasing the mouse buttons.

Versions of Vocal Joystick exist for browsing the Web, drawing on a screen, controlling a cursor and playing a video game. A version also exists for operating a robotic arm, and Bilmes believes the technology could be used to control an electronic wheelchair.

Existing substitutes for the handheld mouse include eye trackers, sip-and-puff devices and head-tracking systems. Each technology has drawbacks. Eye-tracking devices are expensive and require that the eye simultaneously take in information and control the cursor, which can cause confusion. Sip-and-puff joysticks held in the mouth must be spit out if the user wants to speak, and can be tiring. Head-tracking devices require neck movement and expensive hardware.

Vocal Joystick requires only a microphone, a computer with a standard sound card and a user who can produce vocal sounds.

...

One initial concern, he said, was whether people would feel self-conscious using the tool. (Empahsis mine.)

So, I am all about disabilities accessible systems. I think this technology is very cool. However, if you go to their site and watch the sample video of someone using this system, you realize that the primary hangup for this one is that you sound totally ridiculous.

It sounds like a weird fusion between the beatbox guy in breaking dancing videos and the guy who made all the noises in the Police Academy movies.

This must be a standard problem in making a system for disabled people: social stigma. If people at work are going to look down on you for using the extra-large type setting on your computer, you are much more likely to tough it out with the small print.

A certain amount of social sensitivity is necessary in creating these systems. I am sure that this system is very effective but that doesn't necessarily mean that anyone will want to use it.