"That's a paramount kind of use case for getting rid of the mouse," said McDowell, who is working on "Bee Movie," a 3-D animated film for DreamWorks. "I'm in exactly the same situation when I'm working with 3-D. If we're all working in a space that was G-speak friendly, I could gesture to where I want to go. I can physically work in that space, I can grab that figure or gesture to change that to red."
But gestural technology is not without its critics.
Ed Chi, senior research scientist at Palo Alto Research Center, which did pioneering work on the mouse, said new interfaces based on speech or hand gestures have limitations. Researchers discovered one of the most obvious drawbacks while developing virtual reality "caves," 3-D computer environments that let people explore the Lascaux caves or the ceiling of the Sistine Chapel.
"It turns out people are lazy," Chi said. "They don't want to move a lot to interact with their technology."
Other obstacles can be more problematic. For common human behaviors such as gestures or speech to replace the mouse, computers need to be placed in a particular "mode" to respond. Otherwise, it won't know to ignore the hand gestures made during casual conversation, or words spoken when answering a phone call.