“Put-That-There”: Voice and Gesture at the Graphics Interface

   page       BibTeX_logo.png   
Richard A. Bolt
ACM SIGGRAPH Computer Graphics 14(3), pages 262–270
July 1980

Recent technological advances in connected-speech recognition and position sensing in space have encouraged the notion that voice and gesture inputs at the graphics interface can converge to provide a concerted, natural user modality.
The work described herein involves the user commanding simple shapes about a large-screen graphics display surface. Because voice can be augmented with simultaneous pointing, the free usage of pronouns becomes possible, with a corresponding gain in naturalness and economy of expression. Conversely, gesture aided by voice gains precision in its power to reference.