By using multiple channels of communication, interaction becomes less taxing, audio instructions can be spoken to free up the visual channel, and pictures can be used when a visual is most natural. Speech can be used to respond to queries and instructions while hands are free to carry out the instructions at the very physical site where the user needs to troubleshoot. This presentation reviews the design process, the solution architecture, and demos a working multimodal automated application that interacts with a live IVR.

Where does speech technology fit into smartphone applications? This session presents the current state of smartphone app design, how speech technology will shape better smartphone app design, and takes a look at the future of adding the right amount of speech at the right places. Join us to see how you can take advantage of the GUI-speech gap in smartphone application design.