SpeechTEK Europe home
SpeechTEK Europe 2011 - MultiModal Challenge
25 - 26 May 2011 • Copthorne Tara Hotel • London, UK
SpeechTEK University • 24 May 2011
Jim Larson
Jim Larson
SpeechTEK Europe Programme Chair

Take SpeechTEK Europe's Multimodal Challenge

All year you've been submitting entries to the SpeechTEK Europe multimodal challenge, showing us your own speech tech multimodal applications.

Our panel of user experience experts evaluated these applications and awarded the Expert’s Prize to Textpilot from Include AS.

The SpeechTEK Europe conference attendees voted on site for the People’s Choice Award which went to Angel Multimodal Application (Angel-MM)

Check out all of this year’s Multimodal Challenge entries below.

WINNER! Expert’s Prize
Include AS

Textpilot is an intelligent and multi-sensory software solution that aids with reading, composing and comprehending text. Textpilot features a carefully thought-out design and interaction model, based on the principles of universal design, to cater for the needs of a diverse group of users: from people with ordinary writing and reading skills to those with learning disabilities such as dyslexia, mobility impairments or users with visual impairments.

Textpilot can be used in almost all applications where you work with text. Users can benefit from four tools that aid with reading and writing: Advanced spell checking / proofreading, adaptive word prediction, dictionaries and support reading through Text-to-Speech. All tools are available from an easy to use toolbar that sits on top of any open application, whether you access your computer through a mouse, the keyboard or use different assistive technologies.

Textpilot’s combination of tools removes obstacles, boosts focus and increases motivation.

WINNER! People’s Choice Award

Angel Multimodal Application (Angel-MM)

The Angel Multimodal Application (Angel-MM) is an iPhone application that enables users to engage Interactive Voice Response (IVR) systems in real-time multimodal interactions. Users are able to engage the IVR in the traditional way of speaking, pushing buttons, and listening, as well as typing responses, reading text, and looking at imagespushed to the user by the IVR.

The Angel-MM Application enables anyone to deploy a multimodal application right from Angel's Site Builder tool without coding. Users will be able to build their voice applications and configure the interaction points with the Angel-MM App right from their browser.

Multimodality provides the Voice User Interface designer with the ability to select which mode of communication to use when interacting with a user: showing the user a picture is far more effective than describing it; enabling the user to type a sequence of digits is more effective than asking them to speak it and then having them listen to the system speak it back for verification.

To initiate a multimodal interaction, the user calls the IVR by dialing a phone number. The IVR will then send a Push Notification to the phone, asking forpermission to engage the user multimodally. Once the user enters into the multimodal interaction, the IVR will be able to communicate with the user by voice, text, and images.

The Angel Multimodal Application is available from the Apple App store: http://itunes.apple.com/us/app/angel-mm/id429502502?mt=8&ls=1#

Personal Health Assistant
Openstream Inc

This smart multimodal mobile application provides the ability to create and update personal health records using convenient multimodal interfaces. This application combines reminder/alerting services, with location-based searches, maps and directions, image/video capture and annotation, and group-share of selective information securely. It acts as a health-passport for individuals with information on allergies, drug-interactions and wellness monitoring.  

Intelligent multimodal/multi module automated real-time authentication processes
FST21 Ltd

SafeRise an intelligent multimodal recognition system used for automated real-time authentication processes. The system enables biometric recognition based on face, voice and behavioural patterns, correlated with real-time live information and database cross quarries. SafeRise provides easy and convenient access to authorised tenants and approved visitors while maintaining the highest level of security.

FlexT9 for Android
Nuance Communications

FlexT9 for Android represents the power of a truly multimodal experience combining voice and predictive input to give mobile consumers more control over how they send emails or text messages, search the web, update their social media status, and more. By combining Nuance's Dragon Dictation, T9 Trace, T9 Write and XT9, users decide whether they speak, trace, write or tap - or all of the above - via an innovative four-in-one keypad. FlexT9 allows users to switch between different input methods with just a simple tap - and now they can easily toggle back and forth between all six supported languages, which include UK and US English, French, Italian, German and Spanish. FlexT9 is currently available on the Android Market.

Ocean Blue Software Ltd

Talk@TV is a digital set top box (STB) solution that benefits users who are blind or have visual impairments, by voicing the on screen programme guide and menu items. Broadcast data such as the narrative for programs, and static data such as menu items and layouts are clearly described by voice. The project has utilised many years of experience from the RNIB (Royal National Institute of the Blind), on designing products for visually impaired and elderly people using the knowledge from psychologists, creative designers and evaluation trials on how to create products for everyone to use. The product is the world's first accessible, Digital free to air set-top box (STB) designed to provide and allow greater visual clarity in operation, intuitive for the user, easy to use and a better experience than normally associated with Digital TV receiver devices. The breakthrough development allows the visually impaired to access TV like never before.

Prime III
Prime Voting Systems

Prime III is a novel technology that allows private and secure voting to people with disabilities who have previously not had the same access to voting as the common voter. Since the inception of elections and election technologies, all segments of the voting population have never been granted equal access, privacy and security when voting. Disabled voters need to be able to cast their vote without the assistance of others. The Prime III multimodal voting system addresses these issues by allowing voters to privately and independently vote by touch and/or voice.

The Last Person on Earth Who Doesn't Use Online Banking
Garanti Bank

This project's purpose is to increase the use of Garanti Online Banking, one of Turkey’s largest banks. The process begins by sending an email to customers, who click on alink that triggers a news video about ‘the last person not using Garanti Internet Banking’. During the video, the customer is called on their mobile phone and an interactive conversation begins during which the customer is persuaded to use Garanti Internet Banking.


Convergys Mobile Customer Care effectively blends technology with assisted services to deliver a more personalised, effective, and secure way for “on-the-go” customers to transact business whenever they want to, from wherever they want to.  The result is increased customer loyalty and decreased cost to serve.

Connect with
SpeechTEK Europe


Platinum Sponsor
Gold Sponsor
Coffee Break
Media Sponsors