Automatic Sign Language Translator for Accessibility

Awards:

Maya traductor virtual lengua signos

The Technical Institute of  Castilla y León and associates signed an agreement in order to add 1500 signs to our interpret Maya and create a new translation service of web pages in real time.

With this project we expect to improve the accessibility of several contents to persons with hearing impairment who communicate through the Spanish Sign Language (Lengua de Signos Española – LSE).

Under this project agreement between XUL and ITCL, the  Maya’s translations  will be improved by the increased vocabulary size, from 350 to 2500 new words approximately. With this improvement and the new online service, XUL will manage to produce a commercialisable product from the initial prototype.

The project is currently presented in several forums, awarded by great reception from the participants, standing out  in the “feria del SIMO” , where it won the project “15 minutes of glory”, the “Broadcast it”fair , the “CARVI 2011” conference and a large number of apparitions in the media. Maya, our virtual translator had improved significantly from the first iterations, now with high degree of expressiveness and realism, as can be seen from the following pictures. Thanks to this tool, we expect to improve the accessibility of web pages, public services, administrative pages.

Demonstration of the Automatic Sign Language Translator

Signos avatar virtual traduccion online

TextoSign Texto to Language conversion, version 1.0

ITCL has a cooperative project in conjunction  with the enterprise XUL Comunicacíon Social from Cordoba  aiming to create a conversion tool from text to sign language. XUL is responsible for the text  translation whether ITCL is responsibleTextosign expresividad fácil lengua signos virtualfor the representation of said signs through a virtual character, in real time.

The “virtual interpret” is able to express through sign language a set of given phrases, using a list containing 350 signs which will be further expanded.  In the case of a sign or word not present on the list, the word is spelled out. The translator allows exporting the translated phrases to a video format, in order to be integrated in a web page or instructional video, or the real time visualization of the virtual interpret.

TextosignThe 3D visualization of the interpret allows observe the execution of the sign from any angle or position, which has a potential as educational tool for teaching sign language. It is also possible to visualize each signal individually or with natural transitions between each other, as would occur in a conversation.

More information about the complete project can be accessed from www.textosign.es