Contact Us

Automated Sign Language Translater Adds Gestures to Subtitles - featured June 6, 2011

< Back to Previous Page

Thanks to our Twitter friend @DebTruskey for telling us about this cool story!


We've seen quite a few devices designed to help hearing impaired users communicate via phone or computer, but Japan's NHK Science & Technology Research Laboratories has just announced a new animated translation system to help get important news to deaf viewers . While televised subtitles may work for those who understand the language, people who were born deaf and learned sign language from an early age can have significantly more difficulty. NHK's system, unveiled at Technology Open House 2011, bypasses this problem by automatically comparing Japanese text to sign language, converting equivalent words into animated onscreen gestures, and replacing differing words with appropriate synonyms. There are, however, a few kinks to work out. While comprehensible, the translations aren't exactly fluent and researchers have been forced to manually adjust some awkward transitions between words. The ultimate goal is to create a system that could be used during emergencies or natural disasters, allowing deaf citizens to receive urgent broadcasts as instantly as their hearing compatriots. You can see it in action, after the break.

Tags: News of the Week Hearing Loss Newsletter 6 June 2011