IBM Research Demonstrates Innovative ‘Speech to Sign Language’ Translation System

IBM (NYSE: IBM) has developed an ingenious system called SiSi (Say It Sign It) that automatically converts the spoken word into British Sign Language (BSL) which is then signed by an animated digital character or avatar.
SiSi brings together a number of computer technologies. A speech recognition module converts the spoken word into text, which SiSi then interprets into gestures, that are used to animate an avatar which signs in BSL.

Upon development this system would see a signing avatar ‘pop up’ in the corner of the display screen in use — whether that be a laptop, personal computer, TV, meeting-room display or auditorium screen. Users would be able select the size and appearance of the avatar. This type of solution has the potential in the future to enable a person giving a presentation in business or education to have a digital character projected behind them signing what they are saying. This would complement the existing provision, allowing for situations where a sign language interpreter is not available in person.

“IBM is committed to developing IT solutions that are inclusive and accessible to all members of society,” said Dr Andy Stanford-Clark, Master Inventor, IBM Hursley. “This technology has the potential to make life easier for the deaf community by providing automatic signing for television broadcasts, and making radio news and talk shows available to a new audience over the Internet, or by providing automated voicemail transcription to allow them to make better use of the mobile network.”

Guido Gybels, Director of New Technologies at RNID, said: “RNID welcomes any development that would make the Information Society a more equal place for deaf and hard of hearing people. British Sign Language users are amongst the most disenfranchised citizens as a result of services and products not being designed with their needs in mind. There is clearly still a long way to go before such prototypes become fully capable, off-the-shelf products, but it is encouraging to see that mainstream research is contributing to this objective of a more inclusive society.”

Read the complete Press Release