This all-girls team of engineering students has developed an interesting device that translates sign language into speech and text.
Four students from the Holy Grace Academy of Engineering, Mala, Kerala, have developed a device that simplifies communicating with the speech- and hearing-impaired. The all-girls team has invented a device that can convert sign language into voice and text.
The device, Gesture Vocalizer, has been prepared to bridge the communication gap between people with speech and hearing impairment and people without.
Developed by Minu Varghese, S. Deepthi, Delna Domini and Nimya Varghese of Electronics and Communication branch, Gesture Vocaliser will understand the sign language gestures and will speak out those simple words.
“The device is based on body positioning technique (mainly hand gestures). The aim of this system is to make a simple prototype by taking the gestures and converting it into audio-visual format so that it can be understood by everyone,” told Minu Varghese to The Hindu.
The device understands and identifies what a speech-impaired person is trying to say and then translates that into spoken language, converting it through robotic speech or text.
The device works through a glove that is covered with sensors which decode the movement and location of the hand. The gloves identify the speed and tilting of the hand along with the bending of fingers and much more.
This data is further used to “understand” what a person is saying and produce the corresponding pre-recorded output messages, both audio and text. Since sign language is a universal language, the team did not face much trouble in sourcing the data and translating gestures into spoken language.
The device has an LCD screen that displays the output and works on a 9V radio battery which makes it portable and easy to carry.