We have created a neural network service that will help people with hearing and voice impairments understand voices, read text from images and conduct a dialogue with artificial intelligence – all this is translated into gestures in the languages ASL (English), TİD (Turkish) and RSL (Russian).
This is the first step towards truly accessible and equal digital communication.
Voice, text, photos and even chat with AI are converted into gestures.
ASL (English), TİD (Turkish) and RZH (Russian).
Simple and accessible to all users.
Gestures are displayed correctly and clearly.
The system recognizes speech, converts it into text, and then translates it into sign language. Depending on the selected language — RSL (Russian), ASL (American), or TİD (Turkish) — a video appears on the screen with a live performer demonstrating the appropriate gestures.
Currently available:
You can select the desired language in the settings.
Work is currently underway to implement 35 languages for translation into sign languages.
The service is still in test mode, so accuracy may vary. Simple phrases spoken clearly and without background noise are best perceived.
The system recognizes text from a photograph (OCR), translates it into the selected sign language and demonstrates gestures using video clips with live native speakers.
The best are clear photos with printed text (e.g. ads, menus, book pages). Handwritten text is not supported yet.
You communicate with the AI (powered by GPT), and its responses are translated into sign language and displayed using video gestures. This is convenient for those who prefer visual perception.