AKOUO ("to hear") aims to enhance communication between the deaf community and hearing individuals by translating spoken English to sign language in real time with the use of animated avatars. This innovative solution seeks to improve inclusivity and streamline communication with the use of sophisticated speech recognition, natural language processing (NLP) and animation technologies.
- The voice from the user is taken and converted to text.
- This text is then rephrased into a string having only words for which the sign-language gifs are present.
- Then each word is mapped to a gif, and the gifs are shown in a sequence, one-after-another.
- Clone the Repo
- Cd into the directory, and then type "python -r install requirements.txt"
- To run the project, type "python manage.py runserver
The user can type or toggle the audio button to speak into the microphone. The corresponding sign language will be displayed in the right side of the screen