Intuitive Language Learning Application Using IoT and ASL

Darshini Rajasekar; Aravindh Sekar; Magesh Rajasekar

doi:10.21276/ijircst.2020.8.6.3

Abstract

This Project is an android application enabled with IOT and ASL. Which aids the people with visual and hearing impairments to learn a new language? Initially the application will prompt the user to select how he is differently abled (deaf or blind).Now based on the option selected for blind people the entire UI will be converted into voice recognition system and text to Speech ,Hence the user can orally listen and learn and to learn to write, a special interface called Braille Keyboard is used ..Three foreign languages are included in this project namely English French and German. The Alphabets along with the Braille codes will be taught to the blind people. The Main Novelty of this project is that a Braille keyboard is interfaced with the application. If the user is deaf, The UI will become touch based .Now the user will start learning visually and he will understand the words through ASL .After each lesson the user will be tested on their understanding. The entire features of the application is designed based on the requirements gathered from the blind and deaf students by interacting with them in person . So the main advantage of this application is that it will be user friendly for the actual real time end user. Every lesson can be replayed any number of times until the user understands it thoroughly phones. The application assists the blind people and make their learning process easier with voice interface and in addition a Braille keyboard is also being used .They will be given a clearer vision on the Braille code for each and every alphabet The application assists the hearing impaired people to learn a new language by the standard sign language , the ASL.

Keywords

IoT(Internet Of Things), ASL(American Sign Language), UI(User Interface)

References

Adam DÄ…browski, Damian Huderek, Marcin Iwanowski, Piotr KardyÅ›, “A new android application for blind and visually impaired people”, IEEE Transaction on Computers, Poland 2016.
R. Guha, V. Gupta, V. Raghunathan, R. Srikant, “User modelling for a personal assistant”, The 8th WSDM International Conference, Shanghai 2015.
S. M. Kulkarni, Rupa N. Digole, ”Smart navigation system for visually impaired person”, International Journal of Advanced Research in Computer and Communication Engineering, India 2015.
Pooja Sharma, Shimi S. L, “Design and Development of Virtual Eye for the blind”, International Journal of Innovative Research in Electrical, Electronics, Instrumentation and Control Engineering, India 2015.
J. Hildenbrand, “What is Google TalkBack”, AndroidCentral.com, 2014.
Bairoju Vishwa Rupa Chary, B.Santosh Kumar, “Rescue system for visually impaired blind persons”, International Journal of Engineering Trends and Technology (IJETT), India 2014.
Harshad Girish Lele, Mrunmayi Mohan Modak, Viten Vilas Lonkar, Varun Vasant Marathe, “Electronis path guidance for visually impaired people”, The International Journal Of Engineering And Science (IJES), India 2013.
Abhishek Srivastava, Adhar Vashishth, Akshay Sharma, “An assistive reading system for visually impaired using OCR and TTS”, International Journal of Computer Applications, India 2014.
Amanda Hastings, Ravi Kuber, Matthew Tretter, “Determining the accessibility of mobile screen readers for blind users”, IASTED Conference on Human-Computer Interaction, Baltimore, USA 2012.
Shreyashi Narayan Sawant " Sign Language Recognition System to aid Deaf-dumb People Using PCA" International Journal of Computer Science & Engineering Technology (IJCSET)
Dalia Nashat, Abber Shoker, Reem Al-Ebilan “An Android application to aid uneducated deaf-dumb people” International Journal of Computer Science and Mobile Applications (IJCSMA)
Majzoob Kamal, Aldein Omer, Mohmed Sirelkhtem Adrees, Osama E. Sheta “Alternative Central Mobile Application Strategy to Deaf and Dumb Education in Third World Countries” International Journal of Soft Computing and Engineering (IJSCE)

Cites this article as

D. Rajasekar, A. Sekar, M. Rajasekar, "Intuitive Language Learning Application Using IoT and ASL", International Journal of Innovative Research in Engineering & Management (ijircst), Vol-8, Issue-6, Page No-384-388, 2020. Available from: https://doi.org/10.21276/ijircst.2020.8.6.3

Corresponding Author

Darshini Rajasekar

Student, B.Tech, Department of Computer Science & Engineering, Panimalar Engineering College, Anna University, Chennai Tamil Nadu India. (email Id:darshud18@gmail.com)

Download Full Paper

Download PDF

No. of Downloads: 55 | No. of Views: 1913

Advancing Education through VR: The Emerging Scope of Virtual Classrooms

Mohd Tanveer, Mohd Azat, Inayat Husain, Sakil Ahmad, Mohammad Aalam Khan.

May 2025 - Vol 13, Issue 3
Speech Recognition Technologies: Design, Challenges, and Real-World Applications

Maruti Maurya, Mohd Zaheer, Nawab Mohammad, Sadaf siddiqui, Mohd Zeeshan Khan, Mohd Ayan Akram.

May 2025 - Vol 13, Issue 3
Deep Learning-based Sentiment Analysis of Text using Long Short-Term Memory Networks

MD Shahid Ali, Saif Ali , Abdullah Parwez, Abu Sufiyan, Mohd Haroon.

May 2025 - Vol 13, Issue 3

Intuitive Language Learning Application Using IoT and ASL

Citations

Download Full Paper PDF

Total View 1913

Total Download 55