AI-BASED SIGN LANGUAGE TRANSLATOR FOR DEAF AND MUTE PEOPLE

Authors

  • Dr Pradeep K. Professor, Department of Electronics and Communication Engineering, Guru Nanak Dev Engineering College, Bidar, Karnataka, India
  • Shivani UG Student, Department of Electronics and Communication Engineering, Guru Nanak Dev Engineering College, Bidar, Karnataka, India
  • Bhavani UG Student, Department of Electronics and Communication Engineering, Guru Nanak Dev Engineering College, Bidar, Karnataka, India
  • Bhavani UG Student, Department of Electronics and Communication Engineering, Guru Nanak Dev Engineering College Bidar, Karnataka, India
  • Nishita UG Student, Department of Electronics and Communication Engineering, Guru Nanak Dev Engineering College, Bidar, Karnataka, India

Keywords:

Sign Language, Gesture Recognition, Arduino, Flex Sensors, Assistive Technology, Speech Output, Embedded Systems

Abstract

This paper presents a wearable sign language translation system aimed at improving communication for individuals with hearing and speech impairments. The system employs a glove embedded with flex sensors to capture finger movements and hand gestures. These inputs are processed using a microcontroller and matched with predefined gesture patterns. The interpreted output is displayed as text and converted into speech in real time. The design emphasizes affordability, portability, and ease of implementation. Experimental evaluation confirms that the system performs reliably for basic gesture recognition and provides an effective assistive communication solution.

References

I. T. Starner and A. Pentland, “Real-time American Sign Language recognition from video using hidden Markov models,” Proceedings of the International Symposium on Computer Vision, pp. 265–270, 1995.

II. P. Premaratne and Q. Nguyen, “Consumer electronics control system based on hand gesture moment invariants,” IET Computer Vision, vol. 1, no. 1, pp. 35–41, 2007.

III. S. Mitra and T. Acharya, “Gesture recognition: A survey,” IEEE Transactions on Systems, Man, and Cybernetics, vol. 37, no. 3, pp. 311–324, May 2007.

IV. A. M. K. Alam, M. I. Khan, and S. A. Mamun, “Hand gesture recognition for human–computer interaction,” International Journal of Computer Science and Network Security, vol. 12, no. 12, pp. 98–104, 2012.

V. R. Sharma, V. Pavlovic, and T. Huang, “Toward multimodal human–computer interface,” Proceedings of the IEEE, vol. 86, no. 5, pp. 853–869, May 1998.

VI. J. Wu and T. Huang, “Vision-based gesture recognition: A review,” Gesture-Based Communication in Human-Computer Interaction, Springer, pp. 103–115, 1999.

VII. N. D. Lane et al., “Deep learning for sensor-based activity recognition,” Proceedings of the 12th ACM Conference on Embedded Network Sensor Systems, pp. 1–14, 2014.

VIII. M. F. Rahman, M. H. Rahman, and M. R. Rahman, “Wearable glove-based sign language recognition system,” International Journal of Engineering Research and Technology (IJERT), vol. 6, no. 4, pp. 227–231, 2017.

Additional Files

Published

01-06-2026

How to Cite

Dr Pradeep K., Shivani, Bhavani, Bhavani, & Nishita. (2026). AI-BASED SIGN LANGUAGE TRANSLATOR FOR DEAF AND MUTE PEOPLE . International Educational Journal of Science and Engineering, 9(05), 164–168. Retrieved from https://iejse.com/journals/index.php/iejse/article/view/307

Issue

Vol. 9 No. 05 (2026): SPECIAL ISSUE MAY - NATIONAL CONFERENCE ON EMERGING TRENDS IN ENGINEERING, TECHNOLOGY AND MANAGEMENT

Section

Articles

License

Copyright (c) 2026 International Educational Journal of Science and Engineering

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.