English

Sign Language Recognition System using TensorFlow Object Detection API

Computer Vision and Pattern Recognition 2022-03-04 v2 Artificial Intelligence Machine Learning Multimedia

Abstract

Communication is defined as the act of sharing or exchanging information, ideas or feelings. To establish communication between two people, both of them are required to have knowledge and understanding of a common language. But in the case of deaf and dumb people, the means of communication are different. Deaf is the inability to hear and dumb is the inability to speak. They communicate using sign language among themselves and with normal people but normal people do not take seriously the importance of sign language. Not everyone possesses the knowledge and understanding of sign language which makes communication difficult between a normal person and a deaf and dumb person. To overcome this barrier, one can build a model based on machine learning. A model can be trained to recognize different gestures of sign language and translate them into English. This will help a lot of people in communicating and conversing with deaf and dumb people. The existing Indian Sing Language Recognition systems are designed using machine learning algorithms with single and double-handed gestures but they are not real-time. In this paper, we propose a method to create an Indian Sign Language dataset using a webcam and then using transfer learning, train a TensorFlow model to create a real-time Sign Language Recognition system. The system achieves a good level of accuracy even with a limited size dataset.

Keywords

Cite

@article{arxiv.2201.01486,
  title  = {Sign Language Recognition System using TensorFlow Object Detection API},
  author = {Sharvani Srivastava and Amisha Gangwar and Richa Mishra and Sudhakar Singh},
  journal= {arXiv preprint arXiv:2201.01486},
  year   = {2022}
}

Comments

14 pages, 5 figures, ANTIC 2021

R2 v1 2026-06-24T08:40:36.197Z