English
Related papers

Related papers: Sign Language Recognition System using TensorFlow …

200 papers

Through this paper, we seek to reduce the communication barrier between the hearing-impaired community and the larger society who are usually not familiar with sign language in the sub-Saharan region of Africa with the largest occurrences…

Computer Vision and Pattern Recognition · Computer Science 2022-08-16 Steven Kolawole , Opeyemi Osakuade , Nayan Saxena , Babatunde Kazeem Olorisade

Sign language is the primary approach of communication for the Deaf and Hard-of-Hearing (DHH) community. While there are numerous benchmarks for high-resource sign languages, low-resource languages like Arabic remain underrepresented.…

Computation and Language · Computer Science 2026-04-01 Mohammad Amer Khalil , Raghad Nahas , Ahmad Nassar , Khloud Al Jallad

Communication between deaf users, visually im paired users, and the general hearing population often relies on tools that support only one direction of interaction. To address this limitation, this work presents Sanvaad, a lightweight…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Kush Revankar , Shreyas Deshpande , Araham Sayeed , Ansh Tandale , Sarika Bobde

The deaf and hard of hearing community relies on American Sign Language (ASL) as their primary mode of communication, but communication with others who do not know ASL can be difficult, especially during emergencies where no interpreter is…

Image and Video Processing · Electrical Eng. & Systems 2023-05-12 Janice Nguyen , Y. Curtis Wang

Sign Language Recognition (SLR) is an important step in facilitating the communication among deaf people and the rest of society. Existing Persian sign language recognition systems are mainly restricted to static signs which are not very…

Computer Vision and Pattern Recognition · Computer Science 2019-12-05 Saeideh Ghanbari Azar , Hadi Seyedarabi

This research explores using lightweight deep neural network architectures to enable the humanoid robot Pepper to understand American Sign Language (ASL) and facilitate non-verbal human-robot interaction. First, we introduce a lightweight…

Robotics · Computer Science 2023-10-02 JongYoon Lim , Inkyu Sa , Bruce MacDonald , Ho Seok Ahn

This paper presents a system which can recognise hand poses & gestures from the Indian Sign Language (ISL) in real-time using grid-based features. This system attempts to bridge the communication gap between the hearing and speech impaired…

Computer Vision and Pattern Recognition · Computer Science 2021-08-26 Kartik Shenoy , Tejas Dastane , Varun Rao , Devendra Vyavaharkar

Since American Sign Language (ASL) has no standard written form, Deaf signers frequently share videos in order to communicate in their native language. However, since both hands and face convey critical linguistic information in signed…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Zhaoyang Xia , Carol Neidle , Dimitris N. Metaxas

Isolated Sign Language Recognition (ISLR) is crucial for scalable sign language technology, yet language-specific approaches limit current models. To address this, we propose a one-shot learning approach that generalises across languages…

Computation and Language · Computer Science 2025-02-28 Toon Vandendriessche , Mathieu De Coster , Annelies Lejon , Joni Dambre

Visual-to-auditory sensory substitution devices can assist the blind in sensing the visual environment by translating the visual information into a sound pattern. To improve the translation quality, the task performances of the blind are…

Computer Vision and Pattern Recognition · Computer Science 2019-04-22 Di Hu , Dong Wang , Xuelong Li , Feiping Nie , Qi Wang

Sign language is commonly used by deaf or speech impaired people to communicate but requires significant effort to master. Sign Language Recognition (SLR) aims to bridge the gap between sign language users and others by recognizing signs…

Computer Vision and Pattern Recognition · Computer Science 2021-05-04 Songyao Jiang , Bin Sun , Lichen Wang , Yue Bai , Kunpeng Li , Yun Fu

This paper presents an Arabic Alphabet Sign Language recognition approach, using deep learning methods in conjunction with transfer learning and transformer-based models. We study the performance of the different variants on two publicly…

Computer Vision and Pattern Recognition · Computer Science 2024-10-02 Mazen Balat , Rewaa Awaad , Hend Adel , Ahmed B. Zaky , Salah A. Aly

This paper explores the critical but often overlooked role of non-verbal cues, including co-speech gestures and facial expressions, in human communication and their implications for Natural Language Processing (NLP). We argue that…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-14 Amit Moryossef

We introduce a goal-oriented conversational AI system enhanced with American Sign Language (ASL) instructions, presenting the first implementation of such a system on a worldwide multimodal conversational AI platform. Accessible through a…

Computation and Language · Computer Science 2024-10-21 Mert İnan , Katherine Atwell , Anthony Sicilia , Lorna Quandt , Malihe Alikhani

Historically, sign language machine translation has been posed as a sentence-level task: datasets consisting of continuous narratives are chopped up and presented to the model as isolated clips. In this work, we explore the limitations of…

Computation and Language · Computer Science 2024-06-18 Garrett Tanzer , Maximus Shengelia , Ken Harrenstien , David Uthus

Technological advancements and innovations are advancing our daily life in all the ways possible but there is a larger section of society who are deprived of accessing the benefits due to their physical inabilities. To reap the real…

Computation and Language · Computer Science 2024-05-14 Abhinand K. , Abhiram B. Nair , Dhananjay C. , Hanan Hamza , Mohammed Fawaz J. , Rahma Fahim K. , Anoop V. S

Sign Language is used by the deaf community all over world. The work presented here proposes a novel one-dimensional deep capsule network (CapsNet) architecture for continuous Indian Sign Language recognition by means of signals obtained…

Signal Processing · Electrical Eng. & Systems 2020-05-04 Karush Suri , Rinki Gupta

Sign Language Production (SLP) is the tough task of turning sign language into sign videos. The main goal of SLP is to create these videos using a sign gloss. In this research, we've developed a new method to make high-quality sign videos…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Pan Xie , Taiyi Peng , Yao Du , Qipeng Zhang

Sign language recognition is a challenging gesture sequence recognition problem, characterized by quick and highly coarticulated motion. In this paper we focus on recognition of fingerspelling sequences in American Sign Language (ASL)…

Computer Vision and Pattern Recognition · Computer Science 2019-08-29 Bowen Shi , Aurora Martinez Del Rio , Jonathan Keane , Diane Brentari , Greg Shakhnarovich , Karen Livescu

Automatic speech recognition and spoken dialogue systems have made great advances through the use of deep machine learning methods. This is partly due to greater computing power but also through the large amount of data available in common…

Computation and Language · Computer Science 2020-06-04 Boris Mocialov , Graham Turner , Helen Hastie