English
Related papers

Related papers: SLRNet: A Real-Time LSTM-Based Sign Language Recog…

200 papers

The hearing-impaired community in India deserves the access to tools that help them communicate, however, there is limited known technology solutions that make use of Indian Sign Language (ISL) at present. Even though there are many ISL…

Machine Learning · Computer Science 2024-12-11 Smruti Jagtap , Kanika Jadhav , Rushikesh Temkar , Minal Deshmukh

Sign language is a set of gestures that deaf people use to communicate. Unfortunately, normal people don't understand it, which creates a communication gap that needs to be filled. Because of the variations in (Egyptian Sign Language) ESL…

Computer Vision and Pattern Recognition · Computer Science 2021-12-27 Ahmed Elhagry , Rawan Glalal Elrayes

Many technologies for human-computer interaction have been designed for hearing individuals and depend upon vocalized speech, precluding users of American Sign Language (ASL) in the Deaf community from benefiting from these advancements.…

As part of the development of an educational tool that can help students achieve fluency in American Sign Language (ASL) through independent and interactive practice with immediate feedback, this paper introduces a near real-time system to…

Computer Vision and Pattern Recognition · Computer Science 2020-05-04 Elahe Vahdani , Longlong Jing , Yingli Tian , Matt Huenerfauth

Research on continuous sign language recognition (CSLR) is essential to bridge the communication gap between deaf and hearing individuals. Numerous previous studies have trained their models using the connectionist temporal classification…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Ronglai Zuo , Fangyun Wei , Brian Mak

The recent surge in large language models has automated translations of spoken and written languages. However, these advances remain largely inaccessible to American Sign Language (ASL) users, whose language relies on complex visual cues.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Daniel Perkins , Davis Hunter , Dhrumil Patel , Galen Flanagan

Sign language recognition could significantly improve the user experience for d/Deaf people with the general consumer technology, such as IoT devices or videoconferencing. However, current sign language recognition architectures are usually…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Matyáš Boháček , Zhuo Cao , Marek Hrúz

Sign language recognition (SLR) plays a vital role in facilitating communication for the hearing-impaired community. SLR is a weakly supervised task where entire videos are annotated with glosses, making it challenging to identify the…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Hao Chen , Jiaze Wang , Ziyu Guo , Jinpeng Li , Donghao Zhou , Bian Wu , Chenyong Guan , Guangyong Chen , Pheng-Ann Heng

Sign language serves as the primary meaning of communication for the deaf-mute community. Different from spoken language, it commonly conveys information by the collaboration of manual features, i.e., hand gestures and body movements, and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-19 Wengang Zhou , Weichao Zhao , Hezhen Hu , Zecheng Li , Houqiang Li

In the past decades the set of human tasks that are solved by machines was extended dramatically. From simple image classification problems researchers now move towards solving more sophisticated and vital problems, like, autonomous driving…

Computer Vision and Pattern Recognition · Computer Science 2020-04-13 Evgeny Izutov

Sign language recognition is important for natural and convenient communication between deaf community and hearing majority. We take the highly efficient initial step of automatic fingerspelling recognition system using convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2015-10-15 Byeongkeun Kang , Subarna Tripathi , Truong Q. Nguyen

Hand gesture-based Sign Language Recognition (SLR) serves as a crucial communication bridge between deaf and non-deaf individuals. While Graph Convolutional Networks (GCNs) are common, they are limited by their reliance on fixed skeletal…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Koki Hirooka , Abu Saleh Musa Miah , Tatsuya Murakami , Md. Al Mehedi Hasan , Yong Seok Hwang , Jungpil Shin

It has always been a rather tough task to communicate with someone possessing a hearing impairment. One of the most tested ways to establish such a communication is through the use of sign based languages. However, not many people are aware…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Sharanya Mukherjee , Md Hishaam Akhtar , Kannadasan R

Language models for American Sign Language (ASL) could make language technologies substantially more accessible to those who sign. To train models on tasks such as isolated sign recognition (ISR) and ASL-to-English translation, datasets…

Computation and Language · Computer Science 2024-11-07 Lee Kezar , Nidhi Munikote , Zian Zeng , Zed Sehyr , Naomi Caselli , Jesse Thomason

The complexity of Sign Language (SL) data processing brings many challenges. The current approach to recognition of SL signs aims to translate RGB sign language videos through pose information into Word-based ID Glosses, which serve to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Sen Fang , Yalin Feng , Chunyu Sui , Hongbin Zhong , Yanxin Zhang , Hongwei Yi , Hezhen Hu , Dimitris N. Metaxas

In this paper, we propose a 3D Convolutional Neural Network (3DCNN) based multi-stream framework to recognize American Sign Language (ASL) manual signs (consisting of movements of the hands, as well as non-manual face movements in some…

Computer Vision and Pattern Recognition · Computer Science 2019-06-10 Longlong Jing , Elahe Vahdani , Matt Huenerfauth , Yingli Tian

The American Sign Language Linguistic Research Project (ASLLRP) provides Internet access to high-quality ASL video data, generally including front and side views and a close-up of the face. The manual and non-manual components of the…

Computation and Language · Computer Science 2022-01-21 Carol Neidle , Augustine Opoku , Dimitris Metaxas

Spoken language recognition (SLR) is the task of automatically identifying the language present in a speech signal. Existing SLR models are either too computationally expensive or too large to run effectively on devices with limited…

Computation and Language · Computer Science 2023-06-06 Oriol Nieto , Zeyu Jin , Franck Dernoncourt , Justin Salamon

Existing Sign Language Learning applications focus on the demonstration of the sign in the hope that the student will copy a sign correctly. In these cases, only a teacher can confirm that the sign was completed correctly, by reviewing a…

Machine Learning · Computer Science 2024-12-25 Nikita Louison , Wayne Goodridge , Koffka Khan

This study presents a novel approach for enhancing American Sign Language (ASL) recognition using Graph Convolutional Networks (GCNs) integrated with successive residual connections. The method leverages the MediaPipe framework to extract…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Ushnish Sarkar , Archisman Chakraborti , Tapas Samanta , Sarbajit Pal , Amitabha Das