English
Related papers

Related papers: Towards an AI-Driven Video-Based American Sign Lan…

200 papers

Sign language is a fundamental means of communication for the deaf and hard-of-hearing (DHH) community, enabling nuanced expression through gestures, facial expressions, and body movements. Despite its critical role in facilitating…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Alexander Brettmann , Jakob Grävinghoff , Marlene Rüschoff , Marie Westhues

Accurate recognition and interpretation of sign language are crucial for enhancing communication accessibility for deaf and hard of hearing individuals. However, current approaches of Isolated Sign Language Recognition (ISLR) often face…

Computer Vision and Pattern Recognition · Computer Science 2025-05-14 Karina Kvanchiani , Roman Kraynov , Elizaveta Petrova , Petr Surovcev , Aleksandr Nagaev , Alexander Kapitanov

The target of this research is to experiment, iterate and recommend a system that is successful in recognition of American Sign Language (ASL). It is a challenging as well as an interesting problem that if solved will bring a leap in social…

Computer Vision and Pattern Recognition · Computer Science 2018-05-18 Dhruv Rathi

In this paper, a comparative experimental assessment of computer vision-based methods for sign language recognition is conducted. By implementing the most recent deep neural network methods in this field, a thorough evaluation on multiple…

This study investigates innovative interaction designs for communication and collaborative learning between learners of mixed hearing and signing abilities, leveraging advancements in mixed reality technologies like Apple Vision Pro and…

Human-Computer Interaction · Computer Science 2025-03-11 Si Chen , Haocong Cheng , Suzy Su , Stephanie Patterson , Raja Kushalnagar , Qi Wang , Yun Huang

Kenyan Sign Language (KSL) is the primary language used by the deaf community in Kenya. It is the medium of instruction from Pre-primary 1 to university among deaf learners, facilitating their education and academic achievement. Kenyan Sign…

Artificial Intelligence · Computer Science 2024-10-25 Lilian Wanzare , Joel Okutoyi , Maurine Kang'ahi , Mildred Ayere

Indian Sign Language has limited resources for developing machine learning and data-driven approaches for automated language processing. Though text/audio-based language processing techniques have shown colossal research interest and…

Computation and Language · Computer Science 2024-07-09 Abhinav Joshi , Romit Mohanty , Mounika Kanakanti , Andesha Mangla , Sudeep Choudhary , Monali Barbate , Ashutosh Modi

American Sign Language recognition is a difficult gesture recognition problem, characterized by fast, highly articulate gestures. These are comprised of arm movements with different hand shapes, facial expression and head movements. Among…

Computer Vision and Pattern Recognition · Computer Science 2020-03-20 Al Amin Hosain , Panneer Selvam Santhalingam , Parth Pathak , Huzefa Rangwala , Jana Kosecka

In this research, we present our findings to recognize American Sign Language from series of hand gestures. While most researches in literature focus only on static handshapes, our work target dynamic hand gestures. Since dynamic signs…

Computer Vision and Pattern Recognition · Computer Science 2022-05-26 Nguyen Huu Phong , Bernardete Ribeiro

This paper investigates RF-based system for automatic American Sign Language (ASL) recognition. We consider radar for ASL by joint spatio-temporal preprocessing of radar returns using time frequency (TF) analysis and high-resolution receive…

Signal Processing · Electrical Eng. & Systems 2022-04-01 Gavin MacLaughlin , Jack Malcolm , Syed Ali Hamza

This work dedicates to continuous sign language recognition (CSLR), which is a weakly supervised task dealing with the recognition of continuous signs from videos, without any prior knowledge about the temporal boundaries between…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Fangyun Wei , Yutong Chen

Since American Sign Language (ASL) has no standard written form, Deaf signers frequently share videos in order to communicate in their native language. However, since both hands and face convey critical linguistic information in signed…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Zhaoyang Xia , Carol Neidle , Dimitris N. Metaxas

Navigational signs are common aids for human wayfinding and scene understanding, but are underutilized by robots. We argue that they benefit robot navigation and scene understanding, by directly encoding privileged information on actions,…

Robotics · Computer Science 2025-09-17 Ayush Agrawal , Joel Loo , Nicky Zimmerman , David Hsu

Like spoken languages, a single sign language expression could correspond to multiple valid textual interpretations. Hence, learning a rigid one-to-one mapping for sign language translation (SLT) models might be inadequate, particularly in…

Multimedia · Computer Science 2024-10-28 Xin Shen , Lei Shen , Shaozu Yuan , Heming Du , Haiyang Sun , Xin Yu

Sign language is the primary communication language for people with disabling hearing loss. Sign language recognition (SLR) systems aim to recognize sign gestures and translate them into spoken language. One of the main challenges in SLR is…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Hasan Algafri , Hamzah Luqman , Sarah Alyami , Issam Laradji

Helping deaf and hard-of-hearing people communicate more easily is the main goal of Automatic Sign Language Translation. Although most past research has focused on turning sign language into text, doing the reverse, turning spoken English…

Computer Vision and Pattern Recognition · Computer Science 2025-07-10 Kazi Mahathir Rahman , Naveed Imtiaz Nafis , Md. Farhan Sadik , Mohammad Al Rafi , Mehedi Hasan Shahed

Deaf individuals face great challenges in today's society. It can be very difficult to be able to understand different forms of media without a sense of hearing. Many videos and movies found online today are not captioned, and even fewer…

Human-Computer Interaction · Computer Science 2019-09-06 Raja Kushalnagar , Matthew Seita , Abraham Glasser

Models of sign language have historically lagged behind those for spoken language (text and speech). Recent work has greatly improved their performance on tasks like sign language translation and isolated sign recognition. However, it…

Computation and Language · Computer Science 2026-05-01 Serpil Karabüklü , Kanishka Misra , Shester Gueuwou , Diane Brentari , Greg Shakhnarovich , Karen Livescu

Artificial agents, particularly humanoid robots, interact with their environment, objects, and people using cameras, actuators, and physical presence. Their communication methods are often pre-programmed, limiting their actions and…

Artificial Intelligence · Computer Science 2024-06-17 Federico Tavella , Aphrodite Galata , Angelo Cangelosi

Sign language to text is a crucial technology that can break down communication barriers for individuals with hearing difficulties. We replicate and try to improve on a recently published study. We evaluate models using BLEU and rBLEU…

Computation and Language · Computer Science 2024-02-13 Parsheeta Roy , Ji-Eun Han , Srishti Chouhan , Bhaavanaa Thumu
‹ Prev 1 3 4 5 6 7 10 Next ›