English
Related papers

Related papers: American Sign Language Recognition Using RF Sensin…

200 papers

American Sign Language (ASL) uses a series of hand based gestures as a replacement for words to allow the deaf to communicate. Previous work has shown that although it takes longer to make signs than to say the equivalent words, on average…

Information Theory · Computer Science 2009-12-10 Andrew Chong , Lalitha Sankar , H. Vincent Poor

In this paper, we propose a 3D Convolutional Neural Network (3DCNN) based multi-stream framework to recognize American Sign Language (ASL) manual signs (consisting of movements of the hands, as well as non-manual face movements in some…

Computer Vision and Pattern Recognition · Computer Science 2019-06-10 Longlong Jing , Elahe Vahdani , Matt Huenerfauth , Yingli Tian

In recent years, video conferencing applications have become increasingly prevalent, relying heavily on high-speed internet connectivity. When such connectivity is lacking, users often default to audio-only communication, a mode that…

Multimedia · Computer Science 2025-11-12 Panneer Selvam Santhalingam , Swann Thantsin , Ahmad Kamari , Parth Pathak , Kenneth DeHaan

With the recent advancements in intelligent personal assistants (IPAs), their popularity is rapidly increasing when it comes to utilizing Automatic Speech Recognition within households. In this study, we used a Wizard-of-Oz methodology to…

Human-Computer Interaction · Computer Science 2024-05-16 Nina Tran , Paige DeVries , Matthew Seita , Raja Kushalnagar , Abraham Glasser , Christian Vogler

Sign language is an essential resource enabling access to communication and proper socioemotional development for individuals suffering from disabling hearing loss. As this population is expected to reach 700 million by 2050, the importance…

Computer Vision and Pattern Recognition · Computer Science 2022-02-18 Cleison Correia de Amorim , Cleber Zanchettin

The Arabic Sign Language has endorsed outstanding research achievements for identifying gestures and hand signs using the deep learning methodology. The term "forms of communication" refers to the actions used by hearing-impaired people to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-14 Rady El Rwelli , Osama R. Shahin , Ahmed I. Taloba

We have come up with a research that hopes to provide a bridge between the users of American Sign Language and the users of spoken language and Indian Sign Language (ISL). The research enabled us to create a novel framework that we have…

Computation and Language · Computer Science 2024-11-20 Malay Kumar , S. Sarvajit Visagan , Tanish Sarang Mahajan , Anisha Natarajan

This research paper describes a realtime system for identifying American Sign Language (ASL) movements that employs modern computer vision and machine learning approaches. The suggested method makes use of the Mediapipe library for feature…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Rupesh Kumar , Ashutosh Bajpai , Ayush Sinha

Emotional voice communication plays a crucial role in effective daily interactions. Deaf and hard-of-hearing (DHH) individuals often rely on facial expressions to supplement sign language to convey emotions, as the use of voice is limited.…

Human-Computer Interaction · Computer Science 2024-12-10 Hyunchul Lim , Minghan Gao , Franklin Mingzhe Li , Nam Anh Dang , Ianip Sit , Michelle M Olson , Cheng Zhang

Despite tremendous progress in natural language processing using deep learning techniques in recent years, sign language production and comprehension has advanced very little. One critical barrier is the lack of largescale datasets…

Computation and Language · Computer Science 2022-10-14 Yehong Jiang

A machine can understand human activities, and the meaning of signs can help overcome the communication barriers between the inaudible and ordinary people. Sign Language Recognition (SLR) is a fascinating research area and a crucial task…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 M. Madhiarasan , Partha Pratim Roy

Sign language recognition (SLR) is a challenging problem, involving complex manual features, i.e., hand gestures, and fine-grained non-manual features (NMFs), i.e., facial expression, mouth shapes, etc. Although manual features are…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Hezhen Hu , Wengang Zhou , Junfu Pu , Houqiang Li

Sign languages are essential for the Deaf and Hard-of-Hearing (DHH) community. Sign language generation systems have the potential to support communication by translating from written languages, such as English, into signed videos. However,…

We present Large Sign Language Models (LSLM), a novel framework for translating 3D American Sign Language (ASL) by leveraging Large Language Models (LLMs) as the backbone, which can benefit hearing-impaired individuals' virtual…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Sen Zhang , Xiaoxiao He , Di Liu , Zhaoyang Xia , Mingyu Zhao , Chaowei Tan , Vivian Li , Bo Liu , Dimitris N. Metaxas , Mubbasir Kapadia

Accurate recognition and interpretation of sign language are crucial for enhancing communication accessibility for deaf and hard of hearing individuals. However, current approaches of Isolated Sign Language Recognition (ISLR) often face…

Computer Vision and Pattern Recognition · Computer Science 2025-05-14 Karina Kvanchiani , Roman Kraynov , Elizaveta Petrova , Petr Surovcev , Aleksandr Nagaev , Alexander Kapitanov

We introduce a goal-oriented conversational AI system enhanced with American Sign Language (ASL) instructions, presenting the first implementation of such a system on a worldwide multimodal conversational AI platform. Accessible through a…

Computation and Language · Computer Science 2024-10-21 Mert İnan , Katherine Atwell , Anthony Sicilia , Lorna Quandt , Malihe Alikhani

Sign language is the primary language for people with a hearing loss. Sign language recognition (SLR) is the automatic recognition of sign language, which represents a challenging problem for computers, though some progress has been made…

Computer Vision and Pattern Recognition · Computer Science 2021-03-10 Roman Töngi

Fingerspelling poses challenges for sign language processing due to its high-frequency motion and use for open-vocabulary terms. While prior work has studied fingerspelling recognition, there has been little attention to evaluating how well…

Computation and Language · Computer Science 2024-08-14 Garrett Tanzer

The lack of fluency in sign language remains a barrier to seamless communication for hearing and speech-impaired communities. In this work, we propose a low-cost, real-time ASL-to-speech translation glove and an exhaustive training dataset…

Computation and Language · Computer Science 2024-07-22 Aditya Makkar , Divya Makkar , Aarav Patel , Liam Hebert

Since American Sign Language (ASL) has no standard written form, Deaf signers frequently share videos in order to communicate in their native language. However, since both hands and face convey critical linguistic information in signed…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Zhaoyang Xia , Carol Neidle , Dimitris N. Metaxas