English
Related papers

Related papers: Enhancing Sign Language Detection through Mediapip…

200 papers

People with vocal and hearing disabilities use sign language to express themselves using visual gestures and signs. Although sign language is a solution for communication difficulties faced by deaf people, there are still problems as most…

Computer Vision and Pattern Recognition · Computer Science 2023-05-01 Mallikharjuna Rao K , Harleen Kaur , Sanjam Kaur Bedi , M A Lekhana

The primary concern of this research is to take American Sign Language (ASL) data through real time camera footage and be able to convert the data and information into text. Adding to that, we are also putting focus on creating a framework…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Hasnat Jamil Bhuiyan , Mubtasim Fuad Mozumder , Md. Rabiul Islam Khan , Md. Sabbir Ahmed , Nabuat Zaman Nahim

As part of the development of an educational tool that can help students achieve fluency in American Sign Language (ASL) through independent and interactive practice with immediate feedback, this paper introduces a near real-time system to…

Computer Vision and Pattern Recognition · Computer Science 2020-05-04 Elahe Vahdani , Longlong Jing , Yingli Tian , Matt Huenerfauth

Sign language recognition (SLR) facilitates communication between deaf and hearing communities. Deep learning based SLR models are commonly used but require extensive computational resources, making them unsuitable for deployment on edge…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Nitin Kumar Singh , Arie Rachmad Syulistyo , Yuichiro Tanaka , Hakaru Tamukoh

The Arabic Sign Language has endorsed outstanding research achievements for identifying gestures and hand signs using the deep learning methodology. The term "forms of communication" refers to the actions used by hearing-impaired people to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-14 Rady El Rwelli , Osama R. Shahin , Ahmed I. Taloba

Many technologies for human-computer interaction have been designed for hearing individuals and depend upon vocalized speech, precluding users of American Sign Language (ASL) in the Deaf community from benefiting from these advancements.…

The automatic interpretation of sign languages is a challenging task, as it requires the usage of high-level vision and high-level motion processing systems for providing accurate image perception. In this paper, we use Convolutional Neural…

Computer Vision and Pattern Recognition · Computer Science 2020-10-16 Gustaf Halvardsson , Johanna Peterson , César Soto-Valero , Benoit Baudry

Sign language is a fundamental means of communication for the deaf and hard-of-hearing (DHH) community, enabling nuanced expression through gestures, facial expressions, and body movements. Despite its critical role in facilitating…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Alexander Brettmann , Jakob Grävinghoff , Marlene Rüschoff , Marie Westhues

Sign language recognition is a challenging gesture sequence recognition problem, characterized by quick and highly coarticulated motion. In this paper we focus on recognition of fingerspelling sequences in American Sign Language (ASL)…

Computer Vision and Pattern Recognition · Computer Science 2019-08-29 Bowen Shi , Aurora Martinez Del Rio , Jonathan Keane , Diane Brentari , Greg Shakhnarovich , Karen Livescu

Existing Sign Language Learning applications focus on the demonstration of the sign in the hope that the student will copy a sign correctly. In these cases, only a teacher can confirm that the sign was completed correctly, by reviewing a…

Machine Learning · Computer Science 2024-12-25 Nikita Louison , Wayne Goodridge , Koffka Khan

American Sign Language (ASL) uses a series of hand based gestures as a replacement for words to allow the deaf to communicate. Previous work has shown that although it takes longer to make signs than to say the equivalent words, on average…

Information Theory · Computer Science 2009-12-10 Andrew Chong , Lalitha Sankar , H. Vincent Poor

Automatic sign language recognition is an open problem that has received a lot of attention recently, not only because of its usefulness to signers, but also due to the numerous applications a sign classifier can have. In this article, we…

Computer Vision and Pattern Recognition · Computer Science 2015-03-20 Lucas Rioux-Maldague , Philippe Giguère

Hand gesture recognition possesses extensive applications in virtual reality, sign language recognition, and computer games. The direct interface of hand gestures provides us a new way for communicating with the virtual environment. In this…

Computer Vision and Pattern Recognition · Computer Science 2014-08-11 Reza Azad , Babak Azad , Iman Tavakoli Kazerooni

This paper introduces an open-source interface for American Sign Language fingerspell recognition and semantic pose retrieval, aimed to serve as a stepping stone towards more advanced sign language translation systems. Utilizing a…

Computation and Language · Computer Science 2024-08-20 Kevin Jose Thomas

In human interactions, hands are a powerful way of expressing information that, in some cases, can be used as a valid substitute for voice, as it happens in Sign Language. Hand gesture recognition has always been an interesting topic in the…

Computer Vision and Pattern Recognition · Computer Science 2019-07-26 Danilo Avola , Marco Bernardi , Luigi Cinque , Gian Luca Foresti , Cristiano Massaroni

Handshapes serve a fundamental phonological role in signed languages, with American Sign Language employing approximately 50 distinct shapes. However,computational approaches rarely model handshapes explicitly, limiting both recognition…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Alessa Carbo , Eric Nalisnick

Communicative efficiency is a key topic in linguistics and cognitive psychology, with many studies demonstrating how the pressure to communicate with minimal effort guides the form of natural language. However, this phenomenon is rarely…

Computation and Language · Computer Science 2024-06-11 Kayo Yin , Terry Regier , Dan Klein

In this paper, we develop four spiking neural network (SNN) models for two static American Sign Language (ASL) hand gesture classification tasks, i.e., the ASL Alphabet and ASL Digits. The SNN models are deployed on Intel's neuromorphic…

Machine Learning · Computer Science 2022-10-04 MohammadReza Mohammadi , Peyton Chandarana , James Seekings , Sara Hendrix , Ramtin Zand

The people in the world who are hearing impaired face many obstacles in communication and require an interpreter to comprehend what a person is saying. There has been constant scientific research and the existing models lack the ability to…

Computer Vision and Pattern Recognition · Computer Science 2022-12-08 Shubham Thakar , Samveg Shah , Bhavya Shah , Anant V. Nimkar

We study the problem of recognizing video sequences of fingerspelled letters in American Sign Language (ASL). Fingerspelling comprises a significant but relatively understudied part of ASL. Recognizing fingerspelling is challenging for a…

Computation and Language · Computer Science 2016-09-27 Taehwan Kim , Jonathan Keane , Weiran Wang , Hao Tang , Jason Riggle , Gregory Shakhnarovich , Diane Brentari , Karen Livescu