English
Related papers

Related papers: SpellRing: Recognizing Continuous Fingerspelling i…

200 papers

Fingerspelling poses challenges for sign language processing due to its high-frequency motion and use for open-vocabulary terms. While prior work has studied fingerspelling recognition, there has been little attention to evaluating how well…

Computation and Language · Computer Science 2024-08-14 Garrett Tanzer

The lack of fluency in sign language remains a barrier to seamless communication for hearing and speech-impaired communities. In this work, we propose a low-cost, real-time ASL-to-speech translation glove and an exhaustive training dataset…

Computation and Language · Computer Science 2024-07-22 Aditya Makkar , Divya Makkar , Aarav Patel , Liam Hebert

This research paper describes a realtime system for identifying American Sign Language (ASL) movements that employs modern computer vision and machine learning approaches. The suggested method makes use of the Mediapipe library for feature…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Rupesh Kumar , Ashutosh Bajpai , Ayush Sinha

Sign language, which conveys meaning through gestures, is the chief means of communication among deaf people. Recognizing sign language in natural settings presents significant challenges due to factors such as lighting, background clutter,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Bowen Shi

This paper presents a real-time American Sign Language (ASL) recognition system utilizing a hybrid deep learning architecture combining 3D Convolutional Neural Networks (3D CNN) with Long Short-Term Memory (LSTM) networks. The system…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Dawnena Key

This research combines MediaPipe and CNNs for the efficient and accurate interpretation of ASL dataset for the real-time detection of sign language. The system presented here captures and processes hands' gestures in real time. the intended…

Machine Learning · Computer Science 2024-08-28 Aditya Raj Verma , Gagandeep Singh , Karnim Meghwal , Banawath Ramji , Praveen Kumar Dadheech

Sign Language Recognition (SLR) plays a crucial role in bridging the communication gap between the hearing-impaired community and society. This paper introduces SLRNet, a real-time webcam-based ASL recognition system using MediaPipe…

Computer Vision and Pattern Recognition · Computer Science 2025-06-18 Sharvari Kamble

American Sign Language (ASL) uses a series of hand based gestures as a replacement for words to allow the deaf to communicate. Previous work has shown that although it takes longer to make signs than to say the equivalent words, on average…

Information Theory · Computer Science 2009-12-10 Andrew Chong , Lalitha Sankar , H. Vincent Poor

We use insights from research on American Sign Language (ASL) phonology to train models for isolated sign language recognition (ISLR), a step towards automatic sign language understanding. Our key insight is to explicitly recognize the role…

Computation and Language · Computer Science 2023-02-14 Lee Kezar , Jesse Thomason , Zed Sevcikova Sehyr

Sign Language Recognition (SLR) is a fast-growing field that aims to fill the communication gaps between the hearing-impaired and people without hearing loss. Existing solutions for Persian Sign Language (PSL) are limited to word-level…

Human-Computer Interaction · Computer Science 2024-06-25 Amirparsa Salmankhah , Amirreza Rajabi , Negin Kheirmand , Ali Fadaeimanesh , Amirreza Tarabkhah , Amirreza Kazemzadeh , Hamed Farbeh

A primary challenge for the deaf and hearing-impaired community stems from the communication gap with the hearing society, which can greatly impact their daily lives and result in social exclusion. To foster inclusivity in society, our…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Elisa Cabana

Sign Language Recognition (SLR) is an essential yet challenging task since sign language is performed with the fast and complex movement of hand gestures, body posture, and even facial expressions. %Skeleton Aware Multi-modal Sign Language…

Computer Vision and Pattern Recognition · Computer Science 2023-02-17 Maxim Novopoltsev , Leonid Verkhovtsev , Ruslan Murtazin , Dmitriy Milevich , Iuliia Zemtsova

This paper investigates RF-based system for automatic American Sign Language (ASL) recognition. We consider radar for ASL by joint spatio-temporal preprocessing of radar returns using time frequency (TF) analysis and high-resolution receive…

Signal Processing · Electrical Eng. & Systems 2022-04-01 Gavin MacLaughlin , Jack Malcolm , Syed Ali Hamza

People with vocal and hearing disabilities use sign language to express themselves using visual gestures and signs. Although sign language is a solution for communication difficulties faced by deaf people, there are still problems as most…

Computer Vision and Pattern Recognition · Computer Science 2023-05-01 Mallikharjuna Rao K , Harleen Kaur , Sanjam Kaur Bedi , M A Lekhana

There is an undeniable communication barrier between deaf people and people with normal hearing ability. Although innovations in sign language translation technology aim to tear down this communication barrier, the majority of existing sign…

Computer Vision and Pattern Recognition · Computer Science 2018-10-19 Biyi Fang , Jillian Co , Mi Zhang

We introduce a goal-oriented conversational AI system enhanced with American Sign Language (ASL) instructions, presenting the first implementation of such a system on a worldwide multimodal conversational AI platform. Accessible through a…

Computation and Language · Computer Science 2024-10-21 Mert İnan , Katherine Atwell , Anthony Sicilia , Lorna Quandt , Malihe Alikhani

Sign language is the primary communication language for people with disabling hearing loss. Sign language recognition (SLR) systems aim to recognize sign gestures and translate them into spoken language. One of the main challenges in SLR is…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Hasan Algafri , Hamzah Luqman , Sarah Alyami , Issam Laradji

People with speech and hearing impairments often rely on sign language to communicate with others but most of the general population cannot understand sign language and sign language itself is a difficult language to learn, so there is a…

Human-Computer Interaction · Computer Science 2020-09-10 Sai Charan Bodda , Palki Gupta , Gaurav Joshi , Ayush Chaturvedi

This paper introduces an open-source interface for American Sign Language fingerspell recognition and semantic pose retrieval, aimed to serve as a stepping stone towards more advanced sign language translation systems. Utilizing a…

Computation and Language · Computer Science 2024-08-20 Kevin Jose Thomas

The people in the world who are hearing impaired face many obstacles in communication and require an interpreter to comprehend what a person is saying. There has been constant scientific research and the existing models lack the ability to…

Computer Vision and Pattern Recognition · Computer Science 2022-12-08 Shubham Thakar , Samveg Shah , Bhavya Shah , Anant V. Nimkar