English
Related papers

Related papers: An Open-Source American Sign Language Fingerspell …

200 papers

The lack of fluency in sign language remains a barrier to seamless communication for hearing and speech-impaired communities. In this work, we propose a low-cost, real-time ASL-to-speech translation glove and an exhaustive training dataset…

Computation and Language · Computer Science 2024-07-22 Aditya Makkar , Divya Makkar , Aarav Patel , Liam Hebert

As part of the development of an educational tool that can help students achieve fluency in American Sign Language (ASL) through independent and interactive practice with immediate feedback, this paper introduces a near real-time system to…

Computer Vision and Pattern Recognition · Computer Science 2020-05-04 Elahe Vahdani , Longlong Jing , Yingli Tian , Matt Huenerfauth

This paper presents a real-time American Sign Language (ASL) recognition system utilizing a hybrid deep learning architecture combining 3D Convolutional Neural Networks (3D CNN) with Long Short-Term Memory (LSTM) networks. The system…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Dawnena Key

Many technologies for human-computer interaction have been designed for hearing individuals and depend upon vocalized speech, precluding users of American Sign Language (ASL) in the Deaf community from benefiting from these advancements.…

This works aims to design a statistical machine translation from English text to American Sign Language (ASL). The system is based on Moses tool with some modifications and the results are synthesized through a 3D avatar for interpretation.…

Computation and Language · Computer Science 2011-12-02 Achraf Othman , Mohamed Jemni

This paper presents a system which can recognise hand poses & gestures from the Indian Sign Language (ISL) in real-time using grid-based features. This system attempts to bridge the communication gap between the hearing and speech impaired…

Computer Vision and Pattern Recognition · Computer Science 2021-08-26 Kartik Shenoy , Tejas Dastane , Varun Rao , Devendra Vyavaharkar

We study the problem of recognizing video sequences of fingerspelled letters in American Sign Language (ASL). Fingerspelling comprises a significant but relatively understudied part of ASL. Recognizing fingerspelling is challenging for a…

Computation and Language · Computer Science 2016-09-27 Taehwan Kim , Jonathan Keane , Weiran Wang , Hao Tang , Jason Riggle , Gregory Shakhnarovich , Diane Brentari , Karen Livescu

In the past decades the set of human tasks that are solved by machines was extended dramatically. From simple image classification problems researchers now move towards solving more sophisticated and vital problems, like, autonomous driving…

Computer Vision and Pattern Recognition · Computer Science 2020-04-13 Evgeny Izutov

Sign language is a visual language used by the deaf and dumb community to communicate. However, for most recognition methods based on monocular cameras, the recognition accuracy is low and the robustness is poor. Even if the effect is good…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Zhiyu Long , Xingyou Liu , Jiaqi Qiao , Zhi Li

This research explores using lightweight deep neural network architectures to enable the humanoid robot Pepper to understand American Sign Language (ASL) and facilitate non-verbal human-robot interaction. First, we introduce a lightweight…

Robotics · Computer Science 2023-10-02 JongYoon Lim , Inkyu Sa , Bruce MacDonald , Ho Seok Ahn

American Sign Language recognition is a difficult gesture recognition problem, characterized by fast, highly articulate gestures. These are comprised of arm movements with different hand shapes, facial expression and head movements. Among…

Computer Vision and Pattern Recognition · Computer Science 2020-03-20 Al Amin Hosain , Panneer Selvam Santhalingam , Parth Pathak , Huzefa Rangwala , Jana Kosecka

In this thesis, we study the problem of recognizing video sequences of fingerspelled letters in American Sign Language (ASL). Fingerspelling comprises a significant but relatively understudied part of ASL, and recognizing it is challenging…

Computation and Language · Computer Science 2016-08-31 Taehwan Kim

Vision-based sign language recognition aims at helping deaf people to communicate with others. However, most existing sign language datasets are limited to a small number of words. Due to the limited vocabulary size, models learned from…

Computer Vision and Pattern Recognition · Computer Science 2020-01-22 Dongxu Li , Cristian Rodriguez Opazo , Xin Yu , Hongdong Li

In recent years, deep learning techniques have been used to develop sign language recognition systems, potentially serving as a communication tool for millions of hearing-impaired individuals worldwide. However, there are inherent…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Alvaro Leandro Cavalcante Carneiro , Denis Henrique Pinheiro Salvadeo , Lucas de Brito Silva

Sign language translation has historically been peripheral to mainstream machine translation research. In order to help converge the fields, we introduce FLEURS-ASL, an extension of the multiway parallel benchmarks FLORES (for text) and…

Computation and Language · Computer Science 2024-08-27 Garrett Tanzer

People with speech and hearing impairments often rely on sign language to communicate with others but most of the general population cannot understand sign language and sign language itself is a difficult language to learn, so there is a…

Human-Computer Interaction · Computer Science 2020-09-10 Sai Charan Bodda , Palki Gupta , Gaurav Joshi , Ayush Chaturvedi

Automatic Sign Language Recognition (ASLR) has emerged as a vital field for bridging the gap between deaf and hearing communities. However, the problem of sign-to-sign retrieval or detecting a specific sign within a sequence of continuous…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Samuel Ebimobowei Johnny , Blessed Guda , Emmanuel Enejo Aaron , Assane Gueye

Fingerspelling is a critical part of American Sign Language (ASL) recognition and has become an accessible optional text entry method for Deaf and Hard of Hearing (DHH) individuals. In this paper, we introduce SpellRing, a single smart ring…

In recent years, video conferencing applications have become increasingly prevalent, relying heavily on high-speed internet connectivity. When such connectivity is lacking, users often default to audio-only communication, a mode that…

Multimedia · Computer Science 2025-11-12 Panneer Selvam Santhalingam , Swann Thantsin , Ahmad Kamari , Parth Pathak , Kenneth DeHaan

Sign languages are essential for the Deaf and Hard-of-Hearing (DHH) community. Sign language generation systems have the potential to support communication by translating from written languages, such as English, into signed videos. However,…