English
Related papers

Related papers: Toward American Sign Language Processing in the Re…

200 papers

Sign languages are the language of hearing-impaired people who use visuals like the hand, facial, and body movements for communication. There are different signs and gestures representing alphabets, words, and phrases. Nowadays…

Machine Learning · Computer Science 2024-11-08 Sharvani Srivastava , Sudhakar Singh , Pooja , Shiv Prakash

We introduce the problem of zero-shot sign language recognition (ZSSLR), where the goal is to leverage models learned over the seen sign class examples to recognize the instances of unseen signs. To this end, we propose to utilize the…

Computer Vision and Pattern Recognition · Computer Science 2019-07-25 Yunus Can Bilge , Nazli Ikizler-Cinbis , Ramazan Gokberk Cinbis

Inspired by recent developments in natural language processing, we propose a novel approach to sign language processing based on phonological properties validated by American Sign Language users. By taking advantage of datasets composed of…

Computation and Language · Computer Science 2024-07-25 Federico Tavella , Aphrodite Galata , Angelo Cangelosi

Sign language is the primary language for people with a hearing loss. Sign language recognition (SLR) is the automatic recognition of sign language, which represents a challenging problem for computers, though some progress has been made…

Computer Vision and Pattern Recognition · Computer Science 2021-03-10 Roman Töngi

Emotional voice communication plays a crucial role in effective daily interactions. Deaf and hard-of-hearing (DHH) individuals often rely on facial expressions to supplement sign language to convey emotions, as the use of voice is limited.…

Human-Computer Interaction · Computer Science 2024-12-10 Hyunchul Lim , Minghan Gao , Franklin Mingzhe Li , Nam Anh Dang , Ianip Sit , Michelle M Olson , Cheng Zhang

People with vocal and hearing disabilities use sign language to express themselves using visual gestures and signs. Although sign language is a solution for communication difficulties faced by deaf people, there are still problems as most…

Computer Vision and Pattern Recognition · Computer Science 2023-05-01 Mallikharjuna Rao K , Harleen Kaur , Sanjam Kaur Bedi , M A Lekhana

This paper presents a real-time American Sign Language (ASL) recognition system utilizing a hybrid deep learning architecture combining 3D Convolutional Neural Networks (3D CNN) with Long Short-Term Memory (LSTM) networks. The system…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Dawnena Key

Progress in machine understanding of sign languages has been slow and hampered by limited data. In this paper, we present FSboard, an American Sign Language fingerspelling dataset situated in a mobile text entry use case, collected from 147…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Manfred Georg , Garrett Tanzer , Saad Hassan , Maximus Shengelia , Esha Uboweja , Sam Sepah , Sean Forbes , Thad Starner

Despite tremendous progress in natural language processing using deep learning techniques in recent years, sign language production and comprehension has advanced very little. One critical barrier is the lack of largescale datasets…

Computation and Language · Computer Science 2022-10-14 Yehong Jiang

Sign languages are used as a primary language by approximately 70 million D/deaf people world-wide. However, most communication technologies operate in spoken and written languages, creating inequities in access. To help tackle this…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Aashaka Desai , Lauren Berger , Fyodor O. Minakov , Vanessa Milan , Chinmay Singh , Kriston Pumphrey , Richard E. Ladner , Hal Daumé , Alex X. Lu , Naomi Caselli , Danielle Bragg

We are releasing a dataset containing videos of both fluent and non-fluent signers using American Sign Language (ASL), which were collected using a Kinect v2 sensor. This dataset was collected as a part of a project to develop and evaluate…

Computation and Language · Computer Science 2022-07-11 Saad Hassan , Matthew Seita , Larwan Berke , Yingli Tian , Elaine Gale , Sooyeon Lee , Matt Huenerfauth

Language models for American Sign Language (ASL) could make language technologies substantially more accessible to those who sign. To train models on tasks such as isolated sign recognition (ISR) and ASL-to-English translation, datasets…

Computation and Language · Computer Science 2024-11-07 Lee Kezar , Nidhi Munikote , Zian Zeng , Zed Sehyr , Naomi Caselli , Jesse Thomason

Sign spotting, the task of identifying and localizing individual signs within continuous sign language video, plays a pivotal role in scaling dataset annotations and addressing the severe data scarcity issue in sign language translation.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 JianHe Low , Ozge Mercanoglu Sincan , Richard Bowden

Automatic Sign Language Translation requires the integration of both computer vision and natural language processing to effectively bridge the communication gap between sign and spoken languages. However, the deficiency in large-scale…

Computer Vision and Pattern Recognition · Computer Science 2024-05-08 Ryan Wong , Necati Cihan Camgoz , Richard Bowden

Sign language visual recognition from continuous multi-modal streams is still one of the most challenging fields. Recent advances in human actions recognition are exploiting the ascension of GPU-based learning from massive data, and are…

Computer Vision and Pattern Recognition · Computer Science 2020-09-23 Bassem Seddik , Najoua Essoukri Ben Amara

The deaf and hard of hearing community relies on American Sign Language (ASL) as their primary mode of communication, but communication with others who do not know ASL can be difficult, especially during emergencies where no interpreter is…

Image and Video Processing · Electrical Eng. & Systems 2023-05-12 Janice Nguyen , Y. Curtis Wang

Sign language is a visual language used by the deaf and dumb community to communicate. However, for most recognition methods based on monocular cameras, the recognition accuracy is low and the robustness is poor. Even if the effect is good…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Zhiyu Long , Xingyou Liu , Jiaqi Qiao , Zhi Li

Sign language processing technology development relies on extensive and reliable datasets, instructions, and ethical guidelines. We present a comprehensive Azerbaijani Sign Language Dataset (AzSLD) collected from diverse sign language users…

Computation and Language · Computer Science 2025-01-16 Nigar Alishzade , Jamaladdin Hasanov

Sign language is an essential resource enabling access to communication and proper socioemotional development for individuals suffering from disabling hearing loss. As this population is expected to reach 700 million by 2050, the importance…

Computer Vision and Pattern Recognition · Computer Science 2022-02-18 Cleison Correia de Amorim , Cleber Zanchettin

Fingerspelling is a critical part of American Sign Language (ASL) recognition and has become an accessible optional text entry method for Deaf and Hard of Hearing (DHH) individuals. In this paper, we introduce SpellRing, a single smart ring…