English
Related papers

Related papers: Natural Language-Assisted Sign Language Recognitio…

200 papers

Sign language serves as a non-vocal means of communication, transmitting information and significance through gestures, facial expressions, and bodily movements. The majority of current approaches for sign language recognition (SLR) and…

Computer Vision and Pattern Recognition · Computer Science 2024-05-10 Mo Guan , Yan Wang , Guangkun Ma , Jiarui Liu , Mingzu Sun

In this paper, a comparative experimental assessment of computer vision-based methods for sign language recognition is conducted. By implementing the most recent deep neural network methods in this field, a thorough evaluation on multiple…

Sign Language Assessment (SLA) tools are useful to aid in language learning and are underdeveloped. Previous work has focused on isolated signs or comparison against a single reference video to assess Sign Languages (SL). This paper…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Oliver Cory , Ozge Mercanoglu Sincan , Matthew Vowels , Alessia Battisti , Franz Holzknecht , Katja Tissi , Sandra Sidler-Miserez , Tobias Haug , Sarah Ebling , Richard Bowden

Sign Language Translation (SLT) aims to map sign language videos to spoken language text. A common approach relies on gloss annotations as an intermediate representation, decomposing SLT into two sub-tasks: video-to-gloss recognition and…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Jianyuan Guo , Peike Li , Trevor Cohn

Sign language recognition is a challenging and often underestimated problem comprising multi-modal articulators (handshape, orientation, movement, upper body and face) that integrate asynchronously on multiple streams. Learning powerful…

Computer Vision and Pattern Recognition · Computer Science 2019-11-22 Hamid Reza Vaezi Joze , Oscar Koller

Language models for American Sign Language (ASL) could make language technologies substantially more accessible to those who sign. To train models on tasks such as isolated sign recognition (ISR) and ASL-to-English translation, datasets…

Computation and Language · Computer Science 2024-11-07 Lee Kezar , Nidhi Munikote , Zian Zeng , Zed Sehyr , Naomi Caselli , Jesse Thomason

We have come up with a research that hopes to provide a bridge between the users of American Sign Language and the users of spoken language and Indian Sign Language (ISL). The research enabled us to create a novel framework that we have…

Computation and Language · Computer Science 2024-11-20 Malay Kumar , S. Sarvajit Visagan , Tanish Sarang Mahajan , Anisha Natarajan

Sign Language Translation (SLT) is a challenging task due to its cross-domain nature, involving the translation of visual-gestural language to text. Many previous methods employ an intermediate representation, i.e., gloss sequences, to…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Benjia Zhou , Zhigang Chen , Albert Clapés , Jun Wan , Yanyan Liang , Sergio Escalera , Zhen Lei , Du Zhang

Sign language, which conveys meaning through gestures, is the chief means of communication among deaf people. Recognizing sign language in natural settings presents significant challenges due to factors such as lighting, background clutter,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Bowen Shi

Automatic sign language recognition (SLR) is an important topic within the areas of human-computer interaction and machine learning. On the one hand, it poses a complex challenge that requires the intervention of various knowledge areas,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Franco Ronchetti , Facundo Manuel Quiroga , César Estrebou , Laura Lanzarini , Alejandro Rosete

Sign language is a visual language used by the deaf and dumb community to communicate. However, for most recognition methods based on monocular cameras, the recognition accuracy is low and the robustness is poor. Even if the effect is good…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Zhiyu Long , Xingyou Liu , Jiaqi Qiao , Zhi Li

Many technologies for human-computer interaction have been designed for hearing individuals and depend upon vocalized speech, precluding users of American Sign Language (ASL) in the Deaf community from benefiting from these advancements.…

Sign language translation (SLT) is often decomposed into video-to-gloss recognition and gloss-to-text translation, where a gloss is a sequence of transcribed spoken-language words in the order in which they are signed. We focus here on…

Computation and Language · Computer Science 2021-05-18 Amit Moryossef , Kayo Yin , Graham Neubig , Yoav Goldberg

Sign Language Processing (SLP) is an interdisciplinary field comprised of Natural Language Processing (NLP) and Computer Vision. It is focused on the computational understanding, translation, and production of signed languages. Traditional…

Computation and Language · Computer Science 2024-12-04 Amit Moryossef

This paper explores the use of Propositional Dynamic Logic (PDL) as a suitable formal framework for describing Sign Language (SL), the language of deaf people, in the context of natural language processing. SLs are visual, complete,…

Computation and Language · Computer Science 2014-03-27 Arturo Curiel , Christophe Collet

Vision-based sign language recognition aims at helping deaf people to communicate with others. However, most existing sign language datasets are limited to a small number of words. Due to the limited vocabulary size, models learned from…

Computer Vision and Pattern Recognition · Computer Science 2020-01-22 Dongxu Li , Cristian Rodriguez Opazo , Xin Yu , Hongdong Li

Continuous sign language recognition (SLR) aims to translate a signing sequence into a sentence. It is very challenging as sign language is rich in vocabulary, while many among them contain similar gestures and motions. Moreover, it is…

Computer Vision and Pattern Recognition · Computer Science 2019-08-06 Zhaoyang Yang , Zhenmei Shi , Xiaoyong Shen , Yu-Wing Tai

Sign language is a visual language that encompasses all linguistic features of natural languages and serves as the primary communication method for the deaf and hard-of-hearing communities. Although many studies have successfully adapted…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Ronglai Zuo , Rolandos Alexandros Potamias , Evangelos Ververas , Jiankang Deng , Stefanos Zafeiriou

Sign language recognition (SLR) is a weakly supervised task that annotates sign videos as textual glosses. Recent studies show that insufficient training caused by the lack of large-scale available sign datasets becomes the main bottleneck…

Computer Vision and Pattern Recognition · Computer Science 2023-04-13 Jiangbin Zheng , Yile Wang , Cheng Tan , Siyuan Li , Ge Wang , Jun Xia , Yidong Chen , Stan Z. Li

This paper tackles the problem of zero-shot sign language recognition (ZSSLR), where the goal is to leverage models learned over the seen sign classes to recognize the instances of unseen sign classes. In this context, readily available…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Yunus Can Bilge , Ramazan Gokberk Cinbis , Nazli Ikizler-Cinbis