English
Related papers

Related papers: Recognizing American Sign Language Nonmanual Signa…

200 papers

Sign Language Recognition (SLR) is an important step in facilitating the communication among deaf people and the rest of society. Existing Persian sign language recognition systems are mainly restricted to static signs which are not very…

Computer Vision and Pattern Recognition · Computer Science 2019-12-05 Saeideh Ghanbari Azar , Hadi Seyedarabi

Our objective is to translate continuous sign language into spoken language text. Inspired by the way human interpreters rely on context for accurate translation, we incorporate additional contextual cues together with the signing video,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Youngjoon Jang , Haran Raajesh , Liliane Momeni , Gül Varol , Andrew Zisserman

Sign Language Recognition (SLR) has garnered significant attention from researchers in recent years, particularly the intricate domain of Continuous Sign Language Recognition (CSLR), which presents heightened complexity compared to Isolated…

Computer Vision and Pattern Recognition · Computer Science 2024-02-23 Razieh Rastgoo , Kourosh Kiani , Sergio Escalera

Sign language recognition (SLR) refers to interpreting sign language glosses from given videos automatically. This research area presents a complex challenge in computer vision because of the rapid and intricate movements inherent in sign…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Muxin Pu , Mei Kuan Lim , Chun Yong Chong

This paper proposes an attentional network for the task of Continuous Sign Language Recognition. The proposed approach exploits co-independent streams of data to model the sign language modalities. These different channels of information…

Computer Vision and Pattern Recognition · Computer Science 2021-01-13 Fares Ben Slimane , Mohamed Bouguessa

In this paper, we propose a set of features called temporal accumulative features (TAF) for representing and recognizing isolated sign language gestures. By incorporating sign language specific constructs to better represent the unique…

Computer Vision and Pattern Recognition · Computer Science 2020-04-06 Ahmet Alp Kındıroğlu , Oğulcan Özdemir , Lale Akarun

Sign language recognition has attracted the interest of researchers in recent years. While numerous approaches have been proposed for European and Asian sign languages recognition, very limited attempts have been made to develop similar…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Hamzah Luqman

Most sign language translation (SLT) methods to date require the use of gloss annotations to provide additional supervision information, however, the acquisition of gloss is not easy. To solve this problem, we first perform an analysis of…

Computer Vision and Pattern Recognition · Computer Science 2023-07-17 Aoxiong Yin , Tianyun Zhong , Li Tang , Weike Jin , Tao Jin , Zhou Zhao

Sign language is a beautiful visual language and is also the primary language used by speaking and hearing-impaired people. However, sign language has many complex expressions, which are difficult for the public to understand and master.…

Computer Vision and Pattern Recognition · Computer Science 2022-04-20 Ronghui Li , Lu Meng

Correctly recognizing the behaviors of children with Autism Spectrum Disorder (ASD) is of vital importance for the diagnosis of Autism and timely early intervention. However, the observation and recording during the treatment from the…

Computer Vision and Pattern Recognition · Computer Science 2024-01-08 Andong Deng , Taojiannan Yang , Chen Chen , Qian Chen , Leslie Neely , Sakiko Oyama

In this paper, we propose SignLLM, a multilingual Sign Language Production (SLP) large language model, which includes two novel multilingual SLP modes MLSF and Prompt2LangGloss that allow sign language gestures generation from query texts…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Sen Fang , Chen Chen , Lei Wang , Ce Zheng , Chunyu Sui , Yapeng Tian

This works aims to design a statistical machine translation from English text to American Sign Language (ASL). The system is based on Moses tool with some modifications and the results are synthesized through a 3D avatar for interpretation.…

Computation and Language · Computer Science 2011-12-02 Achraf Othman , Mohamed Jemni

The Arabic Sign Language has endorsed outstanding research achievements for identifying gestures and hand signs using the deep learning methodology. The term "forms of communication" refers to the actions used by hearing-impaired people to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-14 Rady El Rwelli , Osama R. Shahin , Ahmed I. Taloba

This paper tackles the problem of zero-shot sign language recognition (ZSSLR), where the goal is to leverage models learned over the seen sign classes to recognize the instances of unseen sign classes. In this context, readily available…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Yunus Can Bilge , Ramazan Gokberk Cinbis , Nazli Ikizler-Cinbis

Sign Language Translation (SLT) aims to map sign language videos to spoken language text. A common approach relies on gloss annotations as an intermediate representation, decomposing SLT into two sub-tasks: video-to-gloss recognition and…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Jianyuan Guo , Peike Li , Trevor Cohn

Continuous sign language recognition (SLR) deals with unaligned video-text pair and uses the word error rate (WER), i.e., edit distance, as the main evaluation metric. Since it is not differentiable, we usually instead optimize the learning…

Computer Vision and Pattern Recognition · Computer Science 2020-10-13 Junfu Pu , Wengang Zhou , Hezhen Hu , Houqiang Li

SLVideo is a video moment retrieval system for Sign Language videos that incorporates facial expressions, addressing this gap in existing technology. The system extracts embedding representations for the hand and face signs from video…

Computer Vision and Pattern Recognition · Computer Science 2024-11-07 Gonçalo Vinagre Martins , João Magalhães , Afonso Quinaz , Carla Viegas , Sofia Cavaco

Research on continuous sign language recognition (CSLR) is essential to bridge the communication gap between deaf and hearing individuals. Numerous previous studies have trained their models using the connectionist temporal classification…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Ronglai Zuo , Fangyun Wei , Brian Mak

. Continuous Sign Language Recognition (CSLR) is a long challenging task in Computer Vision due to the difficulties in detecting the explicit boundaries between the words in a sign sentence. To deal with this challenge, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Razieh Rastgoo , Kourosh Kiani , Sergio Escalera

Isolated Sign Language Recognition (ISLR) approaches primarily rely on RGB data or signer pose information. However, combining these modalities often results in the loss of crucial details, such as hand shape and orientation, due to…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Sven Schreiber , Noha Sarhan , Simone Frintrop , Christian Wilms