English
Related papers

Related papers: Global-local Enhancement Network for NMFs-aware Si…

200 papers

Sign language recognition (SLR) refers to interpreting sign language glosses from given videos automatically. This research area presents a complex challenge in computer vision because of the rapid and intricate movements inherent in sign…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Muxin Pu , Mei Kuan Lim , Chun Yong Chong

Many technologies for human-computer interaction have been designed for hearing individuals and depend upon vocalized speech, precluding users of American Sign Language (ASL) in the Deaf community from benefiting from these advancements.…

Sign Languages are expressed through hand and upper body gestures as well as facial expressions. Therefore, Sign Language Recognition (SLR) needs to focus on all such cues. Previous work uses hand-crafted mechanisms or network aggregation…

Computer Vision and Pattern Recognition · Computer Science 2020-09-30 Çağrı Gökçe , Oğulcan Özdemir , Ahmet Alp Kındıroğlu , Lale Akarun

People with vocal and hearing disabilities use sign language to express themselves using visual gestures and signs. Although sign language is a solution for communication difficulties faced by deaf people, there are still problems as most…

Computer Vision and Pattern Recognition · Computer Science 2023-05-01 Mallikharjuna Rao K , Harleen Kaur , Sanjam Kaur Bedi , M A Lekhana

Non-manual facial features play a crucial role in sign language communication, yet their importance in automatic sign language recognition (ASLR) remains underexplored. While prior studies have shown that incorporating facial features can…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Dinh Nam Pham , Eleftherios Avramidis

Due to the emergence of many sign language datasets, isolated sign language recognition (ISLR) has made significant progress in recent years. In addition, the development of various advanced deep neural networks is another reason for this…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Siyuan Jing , Guangxue Wang , Haoyang Zhai , Qin Tao , Jun Yang , Bing Wang , Peng Jin

As part of the development of an educational tool that can help students achieve fluency in American Sign Language (ASL) through independent and interactive practice with immediate feedback, this paper introduces a near real-time system to…

Computer Vision and Pattern Recognition · Computer Science 2020-05-04 Elahe Vahdani , Longlong Jing , Yingli Tian , Matt Huenerfauth

Sign language is a visual language used by the deaf and dumb community to communicate. However, for most recognition methods based on monocular cameras, the recognition accuracy is low and the robustness is poor. Even if the effect is good…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Zhiyu Long , Xingyou Liu , Jiaqi Qiao , Zhi Li

Sign language translation (SLT), which generates text in a spoken language from visual content in a sign language, is important to assist the hard-of-hearing community for their communications. Inspired by neural machine translation (NMT),…

Computer Vision and Pattern Recognition · Computer Science 2021-11-16 Jichao Kan , Kun Hu , Markus Hagenbuchner , Ah Chung Tsoi , Mohammed Bennamounm , Zhiyong Wang

Sign languages serve as essential communication systems for individuals with hearing and speech impairments. However, digital linguistic dataset resources for underrepresented sign languages, such as Nepali Sign Language (NSL), remain…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Birat Poudel , Satyam Ghimire , Sijan Bhattarai , Saurav Bhandari , Suramya Sharma Dahal

Signed Language Processing (SLP) concerns the automated processing of signed languages, the main means of communication of Deaf and hearing impaired individuals. SLP features many different tasks, ranging from sign recognition to…

Computation and Language · Computer Science 2024-07-25 Federico Tavella , Viktor Schlegel , Marta Romeo , Aphrodite Galata , Angelo Cangelosi

Sign language recognition is a challenging and often underestimated problem comprising multi-modal articulators (handshape, orientation, movement, upper body and face) that integrate asynchronously on multiple streams. Learning powerful…

Computer Vision and Pattern Recognition · Computer Science 2019-11-22 Hamid Reza Vaezi Joze , Oscar Koller

Sign language is commonly used by deaf or speech impaired people to communicate but requires significant effort to master. Sign Language Recognition (SLR) aims to bridge the gap between sign language users and others by recognizing signs…

Computer Vision and Pattern Recognition · Computer Science 2021-05-04 Songyao Jiang , Bin Sun , Lichen Wang , Yue Bai , Kunpeng Li , Yun Fu

In this paper, we propose a 3D Convolutional Neural Network (3DCNN) based multi-stream framework to recognize American Sign Language (ASL) manual signs (consisting of movements of the hands, as well as non-manual face movements in some…

Computer Vision and Pattern Recognition · Computer Science 2019-06-10 Longlong Jing , Elahe Vahdani , Matt Huenerfauth , Yingli Tian

Accurate recognition and interpretation of sign language are crucial for enhancing communication accessibility for deaf and hard of hearing individuals. However, current approaches of Isolated Sign Language Recognition (ISLR) often face…

Computer Vision and Pattern Recognition · Computer Science 2025-05-14 Karina Kvanchiani , Roman Kraynov , Elizaveta Petrova , Petr Surovcev , Aleksandr Nagaev , Alexander Kapitanov

Sign language recognition (SLR) faces fundamental challenges in creating accurate annotations due to the inherent complexity of simultaneous manual and non-manual signals. To the best of our knowledge, this is the first work to integrate…

Computation and Language · Computer Science 2025-07-23 Siyu Liang , Yunan Li , Wentian Xin , Huizhou Chen , Xujie Liu , Kang Liu , Qiguang Miao

Sign languages are visual languages using manual articulations and non-manual elements to convey information. For sign language recognition and translation, the majority of existing approaches directly encode RGB videos into hidden…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Yutong Chen , Ronglai Zuo , Fangyun Wei , Yu Wu , Shujie Liu , Brian Mak

Isolated Sign Language Recognition (ISLR) is crucial for scalable sign language technology, yet language-specific approaches limit current models. To address this, we propose a one-shot learning approach that generalises across languages…

Computation and Language · Computer Science 2025-02-28 Toon Vandendriessche , Mathieu De Coster , Annelies Lejon , Joni Dambre

To promote inclusion and ensuring effective communication for those who rely on sign language as their main form of communication, sign language recognition (SLR) is crucial. Sign language recognition (SLR) seamlessly incorporates with…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 A. E. M Ridwan , Mushfiqul Islam Chowdhury , Mekhala Mariam Mary , Md Tahmid Chowdhury Abir

Research on continuous sign language recognition (CSLR) is essential to bridge the communication gap between deaf and hearing individuals. Numerous previous studies have trained their models using the connectionist temporal classification…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Ronglai Zuo , Fangyun Wei , Brian Mak