English
Related papers

Related papers: A Comparative Study of Continuous Sign Language Re…

200 papers

Sign Language Recognition (SLR) is a fast-growing field that aims to fill the communication gaps between the hearing-impaired and people without hearing loss. Existing solutions for Persian Sign Language (PSL) are limited to word-level…

Human-Computer Interaction · Computer Science 2024-06-25 Amirparsa Salmankhah , Amirreza Rajabi , Negin Kheirmand , Ali Fadaeimanesh , Amirreza Tarabkhah , Amirreza Kazemzadeh , Hamed Farbeh

Prior work on Sign Language Translation has shown that having a mid-level sign gloss representation (effectively recognizing the individual signs) improves the translation performance drastically. In fact, the current state-of-the-art in…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Necati Cihan Camgoz , Oscar Koller , Simon Hadfield , Richard Bowden

A key challenge in continuous sign language recognition (CSLR) is to efficiently capture long-range spatial interactions over time from the video input. To address this challenge, we propose TCNet, a hybrid network that effectively models…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Hui Lu , Albert Ali Salah , Ronald Poppe

Accurate recognition and interpretation of sign language are crucial for enhancing communication accessibility for deaf and hard of hearing individuals. However, current approaches of Isolated Sign Language Recognition (ISLR) often face…

Computer Vision and Pattern Recognition · Computer Science 2025-05-14 Karina Kvanchiani , Roman Kraynov , Elizaveta Petrova , Petr Surovcev , Aleksandr Nagaev , Alexander Kapitanov

Sign language is a beautiful visual language and is also the primary language used by speaking and hearing-impaired people. However, sign language has many complex expressions, which are difficult for the public to understand and master.…

Computer Vision and Pattern Recognition · Computer Science 2022-04-20 Ronghui Li , Lu Meng

Word-level sign language recognition (WSLR) has attracted attention because it is expected to overcome the communication barrier between people with speech impairment and those who can hear. In the WSLR problem, a method designed for action…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Mizuki Maruyama , Shrey Singh , Katsufumi Inoue , Partha Pratim Roy , Masakazu Iwamura , Michifumi Yoshioka

Sign language recognition (SLR) plays a crucial role in bridging the communication gap between the hearing and vocally impaired community and the rest of the society. Word-level sign language recognition (WSLR) is the first important step…

Computer Vision and Pattern Recognition · Computer Science 2020-12-03 Anirudh Tunga , Sai Vidyaranya Nuthalapati , Juan Wachs

The complexity of Sign Language (SL) data processing brings many challenges. The current approach to recognition of SL signs aims to translate RGB sign language videos through pose information into Word-based ID Glosses, which serve to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Sen Fang , Yalin Feng , Chunyu Sui , Hongbin Zhong , Yanxin Zhang , Hongwei Yi , Hezhen Hu , Dimitris N. Metaxas

The performances of Sign Language Recognition (SLR) systems have improved considerably in recent years. However, several open challenges still need to be solved to allow SLR to be useful in practice. The research in the field is in its…

Computer Vision and Pattern Recognition · Computer Science 2021-05-12 Ozge Mercanoglu Sincan , Julio C. S. Jacques Junior , Sergio Escalera , Hacer Yalim Keles

In recent years, deep learning techniques have been used to develop sign language recognition systems, potentially serving as a communication tool for millions of hearing-impaired individuals worldwide. However, there are inherent…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Alvaro Leandro Cavalcante Carneiro , Denis Henrique Pinheiro Salvadeo , Lucas de Brito Silva

The increase of web-scale weakly labelled image-text pairs have greatly facilitated the development of large-scale vision-language models (e.g., CLIP), which have shown impressive generalization performance over a series of downstream…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Lianyu Hu , Tongkai Shi , Liqing Gao , Zekang Liu , Wei Feng

Communication barriers pose significant challenges for individuals with hearing and speech impairments, often limiting their ability to effectively interact in everyday environments. This project introduces a real-time assistive technology…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Brandone Fonya , Clarence Worrell

Sign language is the primary language for people with a hearing loss. Sign language recognition (SLR) is the automatic recognition of sign language, which represents a challenging problem for computers, though some progress has been made…

Computer Vision and Pattern Recognition · Computer Science 2021-03-10 Roman Töngi

This paper tackles the problem of zero-shot sign language recognition (ZSSLR), where the goal is to leverage models learned over the seen sign classes to recognize the instances of unseen sign classes. In this context, readily available…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Yunus Can Bilge , Ramazan Gokberk Cinbis , Nazli Ikizler-Cinbis

Continuous sign language recognition (CSLR) requires precise spatio-temporal modeling to accurately recognize sequences of gestures in videos. Existing frameworks often rely on CNN-based spatial backbones combined with temporal convolution…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Ahmed Abul Hasanaath , Hamzah Luqman

To promote inclusion and ensuring effective communication for those who rely on sign language as their main form of communication, sign language recognition (SLR) is crucial. Sign language recognition (SLR) seamlessly incorporates with…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 A. E. M Ridwan , Mushfiqul Islam Chowdhury , Mekhala Mariam Mary , Md Tahmid Chowdhury Abir

Sign language is one of the most effective communication tools for people with hearing difficulties. Most existing works focus on improving the performance of sign language tasks on RGB videos, which may suffer from degraded recording…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Pengyu Zhang , Hao Yin , Zeren Wang , Wenyue Chen , Shengming Li , Dong Wang , Huchuan Lu , Xu Jia

Continuous sign language recognition (CSLR) focuses on interpreting and transcribing sequences of sign language gestures in videos. In this work, we propose CLIP sign language adaptation (CLIP-SLA), a novel CSLR framework that leverages the…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Sarah Alyami , Hamzah Luqman

Sign language recognition (SLR) facilitates communication between deaf and hearing individuals. Deep learning is widely used to develop SLR-based systems; however, it is computationally intensive and requires substantial computational…

Robotics · Computer Science 2025-12-24 Nitin Kumar Singh , Arie Rachmad Syulistyo , Yuichiro Tanaka , Hakaru Tamukoh

There have been recent advances in computer-based recognition of isolated, citation-form signs from video. There are many challenges for such a task, not least the naturally occurring inter- and intra- signer synchronic variation in sign…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Carol Neidle