English
Related papers

Related papers: Sign Language Recognition and Translation for Low-…

200 papers

In the era of AI-driven language technologies, the participation of deaf communities in sign language technology development, often framed as co-creation, is increasingly emphasized. We present a reflexive case study of two Horizon 2020…

Computation and Language · Computer Science 2025-11-14 Maartje De Meulder , Davy Van Landuyt , Rehana Omardeen

The recognition of sign language is a challenging task with an important role in society to facilitate the communication of deaf persons. We propose a new approach of Spatial-Temporal Graph Convolutional Network to sign language recognition…

Machine Learning · Computer Science 2020-05-21 Cleison Correia de Amorim , David Macêdo , Cleber Zanchettin

Research on continuous sign language recognition (CSLR) is essential to bridge the communication gap between deaf and hearing individuals. Numerous previous studies have trained their models using the connectionist temporal classification…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Ronglai Zuo , Fangyun Wei , Brian Mak

Since American Sign Language (ASL) has no standard written form, Deaf signers frequently share videos in order to communicate in their native language. However, since both hands and face convey critical linguistic information in signed…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Zhaoyang Xia , Carol Neidle , Dimitris N. Metaxas

Sign language recognition (SLR) is a challenging problem, involving complex manual features, i.e., hand gestures, and fine-grained non-manual features (NMFs), i.e., facial expression, mouth shapes, etc. Although manual features are…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Hezhen Hu , Wengang Zhou , Junfu Pu , Houqiang Li

Current sign language machine translation systems rely on recognizing hand movements, facial expressions and body postures, and natural language processing, to convert signs into text. Recent approaches use Transformer architectures to…

Artificial Intelligence · Computer Science 2025-04-17 Nada Shahin , Leila Ismail

Sign language is one of the most effective communication tools for people with hearing difficulties. Most existing works focus on improving the performance of sign language tasks on RGB videos, which may suffer from degraded recording…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Pengyu Zhang , Hao Yin , Zeren Wang , Wenyue Chen , Shengming Li , Dong Wang , Huchuan Lu , Xu Jia

Current benchmarks for sign language recognition (SLR) focus mainly on isolated SLR, while there are limited datasets for continuous SLR (CSLR), which recognizes sequences of signs in a video. Additionally, existing CSLR datasets are…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Sarah Alyami , Hamzah Luqman , Sadam Al-Azani , Maad Alowaifeer , Yazeed Alharbi , Yaser Alonaizan

Sign language is commonly used by deaf or speech impaired people to communicate but requires significant effort to master. Sign Language Recognition (SLR) aims to bridge the gap between sign language users and others by recognizing signs…

Computer Vision and Pattern Recognition · Computer Science 2021-05-04 Songyao Jiang , Bin Sun , Lichen Wang , Yue Bai , Kunpeng Li , Yun Fu

Natural language processing for sign language video - including tasks like recognition, translation, and search - is crucial for making artificial intelligence technologies accessible to deaf individuals, and is gaining research interest in…

Computer Vision and Pattern Recognition · Computer Science 2022-03-28 Bowen Shi , Diane Brentari , Greg Shakhnarovich , Karen Livescu

Sign language is a gesture-based symbolic communication medium among speech and hearing impaired people. It also serves as a communication bridge between non-impaired and impaired populations. Unfortunately, in most situations, a…

Computer Vision and Pattern Recognition · Computer Science 2025-02-19 Prasun Roy , Saumik Bhattacharya , Partha Pratim Roy , Umapada Pal

American Sign Language (ASL) is the fourth most commonly used language in the United States and is the language most commonly used by Deaf people in the United States and the English-speaking regions of Canada. Unfortunately, until…

Computer Vision and Pattern Recognition · Computer Science 2020-09-04 Nicholas Wilkins , Beck Cordes Galbraith , Ifeoma Nwogu

Sign Language Translation has attained considerable success recently, raising hopes for improved communication with the Deaf. A pre-processing step called tokenization improves the success of translations. Tokens can be learned from sign…

Computer Vision and Pattern Recognition · Computer Science 2020-03-05 Alptekin Orbay , Lale Akarun

This work dedicates to continuous sign language recognition (CSLR), which is a weakly supervised task dealing with the recognition of continuous signs from videos, without any prior knowledge about the temporal boundaries between…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Fangyun Wei , Yutong Chen

Significant advances have been made in our ability to understand and generate emotionally expressive content such as text and speech, yet comparable progress in sign language technologies remain limited. While computational approaches to…

Human-Computer Interaction · Computer Science 2025-05-14 Phoebe Chua , Cathy Mengying Fang , Yasith Samaradivakara , Pattie Maes , Suranga Nanayakkara

This paper examines two aspects of the isolated sign language recognition (ISLR) task. First, although a certain number of datasets is available, the data for individual sign languages is limited. It poses the challenge of cross-language…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Ilya Ovodov , Petr Surovtsev , Karina Kvanchiani , Alexander Kapitanov , Alexander Nagaev

Sign Language Recognition (SLR) is a fast-growing field that aims to fill the communication gaps between the hearing-impaired and people without hearing loss. Existing solutions for Persian Sign Language (PSL) are limited to word-level…

Human-Computer Interaction · Computer Science 2024-06-25 Amirparsa Salmankhah , Amirreza Rajabi , Negin Kheirmand , Ali Fadaeimanesh , Amirreza Tarabkhah , Amirreza Kazemzadeh , Hamed Farbeh

Sign language recognition (SLR) facilitates communication between deaf and hearing individuals. Deep learning is widely used to develop SLR-based systems; however, it is computationally intensive and requires substantial computational…

Robotics · Computer Science 2025-12-24 Nitin Kumar Singh , Arie Rachmad Syulistyo , Yuichiro Tanaka , Hakaru Tamukoh

Sign language is a visual language expressed through hand movements and non-manual markers. Non-manual markers include facial expressions and head movements. These expressions vary across different nations. Therefore, specialized analysis…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Yui Tatsumi , Shoko Tanaka , Shunsuke Akamatsu , Takahiro Shindo , Hiroshi Watanabe

In this project, we have developed a sign language tutor that lets users learn isolated signs by watching recorded videos and by trying the same signs. The system records the user's video and analyses it. If the sign is recognized, both…