English
Related papers

Related papers: SignBart -- New approach with the skeleton sequenc…

200 papers

Skeleton-aware sign language recognition (SLR) has gained popularity due to its ability to remain unaffected by background information and its lower computational requirements. Current methods utilize spatial graph modules and temporal…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Lianyu Hu , Liqing Gao , Zekang Liu , Wei Feng

Millions of hearing impaired people around the world routinely use some variants of sign languages to communicate, thus the automatic translation of a sign language is meaningful and important. Currently, there are two sub-problems in Sign…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Jie Huang , Wengang Zhou , Qilin Zhang , Houqiang Li , Weiping Li

Skeleton-based isolated sign language recognition (ISLR) demands fine-grained understanding of articulated motion across multiple spatial scales, from subtle finger movements to global body dynamics. Existing approaches typically rely on…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Muxin Pu , Mei Kuan Lim , Chun Yong Chong , Chen Change Loy

Sign Language Recognition (SLR) has garnered significant attention from researchers in recent years, particularly the intricate domain of Continuous Sign Language Recognition (CSLR), which presents heightened complexity compared to Isolated…

Computer Vision and Pattern Recognition · Computer Science 2024-02-23 Razieh Rastgoo , Kourosh Kiani , Sergio Escalera

Pre-training has proven effective for learning transferable features in sign language understanding (SLU) tasks. Recently, skeleton-based methods have gained increasing attention because they can robustly handle variations in subjects and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Muxin Pu , Mei Kuan Lim , Chun Yong Chong , Chen Change Loy

Voice-controlled personal and home assistants (such as the Amazon Echo and Apple Siri) are becoming increasingly popular for a variety of applications. However, the benefits of these technologies are not readily accessible to Deaf or…

Machine Learning · Computer Science 2019-09-26 Al Amin Hosain , Panneer Selvam Santhalingam , Parth Pathak , Jana Kosecka , Huzefa Rangwala

Sign language is the primary language for people with a hearing loss. Sign language recognition (SLR) is the automatic recognition of sign language, which represents a challenging problem for computers, though some progress has been made…

Computer Vision and Pattern Recognition · Computer Science 2021-03-10 Roman Töngi

Hand gesture-based Sign Language Recognition (SLR) serves as a crucial communication bridge between deaf and non-deaf individuals. While Graph Convolutional Networks (GCNs) are common, they are limited by their reliance on fixed skeletal…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Koki Hirooka , Abu Saleh Musa Miah , Tatsuya Murakami , Md. Al Mehedi Hasan , Yong Seok Hwang , Jungpil Shin

Sign language recognition and translation technologies have the potential to increase access and inclusion of deaf signing communities, but research progress is bottlenecked by a lack of representative data. We introduce a new resource for…

Computation and Language · Computer Science 2023-10-03 Lee Kezar , Elana Pontecorvo , Adele Daniels , Connor Baer , Ruth Ferster , Lauren Berger , Jesse Thomason , Zed Sevcikova Sehyr , Naomi Caselli

Hand gesture-based sign language recognition (SLR) is one of the most advanced applications of machine learning, and computer vision uses hand gestures. Although, in the past few years, many researchers have widely explored and studied how…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Abu Saleh Musa Miah , Md. Al Mehedi Hasan , Md Hadiuzzaman , Muhammad Nazrul Islam , Jungpil Shin

Sign language is the preferred method of communication of deaf or mute people, but similar to any language, it is difficult to learn and represents a significant barrier for those who are hard of hearing or unable to speak. A person's…

Computer Vision and Pattern Recognition · Computer Science 2022-12-26 Neil Song , Yu Xiang

Automatic sign language recognition (SLR) is an important topic within the areas of human-computer interaction and machine learning. On the one hand, it poses a complex challenge that requires the intervention of various knowledge areas,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Franco Ronchetti , Facundo Manuel Quiroga , César Estrebou , Laura Lanzarini , Alejandro Rosete

The performances of Sign Language Recognition (SLR) systems have improved considerably in recent years. However, several open challenges still need to be solved to allow SLR to be useful in practice. The research in the field is in its…

Computer Vision and Pattern Recognition · Computer Science 2021-05-12 Ozge Mercanoglu Sincan , Julio C. S. Jacques Junior , Sergio Escalera , Hacer Yalim Keles

To promote inclusion and ensuring effective communication for those who rely on sign language as their main form of communication, sign language recognition (SLR) is crucial. Sign language recognition (SLR) seamlessly incorporates with…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 A. E. M Ridwan , Mushfiqul Islam Chowdhury , Mekhala Mariam Mary , Md Tahmid Chowdhury Abir

Sign language recognition (SLR) technology has enormous promise to improve communication and accessibility for the difficulty of hearing. This paper presents a novel approach for identifying gestures in TSL using the YOLOv5 object…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Vipul Reddy. P , Vishnu Vardhan Reddy. B , Sukriti

Research on continuous sign language recognition (CSLR) is essential to bridge the communication gap between deaf and hearing individuals. Numerous previous studies have trained their models using the connectionist temporal classification…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Ronglai Zuo , Fangyun Wei , Brian Mak

Recent advances in skeleton-based action recognition increasingly leverage semantic priors from Large Language Models (LLMs) to enrich skeletal representations. However, the LLM is typically queried in isolation from the recognition model…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Hongda Liu , Yunfan Liu , Changlu Wang , Yunlong Wang , Zhenan Sun

Sign Language Translation (SLT) is a promising technology to bridge the communication gap between the deaf and the hearing people. Recently, researchers have adopted Neural Machine Translation (NMT) methods, which usually require…

Computation and Language · Computer Science 2023-03-22 Biao Fu , Peigen Ye , Liang Zhang , Pei Yu , Cong Hu , Yidong Chen , Xiaodong Shi

Sign language is a visual language used by the deaf and dumb community to communicate. However, for most recognition methods based on monocular cameras, the recognition accuracy is low and the robustness is poor. Even if the effect is good…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Zhiyu Long , Xingyou Liu , Jiaqi Qiao , Zhi Li

People with vocal and hearing disabilities use sign language to express themselves using visual gestures and signs. Although sign language is a solution for communication difficulties faced by deaf people, there are still problems as most…

Computer Vision and Pattern Recognition · Computer Science 2023-05-01 Mallikharjuna Rao K , Harleen Kaur , Sanjam Kaur Bedi , M A Lekhana