English
Related papers

Related papers: Isolated Sign Language Recognition with Segmentati…

200 papers

The complexity of Sign Language (SL) data processing brings many challenges. The current approach to recognition of SL signs aims to translate RGB sign language videos through pose information into Word-based ID Glosses, which serve to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Sen Fang , Yalin Feng , Chunyu Sui , Hongbin Zhong , Yanxin Zhang , Hongwei Yi , Hezhen Hu , Dimitris N. Metaxas

Isolated Sign Language Recognition (ISLR) is challenged by gestures that are morphologically similar yet semantically distinct, a problem rooted in the complex interplay between hand shape and motion trajectory. Existing methods, often…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Liangjin Liu , Haoyang Zheng , Zhengzhong Zhu , Pei Zhou

Human body pose estimation and hand detection are two important tasks for systems that perform computer vision-based sign language recognition(SLR). However, both tasks are challenging, especially when the input is color videos, with no…

Computer Vision and Pattern Recognition · Computer Science 2016-04-21 Srujana Gattupalli , Amir Ghaderi , Vassilis Athitsos

Recent Vision Language Models (VLMs) have demonstrated strong performance across a wide range of multimodal reasoning tasks. This raises the question of whether such general-purpose models can also address specialized visual recognition…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Vaclav Javorek , Jakub Honzik , Ivan Gruber , Tomas Zelezny , Marek Hruz

We present Large Sign Language Models (LSLM), a novel framework for translating 3D American Sign Language (ASL) by leveraging Large Language Models (LLMs) as the backbone, which can benefit hearing-impaired individuals' virtual…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Sen Zhang , Xiaoxiao He , Di Liu , Zhaoyang Xia , Mingyu Zhao , Chaowei Tan , Vivian Li , Bo Liu , Dimitris N. Metaxas , Mubbasir Kapadia

There have been recent advances in computer-based recognition of isolated, citation-form signs from video. There are many challenges for such a task, not least the naturally occurring inter- and intra- signer synchronic variation in sign…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Carol Neidle

Sign Language Recognition (SLR) is an essential yet challenging task since sign language is performed with the fast and complex movement of hand gestures, body posture, and even facial expressions. %Skeleton Aware Multi-modal Sign Language…

Computer Vision and Pattern Recognition · Computer Science 2023-02-17 Maxim Novopoltsev , Leonid Verkhovtsev , Ruslan Murtazin , Dmitriy Milevich , Iuliia Zemtsova

This paper presents a system which can recognise hand poses & gestures from the Indian Sign Language (ISL) in real-time using grid-based features. This system attempts to bridge the communication gap between the hearing and speech impaired…

Computer Vision and Pattern Recognition · Computer Science 2021-08-26 Kartik Shenoy , Tejas Dastane , Varun Rao , Devendra Vyavaharkar

Skeleton-based isolated sign language recognition (ISLR) demands fine-grained understanding of articulated motion across multiple spatial scales, from subtle finger movements to global body dynamics. Existing approaches typically rely on…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Muxin Pu , Mei Kuan Lim , Chun Yong Chong , Chen Change Loy

Isolated Sign Language Recognition (ISLR) focuses on identifying individual sign language glosses. Considering the diversity of sign languages across geographical regions, developing region-specific ISLR datasets is crucial for supporting…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Xin Shen , Heming Du , Hongwei Sheng , Shuyun Wang , Hui Chen , Huiqiang Chen , Zhuojie Wu , Xiaobiao Du , Jiaying Ying , Ruihan Lu , Qingzheng Xu , Xin Yu

Sign languages are visual languages which convey information by signers' handshape, facial expression, body movement, and so forth. Due to the inherent restriction of combinations of these visual ingredients, there exist a significant…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Ronglai Zuo , Fangyun Wei , Brian Mak

Word-level sign language recognition (WSLR) has attracted attention because it is expected to overcome the communication barrier between people with speech impairment and those who can hear. In the WSLR problem, a method designed for action…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Mizuki Maruyama , Shrey Singh , Katsufumi Inoue , Partha Pratim Roy , Masakazu Iwamura , Michifumi Yoshioka

Sign languages are visual languages, with vocabularies as rich as their spoken language counterparts. However, current deep-learning based Sign Language Production (SLP) models produce under-articulated skeleton pose sequences from…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Ben Saunders , Necati Cihan Camgoz , Richard Bowden

Automatic sign language recognition plays a crucial role in bridging the communication gap between deaf communities and hearing individuals; however, most available datasets focus on American Sign Language. For Romanian Isolated Sign…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Cătălin-Alexandru Rîpanu , Andrei-Theodor Hotnog , Giulia-Stefania Imbrea , Dumitru-Clementin Cercel

The goal of sign language recognition (SLR) is to help those who are hard of hearing or deaf overcome the communication barrier. Most existing approaches can be typically divided into two lines, i.e., Skeleton-based and RGB-based methods,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Xiaolong Shen , Zhedong Zheng , Yi Yang

Automatic sign language recognition (SLR) is an important topic within the areas of human-computer interaction and machine learning. On the one hand, it poses a complex challenge that requires the intervention of various knowledge areas,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Franco Ronchetti , Facundo Manuel Quiroga , César Estrebou , Laura Lanzarini , Alejandro Rosete

Sign spotting, the task of identifying and localizing individual signs within continuous sign language video, plays a pivotal role in scaling dataset annotations and addressing the severe data scarcity issue in sign language translation.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 JianHe Low , Ozge Mercanoglu Sincan , Richard Bowden

The need of sign language is increasing radically especially to hearing impaired community. Only few research groups try to automatically recognize sign language from video, colored gloves and etc. Their approach requires a valid…

Computer Vision and Pattern Recognition · Computer Science 2010-01-13 M. Krishnaveni , Dr. V. Radha

Signed languages are visual languages produced by the movement of the hands, face, and body. In this paper, we evaluate representations based on skeleton poses, as these are explainable, person-independent, privacy-preserving,…

The deaf and hard of hearing community relies on American Sign Language (ASL) as their primary mode of communication, but communication with others who do not know ASL can be difficult, especially during emergencies where no interpreter is…

Image and Video Processing · Electrical Eng. & Systems 2023-05-12 Janice Nguyen , Y. Curtis Wang