English
Related papers

Related papers: Robust Sign Language Recognition System Using ToF …

200 papers

Automatic sign language recognition (SLR) has become a key enabler of inclusive human-computer interaction, fostering seamless communication between deaf individuals and hearing communities. Despite significant advances in multimodal…

Human-Computer Interaction · Computer Science 2026-05-08 Xiaofang Xiao , Guangchao Li , Guangrong Zhao , Qi Lin , Wen Ma , Hongkai Wen , Yanxiang Wang , Yiran Shen

The recognition of sign language is a challenging task with an important role in society to facilitate the communication of deaf persons. We propose a new approach of Spatial-Temporal Graph Convolutional Network to sign language recognition…

Machine Learning · Computer Science 2020-05-21 Cleison Correia de Amorim , David Macêdo , Cleber Zanchettin

In this paper, we propose a 3D Convolutional Neural Network (3DCNN) based multi-stream framework to recognize American Sign Language (ASL) manual signs (consisting of movements of the hands, as well as non-manual face movements in some…

Computer Vision and Pattern Recognition · Computer Science 2019-06-10 Longlong Jing , Elahe Vahdani , Matt Huenerfauth , Yingli Tian

Accurate sign language understanding serves as a crucial communication channel for individuals with disabilities. Current sign language translation algorithms predominantly rely on RGB frames, which may be limited by fixed frame rates,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Xiao Wang , Yuehang Li , Fuling Wang , Bo Jiang , Yaowei Wang , Yonghong Tian , Jin Tang , Bin Luo

Learning fine-grained movements is a challenging topic in robotics, particularly in the context of robotic hands. One specific instance of this challenge is the acquisition of fingerspelling sign language in robots. In this paper, we…

Robotics · Computer Science 2024-07-25 Federico Tavella , Aphrodite Galata , Angelo Cangelosi

Many technologies for human-computer interaction have been designed for hearing individuals and depend upon vocalized speech, precluding users of American Sign Language (ASL) in the Deaf community from benefiting from these advancements.…

This study explores integrating sign language into virtual reality (VR) by examining the comprehensibility and user experience of viewing American Sign Language (ASL) videos captured with body-mounted 360-degree cameras. Ten participants…

Human-Computer Interaction · Computer Science 2026-02-27 Gauri Umesh Rajmane , Ziming Li , Tae Oh , Roshan Peiris

Automatic sign language recognition is an open problem that has received a lot of attention recently, not only because of its usefulness to signers, but also due to the numerous applications a sign classifier can have. In this article, we…

Computer Vision and Pattern Recognition · Computer Science 2015-03-20 Lucas Rioux-Maldague , Philippe Giguère

Arabic Sign Language (ArSL) is an essential communication method for individuals in the Deaf and Hard-of-Hearing community. However, existing recognition systems face significant challenges due to their reliance on single sensor approaches…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Ghadeer Alanazi , Abir Benabid

Sign language recognition is a challenging and often underestimated problem comprising multi-modal articulators (handshape, orientation, movement, upper body and face) that integrate asynchronously on multiple streams. Learning powerful…

Computer Vision and Pattern Recognition · Computer Science 2019-11-22 Hamid Reza Vaezi Joze , Oscar Koller

It has always been a rather tough task to communicate with someone possessing a hearing impairment. One of the most tested ways to establish such a communication is through the use of sign based languages. However, not many people are aware…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Sharanya Mukherjee , Md Hishaam Akhtar , Kannadasan R

Changes in facial expression, head movement, body movement and gesture movement are remarkable cues in sign language recognition, and most of the current continuous sign language recognition(CSLR) research methods mainly focus on static…

Computer Vision and Pattern Recognition · Computer Science 2024-03-01 Qidan Zhu , Jing Li , Fei Yuan , Quan Gan

Sign language recognition (SLR) refers to interpreting sign language glosses from given videos automatically. This research area presents a complex challenge in computer vision because of the rapid and intricate movements inherent in sign…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Muxin Pu , Mei Kuan Lim , Chun Yong Chong

We present a method for recognition of isolated Swedish Sign Language signs. The method will be used in a game intended to help children training signing at home, as a complement to training with a teacher. The target group is not primarily…

Computer Vision and Pattern Recognition · Computer Science 2012-11-19 Saad Akram , Jonas Beskow , Hedvig Kjellstrom

This paper presents a system which can recognise hand poses & gestures from the Indian Sign Language (ISL) in real-time using grid-based features. This system attempts to bridge the communication gap between the hearing and speech impaired…

Computer Vision and Pattern Recognition · Computer Science 2021-08-26 Kartik Shenoy , Tejas Dastane , Varun Rao , Devendra Vyavaharkar

Sign spotting, the task of identifying and localizing individual signs within continuous sign language video, plays a pivotal role in scaling dataset annotations and addressing the severe data scarcity issue in sign language translation.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 JianHe Low , Ozge Mercanoglu Sincan , Richard Bowden

Depth sensing is useful in a variety of applications that range from augmented reality to robotics. Time-of-flight (TOF) cameras are appealing because they obtain dense depth measurements with minimal latency. However, for many…

Image and Video Processing · Electrical Eng. & Systems 2019-03-27 James Noraky , Vivienne Sze

Sign language is one of the most effective communication tools for people with hearing difficulties. Most existing works focus on improving the performance of sign language tasks on RGB videos, which may suffer from degraded recording…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Pengyu Zhang , Hao Yin , Zeren Wang , Wenyue Chen , Shengming Li , Dong Wang , Huchuan Lu , Xu Jia

Sign language recognition (SLR) facilitates communication between deaf and hearing individuals. Deep learning is widely used to develop SLR-based systems; however, it is computationally intensive and requires substantial computational…

Robotics · Computer Science 2025-12-24 Nitin Kumar Singh , Arie Rachmad Syulistyo , Yuichiro Tanaka , Hakaru Tamukoh

Sign language recognition is a challenging gesture sequence recognition problem, characterized by quick and highly coarticulated motion. In this paper we focus on recognition of fingerspelling sequences in American Sign Language (ASL)…

Computer Vision and Pattern Recognition · Computer Science 2019-08-29 Bowen Shi , Aurora Martinez Del Rio , Jonathan Keane , Diane Brentari , Greg Shakhnarovich , Karen Livescu