English
Related papers

Related papers: Sign Language Recognition Analysis using Multimoda…

200 papers

With the development of robotics, skeleton-based action recognition has become increasingly important, as human-robot interaction requires understanding the actions of humans and humanoid robots. Due to different sources of human skeletons…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Jidong Kuang , Hongsong Wang , Jie Gui

Previous research underscored the potential of danmaku--a text-based commenting feature on videos--in engaging hearing audiences. Yet, for many Deaf and hard-of-hearing (DHH) individuals, American Sign Language (ASL) takes precedence over…

Human-Computer Interaction · Computer Science 2024-03-28 Si Chen , Haocong Cheng , Jason Situ , Desirée Kirst , Suzy Su , Saumya Malhotra , Lawrence Angrave , Qi Wang , Yun Huang

Isolated Sign Language Recognition (ISLR) is critical for bridging the communication gap between the Deaf and Hard-of-Hearing (DHH) community and the hearing world. However, robust ISLR is fundamentally constrained by data scarcity and the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Meher Md Saad

Tremendous headway has been made in the field of 3D hand pose estimation but the 3D depth cameras are usually inaccessible. We propose a model to recognize American Sign Language alphabet from RGB images. Images for the training were…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Nikhil Kasukurthi , Brij Rokad , Shiv Bidani , Aju Dennisan

Continuous Sign Language Recognition (CSLR) focuses on the interpretation of a sequence of sign language gestures performed continually without pauses. In this study, we conduct an empirical evaluation of recent deep learning CSLR…

Computation and Language · Computer Science 2024-10-23 Sarah Alyami , Hamzah Luqman

Sign language recognition (SLR) technology has enormous promise to improve communication and accessibility for the difficulty of hearing. This paper presents a novel approach for identifying gestures in TSL using the YOLOv5 object…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Vipul Reddy. P , Vishnu Vardhan Reddy. B , Sukriti

Correctly recognizing the behaviors of children with Autism Spectrum Disorder (ASD) is of vital importance for the diagnosis of Autism and timely early intervention. However, the observation and recording during the treatment from the…

Computer Vision and Pattern Recognition · Computer Science 2024-01-08 Andong Deng , Taojiannan Yang , Chen Chen , Qian Chen , Leslie Neely , Sakiko Oyama

In human activity recognition (HAR), activity labels have typically been encoded in one-hot format, which has a recent shift towards using textual representations to provide contextual knowledge. Here, we argue that HAR should be anchored…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Shuheng Li , Jiayun Zhang , Xiaohan Fu , Xiyuan Zhang , Jingbo Shang , Rajesh K. Gupta

Recent advances in Deep Learning and Computer Vision have been successfully leveraged to serve marginalized communities in various contexts. One such area is Sign Language - a primary means of communication for the deaf community. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Haz Sameen Shahgir , Khondker Salman Sayeed , Md Toki Tahmid , Tanjeem Azwad Zaman , Md. Zarif Ul Alam

Sign language recognition (SLR) is a challenging problem, involving complex manual features, i.e., hand gestures, and fine-grained non-manual features (NMFs), i.e., facial expression, mouth shapes, etc. Although manual features are…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Hezhen Hu , Wengang Zhou , Junfu Pu , Houqiang Li

Deep learning techniques are being used in skeleton based action recognition tasks and outstanding performance has been reported. Compared with RNN based methods which tend to overemphasize temporal information, CNN-based approaches can…

Computer Vision and Pattern Recognition · Computer Science 2017-05-03 Zewei Ding , Pichao Wang , Philip O. Ogunbona , Wanqing Li

Human body pose estimation and hand detection are two important tasks for systems that perform computer vision-based sign language recognition(SLR). However, both tasks are challenging, especially when the input is color videos, with no…

Computer Vision and Pattern Recognition · Computer Science 2016-04-21 Srujana Gattupalli , Amir Ghaderi , Vassilis Athitsos

In this article, we introduce a novel problem of audio-visual autism behavior recognition, which includes social behavior recognition, an essential aspect previously omitted in AI-assisted autism screening research. We define the task at…

For a long time, detecting hand gestures and recognizing them as letters or numbers has been a challenging task. This creates communication barriers for individuals with disabilities. This paper introduces a new dataset, the Annotated…

Computer Vision and Pattern Recognition · Computer Science 2023-05-18 Sanyam Jain

The ageing population trend is correlated with an increased prevalence of acquired cognitive impairments such as dementia. Although there is no cure for dementia, a timely diagnosis helps in obtaining necessary support and appropriate…

Computer Vision and Pattern Recognition · Computer Science 2021-01-06 Xing Liang , Anastassia Angelopoulou , Epaminondas Kapetanios , Bencie Woll , Reda Al-batat , Tyron Woolfe

People with speech and hearing impairments often rely on sign language to communicate with others but most of the general population cannot understand sign language and sign language itself is a difficult language to learn, so there is a…

Human-Computer Interaction · Computer Science 2020-09-10 Sai Charan Bodda , Palki Gupta , Gaurav Joshi , Ayush Chaturvedi

Skeleton data carries valuable motion information and is widely explored in human action recognition. However, not only the motion information but also the interaction with the environment provides discriminative cues to recognize the…

Computer Vision and Pattern Recognition · Computer Science 2022-05-11 Liang Xu , Cuiling Lan , Wenjun Zeng , Cewu Lu

In low-resource computing contexts, such as smartphones and other tiny devices, Both deep learning and machine learning are being used in a lot of identification systems. as authentication techniques. The transparent, contactless, and…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Pangoth Santhosh Kumar , Garika Akshay

Pre-training has proven effective for learning transferable features in sign language understanding (SLU) tasks. Recently, skeleton-based methods have gained increasing attention because they can robustly handle variations in subjects and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Muxin Pu , Mei Kuan Lim , Chun Yong Chong , Chen Change Loy

Sign language recognition (SLR) facilitates communication between deaf and hearing individuals. Deep learning is widely used to develop SLR-based systems; however, it is computationally intensive and requires substantial computational…

Robotics · Computer Science 2025-12-24 Nitin Kumar Singh , Arie Rachmad Syulistyo , Yuichiro Tanaka , Hakaru Tamukoh