English
Related papers

Related papers: FineHand: Learning Hand Shapes for American Sign L…

200 papers

The Arabic Sign Language has endorsed outstanding research achievements for identifying gestures and hand signs using the deep learning methodology. The term "forms of communication" refers to the actions used by hearing-impaired people to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-14 Rady El Rwelli , Osama R. Shahin , Ahmed I. Taloba

In recent years, deep learning techniques have been used to develop sign language recognition systems, potentially serving as a communication tool for millions of hearing-impaired individuals worldwide. However, there are inherent…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Alvaro Leandro Cavalcante Carneiro , Denis Henrique Pinheiro Salvadeo , Lucas de Brito Silva

Subtle hand differences make sign language recognition challenging, yet many existing methods rely on encoders pretrained on generic action datasets that poorly capture such fine-grained cues. We propose a self-supervised pretraining method…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Kunyuan Xie , Zhixi Cai , Kalin Stefanov

Inspired by recent developments in natural language processing, we propose a novel approach to sign language processing based on phonological properties validated by American Sign Language users. By taking advantage of datasets composed of…

Computation and Language · Computer Science 2024-07-25 Federico Tavella , Aphrodite Galata , Angelo Cangelosi

Automatic sign language recognition is an open problem that has received a lot of attention recently, not only because of its usefulness to signers, but also due to the numerous applications a sign classifier can have. In this article, we…

Computer Vision and Pattern Recognition · Computer Science 2015-03-20 Lucas Rioux-Maldague , Philippe Giguère

Learning fine-grained movements is a challenging topic in robotics, particularly in the context of robotic hands. One specific instance of this challenge is the acquisition of fingerspelling sign language in robots. In this paper, we…

Robotics · Computer Science 2024-07-25 Federico Tavella , Aphrodite Galata , Angelo Cangelosi

Sign language recognition is a challenging and often underestimated problem comprising multi-modal articulators (handshape, orientation, movement, upper body and face) that integrate asynchronously on multiple streams. Learning powerful…

Computer Vision and Pattern Recognition · Computer Science 2019-11-22 Hamid Reza Vaezi Joze , Oscar Koller

Nowadays, hand gesture recognition has become an alternative for human-machine interaction. It has covered a large area of applications like 3D game technology, sign language interpreting, VR (virtual reality) environment, and robotics. But…

Computer Vision and Pattern Recognition · Computer Science 2022-02-28 Abir Sen , Tapas Kumar Mishra , Ratnakar Dash

Hand gesture serves as a critical role in sign language. Current deep-learning-based sign language recognition (SLR) methods may suffer insufficient interpretability and overfitting due to limited sign data sources. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Hezhen Hu , Weichao Zhao , Wengang Zhou , Yuechen Wang , Houqiang Li

Hand gesture recognition is an important aspect of human-computer interaction. It forms the basis of sign language for the visually impaired people. This work proposes a novel hand gesture recognizing system for the differently-abled…

Artificial Intelligence · Computer Science 2026-01-14 Subham Sharma , Sharmila Subudhi

Over the years, hand gesture recognition has been mostly addressed considering hand trajectories in isolation. However, in most sign languages, hand gestures are defined on a particular context (body region). We propose a pipeline to…

Computer Vision and Pattern Recognition · Computer Science 2016-07-22 Marc Martínez-Camarena , Jose Oramas , Mario Montagud-Climent , Tinne Tuytelaars

This study presents a novel approach for enhancing American Sign Language (ASL) recognition using Graph Convolutional Networks (GCNs) integrated with successive residual connections. The method leverages the MediaPipe framework to extract…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Ushnish Sarkar , Archisman Chakraborti , Tapas Samanta , Sarbajit Pal , Amitabha Das

Hand gesture recognition possesses extensive applications in virtual reality, sign language recognition, and computer games. The direct interface of hand gestures provides us a new way for communicating with the virtual environment. In this…

Computer Vision and Pattern Recognition · Computer Science 2014-08-11 Reza Azad , Babak Azad , Iman Tavakoli Kazerooni

There have been recent advances in computer-based recognition of isolated, citation-form signs from video. There are many challenges for such a task, not least the naturally occurring inter- and intra- signer synchronic variation in sign…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Carol Neidle

People with vocal and hearing disabilities use sign language to express themselves using visual gestures and signs. Although sign language is a solution for communication difficulties faced by deaf people, there are still problems as most…

Computer Vision and Pattern Recognition · Computer Science 2023-05-01 Mallikharjuna Rao K , Harleen Kaur , Sanjam Kaur Bedi , M A Lekhana

Sign language is a visual language used by the deaf and dumb community to communicate. However, for most recognition methods based on monocular cameras, the recognition accuracy is low and the robustness is poor. Even if the effect is good…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Zhiyu Long , Xingyou Liu , Jiaqi Qiao , Zhi Li

In the modern context, hand gesture recognition has emerged as a focal point. This is due to its wide range of applications, which include comprehending sign language, factories, hands-free devices, and guiding robots. Many researchers have…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Md Abdur Rahim , Abu Saleh Musa Miah , Hemel Sharker Akash , Jungpil Shin , Md. Imran Hossain , Md. Najmul Hossain

Sign Languages are expressed through hand and upper body gestures as well as facial expressions. Therefore, Sign Language Recognition (SLR) needs to focus on all such cues. Previous work uses hand-crafted mechanisms or network aggregation…

Computer Vision and Pattern Recognition · Computer Science 2020-09-30 Çağrı Gökçe , Oğulcan Özdemir , Ahmet Alp Kındıroğlu , Lale Akarun

The target of this research is to experiment, iterate and recommend a system that is successful in recognition of American Sign Language (ASL). It is a challenging as well as an interesting problem that if solved will bring a leap in social…

Computer Vision and Pattern Recognition · Computer Science 2018-05-18 Dhruv Rathi

Hand gesture serves as a crucial role during the expression of sign language. Current deep learning based methods for sign language understanding (SLU) are prone to over-fitting due to insufficient sign data resource and suffer limited…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Hezhen Hu , Weichao Zhao , Wengang Zhou , Houqiang Li