English
Related papers

Related papers: Sign Language Recognition Based On Facial Expressi…

200 papers

We address the problem of American Sign Language fingerspelling recognition in the wild, using videos collected from websites. We introduce the largest data set available so far for the problem of fingerspelling recognition, and the first…

Computer Vision and Pattern Recognition · Computer Science 2019-02-19 Bowen Shi , Aurora Martinez Del Rio , Jonathan Keane , Jonathan Michaux , Diane Brentari , Greg Shakhnarovich , Karen Livescu

Both manual (relating to the use of hands) and non-manual markers (NMM), such as facial expressions or mouthing cues, are important for providing the complete meaning of phrases in American Sign Language (ASL). Efforts have been made in…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Lipisha Chaudhary , Fei Xu , Ifeoma Nwogu

Sign languages are dynamic visual languages that involve hand gestures, in combination with non manual elements such as facial expressions. While video recordings of sign language are commonly used for education and documentation, the…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Janna Bruner , Amit Moryossef , Lior Wolf

Sign Language Recognition (SLR) is an important step in facilitating the communication among deaf people and the rest of society. Existing Persian sign language recognition systems are mainly restricted to static signs which are not very…

Computer Vision and Pattern Recognition · Computer Science 2019-12-05 Saeideh Ghanbari Azar , Hadi Seyedarabi

Devices like the Myo armband available in the market today enable us to collect data about the position of a user's hands and fingers over time. We can use these technologies for sign language translation since each sign is roughly a…

Computer Vision and Pattern Recognition · Computer Science 2017-01-10 Hardie Cate , Fahim Dalvi , Zeshan Hussain

Handshapes serve a fundamental phonological role in signed languages, with American Sign Language employing approximately 50 distinct shapes. However,computational approaches rarely model handshapes explicitly, limiting both recognition…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Alessa Carbo , Eric Nalisnick

A persistent challenge in sign language video processing, including the task of sign to written language translation, is how we learn representations of sign language in an effective and efficient way that preserves the important attributes…

Computation and Language · Computer Science 2025-06-04 Shester Gueuwou , Xiaodan Du , Greg Shakhnarovich , Karen Livescu

This research combines MediaPipe and CNNs for the efficient and accurate interpretation of ASL dataset for the real-time detection of sign language. The system presented here captures and processes hands' gestures in real time. the intended…

Machine Learning · Computer Science 2024-08-28 Aditya Raj Verma , Gagandeep Singh , Karnim Meghwal , Banawath Ramji , Praveen Kumar Dadheech

A primary challenge for the deaf and hearing-impaired community stems from the communication gap with the hearing society, which can greatly impact their daily lives and result in social exclusion. To foster inclusivity in society, our…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Elisa Cabana

This work dedicates to continuous sign language recognition (CSLR), which is a weakly supervised task dealing with the recognition of continuous signs from videos, without any prior knowledge about the temporal boundaries between…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Fangyun Wei , Yutong Chen

Recent advancements in the field of computer vision with the help of deep neural networks have led us to explore and develop many existing challenges that were once unattended due to the lack of necessary technologies. Hand Sign/Gesture…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Shahjalal Ahmed , Md. Rafiqul Islam , Jahid Hassan , Minhaz Uddin Ahmed , Bilkis Jamal Ferdosi , Sanjay Saha , Md. Shopon

Hand gesture serves as a critical role in sign language. Current deep-learning-based sign language recognition (SLR) methods may suffer insufficient interpretability and overfitting due to limited sign data sources. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Hezhen Hu , Weichao Zhao , Wengang Zhou , Yuechen Wang , Houqiang Li

As the main means of communication for deaf people, sign language has a special grammatical order, so it is meaningful and valuable to develop a real-time translation system for sign language. In the research process, we added a TSM module…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Shengzhuo Wei , Yan Lan

Sign languages are visual languages using manual articulations and non-manual elements to convey information. For sign language recognition and translation, the majority of existing approaches directly encode RGB videos into hidden…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Yutong Chen , Ronglai Zuo , Fangyun Wei , Yu Wu , Shujie Liu , Brian Mak

Sign language recognition (SLR) technology has enormous promise to improve communication and accessibility for the difficulty of hearing. This paper presents a novel approach for identifying gestures in TSL using the YOLOv5 object…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Vipul Reddy. P , Vishnu Vardhan Reddy. B , Sukriti

The count of people suffering from various levels of hearing loss reached 1.57 billion in 2019. This huge number tends to suffer on many personal and professional levels and strictly needs to be included with the rest of society healthily.…

Signal Processing · Electrical Eng. & Systems 2023-12-20 Basma Kalandar , Ziemowit Dworakowski

The objective of this paper is to develop a functional system for translating spoken languages into sign languages, referred to as Spoken2Sign translation. The Spoken2Sign task is orthogonal and complementary to traditional sign language to…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Ronglai Zuo , Fangyun Wei , Zenggui Chen , Brian Mak , Jiaolong Yang , Xin Tong

Hand gesture serves as a crucial role during the expression of sign language. Current deep learning based methods for sign language understanding (SLU) are prone to over-fitting due to insufficient sign data resource and suffer limited…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Hezhen Hu , Weichao Zhao , Wengang Zhou , Houqiang Li

The automatic interpretation of sign languages is a challenging task, as it requires the usage of high-level vision and high-level motion processing systems for providing accurate image perception. In this paper, we use Convolutional Neural…

Computer Vision and Pattern Recognition · Computer Science 2020-10-16 Gustaf Halvardsson , Johanna Peterson , César Soto-Valero , Benoit Baudry

Sign language recognition involves modeling complex multichannel information, such as hand shapes and movements while relying on sufficient sign language-specific data. However, sign languages are often under-resourced, posing a significant…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Hossein Ranjbar , Alireza Taheri