English
Related papers

Related papers: Deep Neural Network-Based Sign Language Recognitio…

200 papers

Sign Language Recognition (SLR) is an essential yet challenging task since sign language is performed with the fast and complex movement of hand gestures, body posture, and even facial expressions. %Skeleton Aware Multi-modal Sign Language…

Computer Vision and Pattern Recognition · Computer Science 2023-02-17 Maxim Novopoltsev , Leonid Verkhovtsev , Ruslan Murtazin , Dmitriy Milevich , Iuliia Zemtsova

Sign language recognition (SLR) is a challenging problem, involving complex manual features, i.e., hand gestures, and fine-grained non-manual features (NMFs), i.e., facial expression, mouth shapes, etc. Although manual features are…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Hezhen Hu , Wengang Zhou , Junfu Pu , Houqiang Li

In recent years, deep learning techniques have been used to develop sign language recognition systems, potentially serving as a communication tool for millions of hearing-impaired individuals worldwide. However, there are inherent…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Alvaro Leandro Cavalcante Carneiro , Denis Henrique Pinheiro Salvadeo , Lucas de Brito Silva

In this paper we propose the Structured Deep Neural Network (Structured DNN) as a structured and deep learning algorithm, learning to find the best structured object (such as a label sequence) given a structured input (such as a vector…

Machine Learning · Computer Science 2015-06-04 Yi-Hsiu Liao , Hung-Yi Lee , Lin-shan Lee

Automatic sign language recognition (SLR) is an important topic within the areas of human-computer interaction and machine learning. On the one hand, it poses a complex challenge that requires the intervention of various knowledge areas,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Franco Ronchetti , Facundo Manuel Quiroga , César Estrebou , Laura Lanzarini , Alejandro Rosete

Sign language is commonly used by deaf or speech impaired people to communicate but requires significant effort to master. Sign Language Recognition (SLR) aims to bridge the gap between sign language users and others by recognizing signs…

Computer Vision and Pattern Recognition · Computer Science 2021-05-04 Songyao Jiang , Bin Sun , Lichen Wang , Yue Bai , Kunpeng Li , Yun Fu

Deep neural networks have been widely used in communication signal recognition and achieved remarkable performance, but this superiority typically depends on using massive examples for supervised learning, whereas training a deep neural…

Signal Processing · Electrical Eng. & Systems 2023-11-15 Weidong Wang , Hongshu Liao , Lu Gan

The automatic interpretation of sign languages is a challenging task, as it requires the usage of high-level vision and high-level motion processing systems for providing accurate image perception. In this paper, we use Convolutional Neural…

Computer Vision and Pattern Recognition · Computer Science 2020-10-16 Gustaf Halvardsson , Johanna Peterson , César Soto-Valero , Benoit Baudry

Continuous Sign Language Recognition (CSLR) focuses on the interpretation of a sequence of sign language gestures performed continually without pauses. In this study, we conduct an empirical evaluation of recent deep learning CSLR…

Computation and Language · Computer Science 2024-10-23 Sarah Alyami , Hamzah Luqman

Zero-Shot Learning (ZSL) has rapidly advanced in recent years. Towards overcoming the annotation bottleneck in the Sign Language Recognition (SLR), we explore the idea of Zero-Shot Sign Language Recognition (ZS-SLR) with no annotated visual…

Computer Vision and Pattern Recognition · Computer Science 2021-09-06 Razieh Rastgoo , Kourosh Kiani , Sergio Escalera , Mohammad Sabokrou

Existing Sign Language Learning applications focus on the demonstration of the sign in the hope that the student will copy a sign correctly. In these cases, only a teacher can confirm that the sign was completed correctly, by reviewing a…

Machine Learning · Computer Science 2024-12-25 Nikita Louison , Wayne Goodridge , Koffka Khan

Sign Language Recognition (SLR) is a fast-growing field that aims to fill the communication gaps between the hearing-impaired and people without hearing loss. Existing solutions for Persian Sign Language (PSL) are limited to word-level…

Human-Computer Interaction · Computer Science 2024-06-25 Amirparsa Salmankhah , Amirreza Rajabi , Negin Kheirmand , Ali Fadaeimanesh , Amirreza Tarabkhah , Amirreza Kazemzadeh , Hamed Farbeh

Recent advancements in the field of computer vision with the help of deep neural networks have led us to explore and develop many existing challenges that were once unattended due to the lack of necessary technologies. Hand Sign/Gesture…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Shahjalal Ahmed , Md. Rafiqul Islam , Jahid Hassan , Minhaz Uddin Ahmed , Bilkis Jamal Ferdosi , Sanjay Saha , Md. Shopon

Sign languages are multi-channel visual languages, where signers use a continuous 3D space to communicate.Sign Language Production (SLP), the automatic translation from spoken to sign languages, must embody both the continuous articulation…

Computer Vision and Pattern Recognition · Computer Science 2021-03-15 Ben Saunders , Necati Cihan Camgoz , Richard Bowden

Sign languages are visual languages, with vocabularies as rich as their spoken language counterparts. However, current deep-learning based Sign Language Production (SLP) models produce under-articulated skeleton pose sequences from…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Ben Saunders , Necati Cihan Camgoz , Richard Bowden

Spoken language recognition (SLR) is the task of automatically identifying the language present in a speech signal. Existing SLR models are either too computationally expensive or too large to run effectively on devices with limited…

Computation and Language · Computer Science 2023-06-06 Oriol Nieto , Zeyu Jin , Franck Dernoncourt , Justin Salamon

In this study, the authors propose a computational cognitive model for sign language (SL) perception and comprehension with detailed algorithmic descriptions based on cognitive functionalities in human language processing. The semantic…

Computation and Language · Computer Science 2023-01-30 Xinchen Kang , Dengfeng Yao , Minghu Jiang , Yunlong Huang , Fanshu Li

We present a novel framework for real-time sign language recognition using lightweight DNNs trained on limited data. Our system addresses key challenges in sign language recognition, including data scarcity, high computational costs, and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Nikita Nikitin , Eugene Fomin

Sign language is a visual language that enhances communication between people and is frequently used as the primary form of communication by people with hearing loss. Even so, not many people with hearing loss use sign language, and they…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Rupesh Kumar , Ayush Sinha , Ashutosh Bajpai , S. K Singh

In the realm of multimodal communication, sign language is, and continues to be, one of the most understudied areas. In line with recent advances in the field of deep learning, there are far reaching implications and applications that…

Computer Vision and Pattern Recognition · Computer Science 2017-11-21 Vivek Bheda , Dianna Radpour