English
Related papers

Related papers: Sign Language Recognition Based On Facial Expressi…

200 papers

Unlike spoken languages where the use of prosodic features to convey emotion is well studied, indicators of emotion in sign language remain poorly understood, creating communication barriers in critical settings. Sign languages present…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Phoebe Chua , Cathy Mengying Fang , Takehiko Ohkawa , Raja Kushalnagar , Suranga Nanayakkara , Pattie Maes

The recent surge in large language models has automated translations of spoken and written languages. However, these advances remain largely inaccessible to American Sign Language (ASL) users, whose language relies on complex visual cues.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Daniel Perkins , Davis Hunter , Dhrumil Patel , Galen Flanagan

Sign language recognition (SLR) plays a vital role in facilitating communication for the hearing-impaired community. SLR is a weakly supervised task where entire videos are annotated with glosses, making it challenging to identify the…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Hao Chen , Jiaze Wang , Ziyu Guo , Jinpeng Li , Donghao Zhou , Bian Wu , Chenyong Guan , Guangyong Chen , Pheng-Ann Heng

Human communication is the vocal and non verbal signal to communicate with others. Human expression is a significant biometric object in picture and record databases of surveillance systems. Face appreciation has a serious role in biometric…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 P. Deivendran , P. Suresh Babu , G. Malathi , K. Anbazhagan , R. Senthil Kumar

Isolated Sign Language Recognition (ISLR) is crucial for scalable sign language technology, yet language-specific approaches limit current models. To address this, we propose a one-shot learning approach that generalises across languages…

Computation and Language · Computer Science 2025-02-28 Toon Vandendriessche , Mathieu De Coster , Annelies Lejon , Joni Dambre

Sign Language Assessment (SLA) tools are useful to aid in language learning and are underdeveloped. Previous work has focused on isolated signs or comparison against a single reference video to assess Sign Languages (SL). This paper…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Oliver Cory , Ozge Mercanoglu Sincan , Matthew Vowels , Alessia Battisti , Franz Holzknecht , Katja Tissi , Sandra Sidler-Miserez , Tobias Haug , Sarah Ebling , Richard Bowden

The goal of this investigation is to quantify to what extent computer vision methods can correctly classify facial expressions on a sign language dataset. We extend our experiments by recognizing expressions using only the upper or lower…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Fabrizio Nunnari , Alakshendra Jyotsnaditya Ramkrishna Singh , Patrick Gebhard

Automatic Sign Language Recognition (ASLR) has emerged as a vital field for bridging the gap between deaf and hearing communities. However, the problem of sign-to-sign retrieval or detecting a specific sign within a sequence of continuous…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Samuel Ebimobowei Johnny , Blessed Guda , Emmanuel Enejo Aaron , Assane Gueye

Inspired by recent developments in natural language processing, we propose a novel approach to sign language processing based on phonological properties validated by American Sign Language users. By taking advantage of datasets composed of…

Computation and Language · Computer Science 2024-07-25 Federico Tavella , Aphrodite Galata , Angelo Cangelosi

Sign language is one of the most effective communication tools for people with hearing difficulties. Most existing works focus on improving the performance of sign language tasks on RGB videos, which may suffer from degraded recording…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Pengyu Zhang , Hao Yin , Zeren Wang , Wenyue Chen , Shengming Li , Dong Wang , Huchuan Lu , Xu Jia

Hand gesture recognition possesses extensive applications in virtual reality, sign language recognition, and computer games. The direct interface of hand gestures provides us a new way for communicating with the virtual environment. In this…

Computer Vision and Pattern Recognition · Computer Science 2014-08-11 Reza Azad , Babak Azad , Iman Tavakoli Kazerooni

Automatic sign language recognition is a research area that encompasses human-computer interaction, computer vision and machine learning. Robust automatic recognition of sign language could assist in the translation process and the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Franco Ronchetti , Facundo Manuel Quiroga , César Estrebou , Laura Lanzarini , Alejandro Rosete

Human body pose estimation and hand detection are two important tasks for systems that perform computer vision-based sign language recognition(SLR). However, both tasks are challenging, especially when the input is color videos, with no…

Computer Vision and Pattern Recognition · Computer Science 2016-04-21 Srujana Gattupalli , Amir Ghaderi , Vassilis Athitsos

The human body communicates through various meaningful gestures, with sign language using hands being a prominent example. Bangla Sign Language Translation (BSLT) aims to bridge communication gaps for the deaf and mute community. Our…

Computation and Language · Computer Science 2024-12-24 Rotan Hawlader Pranto , Shahnewaz Siddique

Continuous sign language recognition (SLR) aims to translate a signing sequence into a sentence. It is very challenging as sign language is rich in vocabulary, while many among them contain similar gestures and motions. Moreover, it is…

Computer Vision and Pattern Recognition · Computer Science 2019-08-06 Zhaoyang Yang , Zhenmei Shi , Xiaoyong Shen , Yu-Wing Tai

Zero-Shot Learning (ZSL) has rapidly advanced in recent years. Towards overcoming the annotation bottleneck in the Sign Language Recognition (SLR), we explore the idea of Zero-Shot Sign Language Recognition (ZS-SLR) with no annotated visual…

Computer Vision and Pattern Recognition · Computer Science 2021-09-06 Razieh Rastgoo , Kourosh Kiani , Sergio Escalera , Mohammad Sabokrou

Human action recognition and performance assessment have been hot research topics in recent years. Recognition problems have mature solutions in the field of sign language, but past research in performance analysis has focused on…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Hongli Wen , Yang Xu

Sign language is the primary language for people with a hearing loss. Sign language recognition (SLR) is the automatic recognition of sign language, which represents a challenging problem for computers, though some progress has been made…

Computer Vision and Pattern Recognition · Computer Science 2021-03-10 Roman Töngi

Sign language is the window for people differently-abled to express their feelings as well as emotions. However, it remains challenging for people to learn sign language in a short time. To address this real-world challenge, in this work,…

Computer Vision and Pattern Recognition · Computer Science 2022-07-11 Yucheng Suo , Zhedong Zheng , Xiaohan Wang , Bang Zhang , Yi Yang

Artificial agents, particularly humanoid robots, interact with their environment, objects, and people using cameras, actuators, and physical presence. Their communication methods are often pre-programmed, limiting their actions and…

Artificial Intelligence · Computer Science 2024-06-17 Federico Tavella , Aphrodite Galata , Angelo Cangelosi