English
Related papers

Related papers: A Transformer-Based Framework for Greek Sign Langu…

200 papers

Sign languages are the language of hearing-impaired people who use visuals like the hand, facial, and body movements for communication. There are different signs and gestures representing alphabets, words, and phrases. Nowadays…

Machine Learning · Computer Science 2024-11-08 Sharvani Srivastava , Sudhakar Singh , Pooja , Shiv Prakash

Sign language is a fundamental means of communication for the deaf and hard-of-hearing (DHH) community, enabling nuanced expression through gestures, facial expressions, and body movements. Despite its critical role in facilitating…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Alexander Brettmann , Jakob Grävinghoff , Marlene Rüschoff , Marie Westhues

Sign Language (SL), as the mother tongue of the deaf community, is a special visual language that most hearing people cannot understand. In recent years, neural Sign Language Translation (SLT), as a possible way for bridging communication…

Computation and Language · Computer Science 2022-11-02 Jiangbin Zheng , Siyuan Li , Cheng Tan , Chong Wu , Yidong Chen , Stan Z. Li

The absence of effective communication the deaf population represents the main social gap in this community. Furthermore, the sign language, main deaf communication tool, is unlettered, i.e., there is no formal written representation. In…

Computation and Language · Computer Science 2025-03-26 Fredy Alejandro Mendoza López , Jefferson Rodriguez , Fabio Martínez

Sign language serves as the primary meaning of communication for the deaf-mute community. Different from spoken language, it commonly conveys information by the collaboration of manual features, i.e., hand gestures and body movements, and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-19 Wengang Zhou , Weichao Zhao , Hezhen Hu , Zecheng Li , Houqiang Li

Sign language translation (SLT) is a challenging task that involves translating sign language images into spoken language. For SLT models to perform this task successfully, they must bridge the modality gap and identify subtle variations in…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Jungeun Kim , Hyeongwoo Jeon , Jongseong Bae , Ha Young Kim

Sign Language Translation (SLT) aims to convert sign language (SL) videos into spoken language text, thereby bridging the communication gap between the sign and the spoken community. While most existing works focus on translating a single…

Computation and Language · Computer Science 2025-06-02 Sihan Tan , Taro Miyazaki , Kazuhiro Nakadai

This paper explores the use of Propositional Dynamic Logic (PDL) as a suitable formal framework for describing Sign Language (SL), the language of deaf people, in the context of natural language processing. SLs are visual, complete,…

Computation and Language · Computer Science 2014-03-27 Arturo Curiel , Christophe Collet

With the development of deep learning (DL), natural language processing (NLP) makes it possible for us to analyze and understand a large amount of language texts. Accordingly, we can achieve a semantic communication in terms of joint…

Computation and Language · Computer Science 2021-11-30 Qingyang Zhou , Rongpeng Li , Zhifeng Zhao , Chenghui Peng , Honggang Zhang

Sign language is the primary language for people with a hearing loss. Sign language recognition (SLR) is the automatic recognition of sign language, which represents a challenging problem for computers, though some progress has been made…

Computer Vision and Pattern Recognition · Computer Science 2021-03-10 Roman Töngi

Sign language is commonly used by deaf or mute people to communicate but requires extensive effort to master. It is usually performed with the fast yet delicate movement of hand gestures, body posture, and even facial expressions. Current…

Computer Vision and Pattern Recognition · Computer Science 2021-10-13 Songyao Jiang , Bin Sun , Lichen Wang , Yue Bai , Kunpeng Li , Yun Fu

To promote inclusion and ensuring effective communication for those who rely on sign language as their main form of communication, sign language recognition (SLR) is crucial. Sign language recognition (SLR) seamlessly incorporates with…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 A. E. M Ridwan , Mushfiqul Islam Chowdhury , Mekhala Mariam Mary , Md Tahmid Chowdhury Abir

The Greek Language Multimodal Lip Reading with Integrated Sign Language Accessibility (GLaM-Sign) [1] is a groundbreaking resource in accessibility and multimodal AI, designed to support Deaf and Hard-of-Hearing (DHH) individuals. Developed…

Computation and Language · Computer Science 2025-01-10 Dimitris Kouremenos , Klimis Ntalianis

Sign language understanding has made significant strides; however, there is still no viable solution for generating sign sequences directly from entire spoken content, e.g., text or speech. In this paper, we propose a unified framework for…

Computation and Language · Computer Science 2024-07-19 Jian Ma , Wenguan Wang , Yi Yang , Feng Zheng

Machine Translation has played a critical role in reducing language barriers, but its adaptation for Sign Language Machine Translation (SLMT) has been less explored. Existing works on SLMT mostly use the Transformer neural network which…

Computation and Language · Computer Science 2025-02-19 Nada Shahin , Leila Ismail

Sign Language Translation (SLT) is a challenging task due to its cross-domain nature, involving the translation of visual-gestural language to text. Many previous methods employ an intermediate representation, i.e., gloss sequences, to…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Benjia Zhou , Zhigang Chen , Albert Clapés , Jun Wan , Yanyan Liang , Sergio Escalera , Zhen Lei , Du Zhang

This study presents TSLFormer, a light and robust word-level Turkish Sign Language (TSL) recognition model that treats sign gestures as ordered, string-like language. Instead of using raw RGB or depth videos, our method only works with 3D…

Computation and Language · Computer Science 2025-06-19 Kutay Ertürk , Furkan Altınışık , İrem Sarıaltın , Ömer Nezih Gerek

Sign languages play a crucial role in the communication of deaf communities, but they are often marginalized, limiting access to essential services such as healthcare and education. This study proposes an automatic sign language recognition…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Fraisse Sacré Takouchouang , Ho Tuong Vinh

We present SignAvatars, the first large-scale, multi-prompt 3D sign language (SL) motion dataset designed to bridge the communication gap for Deaf and hard-of-hearing individuals. While there has been an exponentially growing number of…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Zhengdi Yu , Shaoli Huang , Yongkang Cheng , Tolga Birdal

Sign language is the primary approach of communication for the Deaf and Hard-of-Hearing (DHH) community. While there are numerous benchmarks for high-resource sign languages, low-resource languages like Arabic remain underrepresented.…

Computation and Language · Computer Science 2026-04-01 Mohammad Amer Khalil , Raghad Nahas , Ahmad Nassar , Khloud Al Jallad