English
Related papers

Related papers: Towards AI-driven Sign Language Generation with No…

200 papers

Translating written sentences from oral languages to a sequence of manual and non-manual gestures plays a crucial role in building a more inclusive society for deaf and hard-of-hearing people. Facial expressions (non-manual), in particular,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Rafael Azevedo , Thiago Coutinho , João Ferreira , Thiago Gomes , Erickson Nascimento

Sign Language Assessment (SLA) tools are useful to aid in language learning and are underdeveloped. Previous work has focused on isolated signs or comparison against a single reference video to assess Sign Languages (SL). This paper…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Oliver Cory , Ozge Mercanoglu Sincan , Matthew Vowels , Alessia Battisti , Franz Holzknecht , Katja Tissi , Sandra Sidler-Miserez , Tobias Haug , Sarah Ebling , Richard Bowden

Sign language translation (SLT) is a challenging task that involves translating sign language images into spoken language. For SLT models to perform this task successfully, they must bridge the modality gap and identify subtle variations in…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Jungeun Kim , Hyeongwoo Jeon , Jongseong Bae , Ha Young Kim

Sign languages play a crucial role in the communication of deaf communities, but they are often marginalized, limiting access to essential services such as healthcare and education. This study proposes an automatic sign language recognition…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Fraisse Sacré Takouchouang , Ho Tuong Vinh

Sign language is the primary language for people with a hearing loss. Sign language recognition (SLR) is the automatic recognition of sign language, which represents a challenging problem for computers, though some progress has been made…

Computer Vision and Pattern Recognition · Computer Science 2021-03-10 Roman Töngi

American Sign Language recognition is a difficult gesture recognition problem, characterized by fast, highly articulate gestures. These are comprised of arm movements with different hand shapes, facial expression and head movements. Among…

Computer Vision and Pattern Recognition · Computer Science 2020-03-20 Al Amin Hosain , Panneer Selvam Santhalingam , Parth Pathak , Huzefa Rangwala , Jana Kosecka

Large Language Models (LLMs) have recently garnered significant attention, primarily for their capabilities in text-based interactions. However, natural human interaction often relies on speech, necessitating a shift towards voice-based…

Computation and Language · Computer Science 2025-08-08 Wenqian Cui , Dianzhi Yu , Xiaoqi Jiao , Ziqiao Meng , Guangyan Zhang , Qichao Wang , Yiwen Guo , Irwin King

Translating natural languages into sign languages is a highly complex and underexplored task. Despite growing interest in accessibility and inclusivity, the development of robust translation systems remains hindered by the limited…

Computation and Language · Computer Science 2025-09-09 Luana Bulla , Gabriele Tuccio , Misael Mongiovì , Aldo Gangemi

This study explores integrating sign language into virtual reality (VR) by examining the comprehensibility and user experience of viewing American Sign Language (ASL) videos captured with body-mounted 360-degree cameras. Ten participants…

Human-Computer Interaction · Computer Science 2026-02-27 Gauri Umesh Rajmane , Ziming Li , Tae Oh , Roshan Peiris

Sign language translation from text to video plays a crucial role in enabling effective communication for Deaf and hard--of--hearing individuals. A major challenge lies in generating accurate and natural body poses and movements that…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Zetian Wu , Tianshuo Zhou , Stefan Lee , Liang Huang

Recent advancements in the field of computer vision with the help of deep neural networks have led us to explore and develop many existing challenges that were once unattended due to the lack of necessary technologies. Hand Sign/Gesture…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Shahjalal Ahmed , Md. Rafiqul Islam , Jahid Hassan , Minhaz Uddin Ahmed , Bilkis Jamal Ferdosi , Sanjay Saha , Md. Shopon

Sign language is a gesture-based symbolic communication medium among speech and hearing impaired people. It also serves as a communication bridge between non-impaired and impaired populations. Unfortunately, in most situations, a…

Computer Vision and Pattern Recognition · Computer Science 2025-02-19 Prasun Roy , Saumik Bhattacharya , Partha Pratim Roy , Umapada Pal

Sign language recognition and translation technologies have the potential to increase access and inclusion of deaf signing communities, but research progress is bottlenecked by a lack of representative data. We introduce a new resource for…

Computation and Language · Computer Science 2023-10-03 Lee Kezar , Elana Pontecorvo , Adele Daniels , Connor Baer , Ruth Ferster , Lauren Berger , Jesse Thomason , Zed Sevcikova Sehyr , Naomi Caselli

Sign Language (SL) automatic processing slowly progresses bottom-up. The field has seen proposition to handle the video signal, to recognize and synthesize sublexical and lexical units. It starts to see the development of supra-lexical…

Computation and Language · Computer Science 2014-03-19 Rémi Dubot , Christophe Collet

Automatic Sign Language Translation requires the integration of both computer vision and natural language processing to effectively bridge the communication gap between sign and spoken languages. However, the deficiency in large-scale…

Computer Vision and Pattern Recognition · Computer Science 2024-05-08 Ryan Wong , Necati Cihan Camgoz , Richard Bowden

Sign languages are the primary means of communication for many hard-of-hearing people worldwide. Recently, to bridge the communication gap between the hard-of-hearing community and the rest of the population, several sign language…

Computation and Language · Computer Science 2023-07-12 Abhinav Joshi , Susmit Agrawal , Ashutosh Modi

Indian Sign Language has limited resources for developing machine learning and data-driven approaches for automated language processing. Though text/audio-based language processing techniques have shown colossal research interest and…

Computation and Language · Computer Science 2024-07-09 Abhinav Joshi , Romit Mohanty , Mounika Kanakanti , Andesha Mangla , Sudeep Choudhary , Monali Barbate , Ashutosh Modi

Sign languages are multi-channel languages that communicate information through not just the hands (manual signals) but also facial expressions and upper body movements (non-manual signals). However, since automatic sign language…

Computation and Language · Computer Science 2024-06-12 Jung-Ho Kim , Mathew Huerta-Enochian , Changyong Ko , Du Hui Lee

For d/Deaf and hard of hearing (DHH) people, captioning is an essential accessibility tool. Significant developments in artificial intelligence (AI) mean that Automatic Speech Recognition (ASR) is now a part of many popular applications.…

Computation and Language · Computer Science 2024-08-30 Korbinian Kuhn , Verena Kersken , Benedikt Reuter , Niklas Egger , Gottfried Zimmermann

Sign languages, used by around 70 million Deaf individuals globally, are visual languages that convey visual and contextual information. Current methods in vision-based sign language recognition (SLR) and translation (SLT) struggle with…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Yuqi Liu , Wenqian Zhang , Sihan Ren , Chengyu Huang , Jingyi Yu , Lan Xu