English
Related papers

Related papers: Two-Stream Network for Sign Language Recognition a…

200 papers

Sign languages play a crucial role in the communication of deaf communities, but they are often marginalized, limiting access to essential services such as healthcare and education. This study proposes an automatic sign language recognition…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Fraisse Sacré Takouchouang , Ho Tuong Vinh

Sign Language Production (SLP) is the process of converting the complex input text into a real video. Most previous works focused on the Text2Gloss, Gloss2Pose, Pose2Vid stages, and some concentrated on Prompt2Gloss and Text2Avatar stages.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Sen Fang , Yalin Feng , Hongbin Zhong , Yanxin Zhang , Dimitris N. Metaxas

In recent years, deep learning techniques have been used to develop sign language recognition systems, potentially serving as a communication tool for millions of hearing-impaired individuals worldwide. However, there are inherent…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Alvaro Leandro Cavalcante Carneiro , Denis Henrique Pinheiro Salvadeo , Lucas de Brito Silva

Sign language to spoken language audio translation is important to connect the hearing- and speech-challenged humans with others. We consider sign language videos with isolated sign sequences rather than continuous grammatical signing. Such…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Harsh Kavediya , Vighnesh Nayak , Bheeshm Sharma , Balamurugan Palaniappan

Sign language translation (SLT) is an active field of study that encompasses human-computer interaction, computer vision, natural language processing and machine learning. Progress on this field could lead to higher levels of integration of…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Pedro Dal Bianco , Gastón Ríos , Franco Ronchetti , Facundo Quiroga , Oscar Stanchi , Waldo Hasperué , Alejandro Rosete

Deaf individuals confront significant communication obstacles on a daily basis. Their inability to hear makes it difficult for them to communicate with those who do not understand sign language. Moreover, it presents difficulties in…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 Velmathi G , Kaushal Goyal

Reasoning Segmentation (RS) is a multimodal vision-text task that requires segmenting objects based on implicit text queries, demanding both precise visual perception and vision-text reasoning capabilities. Current RS approaches rely on…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Yizhen Li , Dell Zhang , Xuelong Li , Yiqing Shen

Sign Language Recognition (SLR) involves the automatic identification and classification of sign gestures from images or video, converting them into text or speech to improve accessibility for the hearing-impaired community. In Bangladesh,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Jubayer Ahmed Bhuiyan Shawon , Hasan Mahmud , Kamrul Hasan

In this paper, we present our solution to the Cross-View Isolated Sign Language Recognition (CV-ISLR) challenge held at WWW 2025. CV-ISLR addresses a critical issue in traditional Isolated Sign Language Recognition (ISLR), where existing…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Fei Wang , Kun Li , Yiqi Nie , Zhangling Duan , Peng Zou , Zhiliang Wu , Yuwei Wang , Yanyan Wei

Self-Supervised Learning is vastly used to efficiently represent speech for Spoken Language Understanding, gradually replacing conventional approaches. Meanwhile, textual SSL models are proposed to encode language-agnostic semantics.…

Computation and Language · Computer Science 2024-06-19 Gaëlle Laperrière , Sahar Ghannay , Bassam Jabaian , Yannick Estève

Simultaneous speech translation (SST) outputs translations in parallel with streaming speech input, balancing translation quality and latency. While large language models (LLMs) have been extended to handle the speech modality, streaming…

Computation and Language · Computer Science 2025-04-23 Keqi Deng , Wenxi Chen , Xie Chen , Philip C. Woodland

Self-supervised learning (SSL) has emerged as a promising paradigm for learning flexible speech representations from unlabeled data. By designing pretext tasks that exploit statistical regularities, SSL models can capture useful…

Sound · Computer Science 2024-01-25 Yusuf Brima , Ulf Krumnack , Simone Pika , Gunther Heidemann

Gestural language is used by deaf & mute communities to communicate through hand gestures & body movements that rely on visual-spatial patterns known as sign languages. Sign languages, which rely on visual-spatial patterns of hand gestures…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Rajat Singhal , Jatin Gupta , Akhil Sharma , Anushka Gupta , Navya Sharma

Previous Sign Language Translation (SLT) methods achieve superior performance by relying on gloss annotations. However, labeling high-quality glosses is a labor-intensive task, which limits the further development of SLT. Although some…

Computation and Language · Computer Science 2024-03-20 Zhigang Chen , Benjia Zhou , Jun Li , Jun Wan , Zhen Lei , Ning Jiang , Quan Lu , Guoqing Zhao

In this paper, a comparative experimental assessment of computer vision-based methods for sign language recognition is conducted. By implementing the most recent deep neural network methods in this field, a thorough evaluation on multiple…

Continuous Sign Language Recognition (CSLR) focuses on the interpretation of a sequence of sign language gestures performed continually without pauses. In this study, we conduct an empirical evaluation of recent deep learning CSLR…

Computation and Language · Computer Science 2024-10-23 Sarah Alyami , Hamzah Luqman

Natural language processing for sign language video - including tasks like recognition, translation, and search - is crucial for making artificial intelligence technologies accessible to deaf individuals, and is gaining research interest in…

Computer Vision and Pattern Recognition · Computer Science 2022-03-28 Bowen Shi , Diane Brentari , Greg Shakhnarovich , Karen Livescu

Hand gesture-based sign language recognition (SLR) is one of the most advanced applications of machine learning, and computer vision uses hand gestures. Although, in the past few years, many researchers have widely explored and studied how…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Abu Saleh Musa Miah , Md. Al Mehedi Hasan , Md Hadiuzzaman , Muhammad Nazrul Islam , Jungpil Shin

The recent surge in large language models has automated translations of spoken and written languages. However, these advances remain largely inaccessible to American Sign Language (ASL) users, whose language relies on complex visual cues.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Daniel Perkins , Davis Hunter , Dhrumil Patel , Galen Flanagan

Helping deaf and hard-of-hearing people communicate more easily is the main goal of Automatic Sign Language Translation. Although most past research has focused on turning sign language into text, doing the reverse, turning spoken English…

Computer Vision and Pattern Recognition · Computer Science 2025-07-10 Kazi Mahathir Rahman , Naveed Imtiaz Nafis , Md. Farhan Sadik , Mohammad Al Rafi , Mehedi Hasan Shahed