English
Related papers

Related papers: A prototype Malayalam to Sign Language Automatic T…

200 papers

This article presents an original method for Text-to-Sign Translation. It compensates data scarcity using a domain-specific parallel corpus of alignments between text and hierarchical formal descriptions of Sign Language videos in AZee.…

Computation and Language · Computer Science 2022-05-09 Élise Bertin-Lemée , Annelies Braffort , Camille Challant , Claire Danet , Michael Filhol

Sign languages play a crucial role in the communication of deaf communities, but they are often marginalized, limiting access to essential services such as healthcare and education. This study proposes an automatic sign language recognition…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Fraisse Sacré Takouchouang , Ho Tuong Vinh

Our objective is to translate continuous sign language into spoken language text. Inspired by the way human interpreters rely on context for accurate translation, we incorporate additional contextual cues together with the signing video,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Youngjoon Jang , Haran Raajesh , Liliane Momeni , Gül Varol , Andrew Zisserman

Sign languages use multiple asynchronous information channels (articulators), not just the hands but also the face and body, which computational approaches often ignore. In this paper we tackle the multi-articulatory sign language…

Computer Vision and Pattern Recognition · Computer Science 2020-09-02 Necati Cihan Camgoz , Oscar Koller , Simon Hadfield , Richard Bowden

Recent advancements in the field of computer vision with the help of deep neural networks have led us to explore and develop many existing challenges that were once unattended due to the lack of necessary technologies. Hand Sign/Gesture…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Shahjalal Ahmed , Md. Rafiqul Islam , Jahid Hassan , Minhaz Uddin Ahmed , Bilkis Jamal Ferdosi , Sanjay Saha , Md. Shopon

Sign Language (SL), as the mother tongue of the deaf community, is a special visual language that most hearing people cannot understand. In recent years, neural Sign Language Translation (SLT), as a possible way for bridging communication…

Computation and Language · Computer Science 2022-11-02 Jiangbin Zheng , Siyuan Li , Cheng Tan , Chong Wu , Yidong Chen , Stan Z. Li

We outline a bidirectional translation system that converts sentences from American Sign Language (ASL) to English, and vice versa. To perform machine translation between ASL and English, we utilize a generative approach. Specifically, we…

Computation and Language · Computer Science 2017-01-12 Hardie Cate , Zeshan Hussain

Modern computational linguistic software cannot produce important aspects of sign language translation. Using some researches we deduce that the majority of automatic sign language translation systems ignore many aspects when they generate…

Computation and Language · Computer Science 2012-03-15 Mehrez Boulares , Mohamed Jemni

Sign Language Translation has attained considerable success recently, raising hopes for improved communication with the Deaf. A pre-processing step called tokenization improves the success of translations. Tokens can be learned from sign…

Computer Vision and Pattern Recognition · Computer Science 2020-03-05 Alptekin Orbay , Lale Akarun

Sign Language Translation (SLT) aims to convert sign language (SL) videos into spoken language text, thereby bridging the communication gap between the sign and the spoken community. While most existing works focus on translating a single…

Computation and Language · Computer Science 2025-06-02 Sihan Tan , Taro Miyazaki , Kazuhiro Nakadai

Sign languages are natural, visual-gestural languages used by Deaf communities worldwide. Over 300 distinct sign languages remain severely low-resource due to limited documentation, sparse datasets, and insufficient computational tools.…

Computation and Language · Computer Science 2026-05-13 Nigar Alishzade , Gulchin Abdullayeva

As the main means of communication for deaf people, sign language has a special grammatical order, so it is meaningful and valuable to develop a real-time translation system for sign language. In the research process, we added a TSM module…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Shengzhuo Wei , Yan Lan

Transliteration is a task in the domain of NLP where the output word is a similar-sounding word written using the letters of any foreign language. Today this system has been developed for several language pairs that involve English as…

Computation and Language · Computer Science 2022-08-24 Yash Raj , Bhavesh Laddagiri

Emotional voice communication plays a crucial role in effective daily interactions. Deaf and hard-of-hearing (DHH) individuals often rely on facial expressions to supplement sign language to convey emotions, as the use of voice is limited.…

Human-Computer Interaction · Computer Science 2024-12-10 Hyunchul Lim , Minghan Gao , Franklin Mingzhe Li , Nam Anh Dang , Ianip Sit , Michelle M Olson , Cheng Zhang

The hearing-impaired community in India deserves the access to tools that help them communicate, however, there is limited known technology solutions that make use of Indian Sign Language (ISL) at present. Even though there are many ISL…

Machine Learning · Computer Science 2024-12-11 Smruti Jagtap , Kanika Jadhav , Rushikesh Temkar , Minal Deshmukh

Sign languages are multi-channel languages that communicate information through not just the hands (manual signals) but also facial expressions and upper body movements (non-manual signals). However, since automatic sign language…

Computation and Language · Computer Science 2024-06-12 Jung-Ho Kim , Mathew Huerta-Enochian , Changyong Ko , Du Hui Lee

Sign languages are the language of hearing-impaired people who use visuals like the hand, facial, and body movements for communication. There are different signs and gestures representing alphabets, words, and phrases. Nowadays…

Machine Learning · Computer Science 2024-11-08 Sharvani Srivastava , Sudhakar Singh , Pooja , Shiv Prakash

Braille is the only system to visually impaired people for reading and writing. However, general people cannot read Braille. So, teachers and relatives find it hard to assist them with learning. Almost every major language has software…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Minhas Kamal , Amin Ahsan Ali , Muhammad Asif Hossain Khan , Mohammad Shoyaib

We introduce SignBank+, a clean version of the SignBank dataset, optimized for machine translation between spoken language text and SignWriting, a phonetic sign language writing system. In addition to previous work that employs complex…

Computation and Language · Computer Science 2024-03-22 Amit Moryossef , Zifan Jiang

Sign language is an essential means of communication for millions of people around the world and serves as their primary language. However, most communication tools are developed for spoken and written languages which can cause problems and…

Computation and Language · Computer Science 2024-07-16 Ali Ghadami , Alireza Taheri , Ali Meghdari