English
Related papers

Related papers: A prototype Malayalam to Sign Language Automatic T…

200 papers

Sign Language is the dominant form of communication language used in the deaf and hearing-impaired community. To make an easy and mutual communication between the hearing-impaired and the hearing communities, building a robust system…

Computer Vision and Pattern Recognition · Computer Science 2022-01-07 Razieh Rastgoo , Kourosh Kiani , Sergio Escalera , Vassilis Athitsos , Mohammad Sabokrou

The objective of this paper is to develop a functional system for translating spoken languages into sign languages, referred to as Spoken2Sign translation. The Spoken2Sign task is orthogonal and complementary to traditional sign language to…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Ronglai Zuo , Fangyun Wei , Zenggui Chen , Brian Mak , Jiaolong Yang , Xin Tong

Sign Languages are the primary form of communication for Deaf communities across the world. To break the communication barriers between the Deaf and Hard-of-Hearing and the hearing communities, it is imperative to build systems capable of…

Machine Learning · Computer Science 2025-03-05 Chrysa Pratikaki , Panagiotis Filntisis , Athanasios Katsamanis , Anastasios Roussos , Petros Maragos

This works aims to design a statistical machine translation from English text to American Sign Language (ASL). The system is based on Moses tool with some modifications and the results are synthesized through a 3D avatar for interpretation.…

Computation and Language · Computer Science 2011-12-02 Achraf Othman , Mohamed Jemni

Sign language translation (SLT) is a challenging task that involves translating sign language images into spoken language. For SLT models to perform this task successfully, they must bridge the modality gap and identify subtle variations in…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Jungeun Kim , Hyeongwoo Jeon , Jongseong Bae , Ha Young Kim

This project explores methods to enhance sign language translation of German sign language, specifically focusing on disambiguation of homonyms. Sign language is ambiguous and understudied which is the basis for our experiments. We approach…

Computation and Language · Computer Science 2024-09-16 Jana Grimm , Miriam Winkler , Oliver Kraus , Tanalp Agustoslu

These days mobile devices like phones or tablets are very common among people of all age. They are connected with network and provide seamless communications through internet or cellular services. These devices can be a big help for the…

Human-Computer Interaction · Computer Science 2015-03-13 Jagdish L. Raheja , A. Singhal , A. Chaudhary

Large language models, with their strong reasoning ability and rich knowledge, have brought revolution to many tasks of AI, but their impact on sign language generation remains limited due to its complexity and unique rules. In this paper,…

Computation and Language · Computer Science 2025-07-16 Zhaoyi An , Rei Kawakami

This paper presents work on novel machine translation (MT) systems between spoken and signed languages, where signed languages are represented in SignWriting, a sign language writing system. Our work seeks to address the lack of…

Computation and Language · Computer Science 2023-02-24 Zifan Jiang , Amit Moryossef , Mathias Müller , Sarah Ebling

With the growing Deaf and Hard of Hearing population worldwide and the persistent shortage of certified sign language interpreters, there is a pressing need for an efficient, signs-driven, integrated end-to-end translation system, from sign…

Artificial Intelligence · Computer Science 2025-02-17 Nada Shahin , Leila Ismail

We present Large Sign Language Models (LSLM), a novel framework for translating 3D American Sign Language (ASL) by leveraging Large Language Models (LLMs) as the backbone, which can benefit hearing-impaired individuals' virtual…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Sen Zhang , Xiaoxiao He , Di Liu , Zhaoyang Xia , Mingyu Zhao , Chaowei Tan , Vivian Li , Bo Liu , Dimitris N. Metaxas , Mubbasir Kapadia

Sign language, which conveys meaning through gestures, is the chief means of communication among deaf people. Recognizing sign language in natural settings presents significant challenges due to factors such as lighting, background clutter,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Bowen Shi

The hand gestures are one of the typical methods used in sign language. It is very difficult for the hearing-impaired people to communicate with the world. This project presents a solution that will not only automatically recognize the hand…

Computer Vision and Pattern Recognition · Computer Science 2018-11-30 K. Manikandan , Ayush Patidar , Pallav Walia , Aneek Barman Roy

Sign language is a gesture-based symbolic communication medium among speech and hearing impaired people. It also serves as a communication bridge between non-impaired and impaired populations. Unfortunately, in most situations, a…

Computer Vision and Pattern Recognition · Computer Science 2025-02-19 Prasun Roy , Saumik Bhattacharya , Partha Pratim Roy , Umapada Pal

Significant advances have been made in our ability to understand and generate emotionally expressive content such as text and speech, yet comparable progress in sign language technologies remain limited. While computational approaches to…

Human-Computer Interaction · Computer Science 2025-05-14 Phoebe Chua , Cathy Mengying Fang , Yasith Samaradivakara , Pattie Maes , Suranga Nanayakkara

The absence of effective communication the deaf population represents the main social gap in this community. Furthermore, the sign language, main deaf communication tool, is unlettered, i.e., there is no formal written representation. In…

Computation and Language · Computer Science 2025-03-26 Fredy Alejandro Mendoza López , Jefferson Rodriguez , Fabio Martínez

Sign language is a visual language that encompasses all linguistic features of natural languages and serves as the primary communication method for the deaf and hard-of-hearing communities. Although many studies have successfully adapted…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Ronglai Zuo , Rolandos Alexandros Potamias , Evangelos Ververas , Jiankang Deng , Stefanos Zafeiriou

People with speech and hearing impairments often rely on sign language to communicate with others but most of the general population cannot understand sign language and sign language itself is a difficult language to learn, so there is a…

Human-Computer Interaction · Computer Science 2020-09-10 Sai Charan Bodda , Palki Gupta , Gaurav Joshi , Ayush Chaturvedi

This paper explores the use of Propositional Dynamic Logic (PDL) as a suitable formal framework for describing Sign Language (SL), the language of deaf people, in the context of natural language processing. SLs are visual, complete,…

Computation and Language · Computer Science 2014-03-27 Arturo Curiel , Christophe Collet

The paper aims to show how an application can be developed that converts the English language into the Punjabi Language, and the same application can convert the Text to Speech(TTS) i.e. pronounce the text. This application can be really…

Computation and Language · Computer Science 2015-03-09 Prabhsimran Singh , Amritpal Singh