English
Related papers

Related papers: Multilingual Communication System with Deaf Indivi…

200 papers

Video conferencing has become central to professional collaboration, yet most platforms offer limited support for deaf, hard-of-hearing, and multilingual users. The World Health Organisation estimates that over 430 million people worldwide…

Computational Engineering, Finance, and Science · Computer Science 2026-04-08 Nikolaos D. Tantaroudas , Andrew J. McCracken , Ilias Karachalios , Evangelos Papatheou

There is an undeniable communication barrier between deaf people and people with normal hearing ability. Although innovations in sign language translation technology aim to tear down this communication barrier, the majority of existing sign…

Computer Vision and Pattern Recognition · Computer Science 2018-10-19 Biyi Fang , Jillian Co , Mi Zhang

These days mobile devices like phones or tablets are very common among people of all age. They are connected with network and provide seamless communications through internet or cellular services. These devices can be a big help for the…

Human-Computer Interaction · Computer Science 2015-03-13 Jagdish L. Raheja , A. Singhal , A. Chaudhary

Sign Language is the dominant form of communication language used in the deaf and hearing-impaired community. To make an easy and mutual communication between the hearing-impaired and the hearing communities, building a robust system…

Computer Vision and Pattern Recognition · Computer Science 2022-01-07 Razieh Rastgoo , Kourosh Kiani , Sergio Escalera , Vassilis Athitsos , Mohammad Sabokrou

People with speech and hearing impairments often rely on sign language to communicate with others but most of the general population cannot understand sign language and sign language itself is a difficult language to learn, so there is a…

Human-Computer Interaction · Computer Science 2020-09-10 Sai Charan Bodda , Palki Gupta , Gaurav Joshi , Ayush Chaturvedi

Developing successful sign language recognition, generation, and translation systems requires expertise in a wide range of fields, including computer vision, computer graphics, natural language processing, human-computer interaction,…

Sign language is the fundamental communication method among people who suffer from speech and hearing defects. The rest of the world doesn't have a clear idea of sign language. "Sign Language Communicator" (SLC) is designed to solve the…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Matheesha Fernando , Janaka Wijayanayake

Sign(ed) languages use gestures, such as hand or head movements, for communication. Sign language recognition is an assistive technology for individuals with hearing disability and its goal is to improve such individuals' life quality by…

Human-Computer Interaction · Computer Science 2019-11-04 Mohammad Eslami , Mahdi Karami , Sedigheh Eslami , Solale Tabarestani , Farah Torkamani-Azar , Christoph Meinel

Sign language recognition is a challenging and often underestimated problem comprising multi-modal articulators (handshape, orientation, movement, upper body and face) that integrate asynchronously on multiple streams. Learning powerful…

Computer Vision and Pattern Recognition · Computer Science 2019-11-22 Hamid Reza Vaezi Joze , Oscar Koller

Multimodal Large Language Models (MLLMs) have demonstrated significant advances across numerous vision-language tasks. MLLMs have shown promising capability in aligning visual and textual modalities, allowing them to process image-text…

Computation and Language · Computer Science 2025-09-29 Xiaolong Wang , Zhaolu Kang , Wangyuxuan Zhai , Xinyue Lou , Yunghwei Lai , Ziyue Wang , Yawen Wang , Kaiyu Huang , Yile Wang , Peng Li , Yang Liu

Visually impaired people are often confronted with new environments and they find themselves face to face with an innumerous amount of difficulties when facing these environments. Having to surpass and deal with these difficulties that…

Human-Computer Interaction · Computer Science 2014-02-07 Ivo Rafael

To be truly understandable and accepted by Deaf communities, an automatic Sign Language Production (SLP) system must generate a photo-realistic signer. Prior approaches based on graphical avatars have proven unpopular, whereas recent neural…

Computer Vision and Pattern Recognition · Computer Science 2020-11-30 Ben Saunders , Necati Cihan Camgoz , Richard Bowden

Accessibility remains a critical concern in today's society, as many technologies are not developed to support the full range of user needs. Existing multi-agent systems (MAS) often cannot provide comprehensive assistance for users in need…

Multiagent Systems · Computer Science 2025-07-16 Aleksandr Algazinov , Matt Laing , Paul Laban

Human communication is a complex and diverse process that not only involves multiple factors such as language, commonsense, and cultural backgrounds but also requires the participation of multimodal information, such as speech. Large…

Computation and Language · Computer Science 2024-01-09 Dong Zhang , Zhaowei Li , Pengyu Wang , Xin Zhang , Yaqian Zhou , Xipeng Qiu

Sign language is the primary language for many Deaf and Hard-of-Hearing (DHH) signers, yet most conversational AI systems still mediate interaction through spoken or written language. This spoken-language-centered interface can limit access…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Youngmin Kim , Kyobin Choo , Jiwoo Park , Minseo Kim , Chanyoung Kim , Junhyeok Kim , Seong Jae Hwang

Speech is essential for human communication, yet millions of people face impairments such as dysarthria, stuttering, and aphasia conditions that often lead to social isolation and reduced participation. Despite recent progress in automatic…

Systems and Control · Electrical Eng. & Systems 2025-10-24 Haowei Lou , Chengkai Huang , Hye-young Paik , Yongquan Hu , Aaron Quigley , Wen Hu , Lina Yao

Understanding details of human multimodal interaction can elucidate many aspects of the type of information processing machines must perform to interact with humans. This article gives an overview of recent findings from Linguistics…

Computation and Language · Computer Science 2020-08-10 João Ranhel , Cacilda Vilela

Sign language visual recognition from continuous multi-modal streams is still one of the most challenging fields. Recent advances in human actions recognition are exploiting the ascension of GPU-based learning from massive data, and are…

Computer Vision and Pattern Recognition · Computer Science 2020-09-23 Bassem Seddik , Najoua Essoukri Ben Amara

Significant advances have been made in our ability to understand and generate emotionally expressive content such as text and speech, yet comparable progress in sign language technologies remain limited. While computational approaches to…

Human-Computer Interaction · Computer Science 2025-05-14 Phoebe Chua , Cathy Mengying Fang , Yasith Samaradivakara , Pattie Maes , Suranga Nanayakkara

Sign Language Processing (SLP) is an interdisciplinary field comprised of Natural Language Processing (NLP) and Computer Vision. It is focused on the computational understanding, translation, and production of signed languages. Traditional…

Computation and Language · Computer Science 2024-12-04 Amit Moryossef