English
Related papers

Related papers: Automatic Hand Sign Recognition: Identify Unusuali…

200 papers

Indonesia ranks fourth globally in the number of deaf cases. Individuals with hearing impairments often find communication challenging, necessitating the use of sign language. However, there are limited public services that offer such…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Muchammad Daniyal Kautsar , Afra Majida Hariono , Ridwan Akmal

Sign language is the fundamental communication method among people who suffer from speech and hearing defects. The rest of the world doesn't have a clear idea of sign language. "Sign Language Communicator" (SLC) is designed to solve the…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Matheesha Fernando , Janaka Wijayanayake

Automatic sign language recognition is an open problem that has received a lot of attention recently, not only because of its usefulness to signers, but also due to the numerous applications a sign classifier can have. In this article, we…

Computer Vision and Pattern Recognition · Computer Science 2015-03-20 Lucas Rioux-Maldague , Philippe Giguère

A machine can understand human activities, and the meaning of signs can help overcome the communication barriers between the inaudible and ordinary people. Sign Language Recognition (SLR) is a fascinating research area and a crucial task…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 M. Madhiarasan , Partha Pratim Roy

Large language models, with their strong reasoning ability and rich knowledge, have brought revolution to many tasks of AI, but their impact on sign language generation remains limited due to its complexity and unique rules. In this paper,…

Computation and Language · Computer Science 2025-07-16 Zhaoyi An , Rei Kawakami

This paper explores the critical but often overlooked role of non-verbal cues, including co-speech gestures and facial expressions, in human communication and their implications for Natural Language Processing (NLP). We argue that…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-14 Amit Moryossef

Labeling is the cornerstone of supervised machine learning, which has been exploited in a plethora of various applications, with sign language recognition being one of them. However, such algorithms must be fed with a huge amount of…

Conversational systems rely heavily on speech recognition to interpret and respond to user commands and queries. Despite progress on speech recognition accuracy, errors may still sometimes occur and can significantly affect the end-user…

Human-Computer Interaction · Computer Science 2025-06-23 Sadia Nowrin , Keith Vertanen

People with vocal and hearing disabilities use sign language to express themselves using visual gestures and signs. Although sign language is a solution for communication difficulties faced by deaf people, there are still problems as most…

Computer Vision and Pattern Recognition · Computer Science 2023-05-01 Mallikharjuna Rao K , Harleen Kaur , Sanjam Kaur Bedi , M A Lekhana

Sign language translation from text to video plays a crucial role in enabling effective communication for Deaf and hard--of--hearing individuals. A major challenge lies in generating accurate and natural body poses and movements that…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Zetian Wu , Tianshuo Zhou , Stefan Lee , Liang Huang

In this project, we have developed a sign language tutor that lets users learn isolated signs by watching recorded videos and by trying the same signs. The system records the user's video and analyses it. If the sign is recognized, both…

Sign Language Translation has attained considerable success recently, raising hopes for improved communication with the Deaf. A pre-processing step called tokenization improves the success of translations. Tokens can be learned from sign…

Computer Vision and Pattern Recognition · Computer Science 2020-03-05 Alptekin Orbay , Lale Akarun

Growing research in sign language recognition, generation, and translation AI has been accompanied by calls for ethical development of such technologies. While these works are crucial to helping individual researchers do better, there is a…

Computer Vision and Pattern Recognition · Computer Science 2024-03-06 Aashaka Desai , Maartje De Meulder , Julie A. Hochgesang , Annemarie Kocab , Alex X. Lu

We present an interactive machine translation (MT) system designed for users who are not proficient in the target language. It aims to improve trustworthiness and explainability by identifying potentially mistranslated words and allowing…

Computation and Language · Computer Science 2025-04-01 Kenneth J. Sible , David Chiang

Translating spoken languages into Sign languages is necessary for open communication between the hearing and hearing-impaired communities. To achieve this goal, we propose the first method for animating a text written in HamNoSys, a lexical…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Rotem Shalev-Arkushin , Amit Moryossef , Ohad Fried

Deaf individuals confront significant communication obstacles on a daily basis. Their inability to hear makes it difficult for them to communicate with those who do not understand sign language. Moreover, it presents difficulties in…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 Velmathi G , Kaushal Goyal

We study the problem of recognizing video sequences of fingerspelled letters in American Sign Language (ASL). Fingerspelling comprises a significant but relatively understudied part of ASL. Recognizing fingerspelling is challenging for a…

Computation and Language · Computer Science 2016-09-27 Taehwan Kim , Jonathan Keane , Weiran Wang , Hao Tang , Jason Riggle , Gregory Shakhnarovich , Diane Brentari , Karen Livescu

Sign language serves as the primary meaning of communication for the deaf-mute community. Different from spoken language, it commonly conveys information by the collaboration of manual features, i.e., hand gestures and body movements, and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-19 Wengang Zhou , Weichao Zhao , Hezhen Hu , Zecheng Li , Houqiang Li

The count of people suffering from various levels of hearing loss reached 1.57 billion in 2019. This huge number tends to suffer on many personal and professional levels and strictly needs to be included with the rest of society healthily.…

Signal Processing · Electrical Eng. & Systems 2023-12-20 Basma Kalandar , Ziemowit Dworakowski

Sign Language Recognition (SLR) is an essential yet challenging task since sign language is performed with the fast and complex movement of hand gestures, body posture, and even facial expressions. %Skeleton Aware Multi-modal Sign Language…

Computer Vision and Pattern Recognition · Computer Science 2023-02-17 Maxim Novopoltsev , Leonid Verkhovtsev , Ruslan Murtazin , Dmitriy Milevich , Iuliia Zemtsova