English
Related papers

Related papers: Fingerspelling recognition in the wild with iterat…

200 papers

Learning fine-grained movements is a challenging topic in robotics, particularly in the context of robotic hands. One specific instance of this challenge is the acquisition of fingerspelling sign language in robots. In this paper, we…

Robotics · Computer Science 2024-07-25 Federico Tavella , Aphrodite Galata , Angelo Cangelosi

Automatic sign language recognition is an open problem that has received a lot of attention recently, not only because of its usefulness to signers, but also due to the numerous applications a sign classifier can have. In this article, we…

Computer Vision and Pattern Recognition · Computer Science 2015-03-20 Lucas Rioux-Maldague , Philippe Giguère

Accurate recognition and interpretation of sign language are crucial for enhancing communication accessibility for deaf and hard of hearing individuals. However, current approaches of Isolated Sign Language Recognition (ISLR) often face…

Computer Vision and Pattern Recognition · Computer Science 2025-05-14 Karina Kvanchiani , Roman Kraynov , Elizaveta Petrova , Petr Surovcev , Aleksandr Nagaev , Alexander Kapitanov

Sign language to spoken language audio translation is important to connect the hearing- and speech-challenged humans with others. We consider sign language videos with isolated sign sequences rather than continuous grammatical signing. Such…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Harsh Kavediya , Vighnesh Nayak , Bheeshm Sharma , Balamurugan Palaniappan

Sign Language Recognition (SLR) has garnered significant attention from researchers in recent years, particularly the intricate domain of Continuous Sign Language Recognition (CSLR), which presents heightened complexity compared to Isolated…

Computer Vision and Pattern Recognition · Computer Science 2024-02-23 Razieh Rastgoo , Kourosh Kiani , Sergio Escalera

This research paper describes a realtime system for identifying American Sign Language (ASL) movements that employs modern computer vision and machine learning approaches. The suggested method makes use of the Mediapipe library for feature…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Rupesh Kumar , Ashutosh Bajpai , Ayush Sinha

Automatic sign language recognition (SLR) has become a key enabler of inclusive human-computer interaction, fostering seamless communication between deaf individuals and hearing communities. Despite significant advances in multimodal…

Human-Computer Interaction · Computer Science 2026-05-08 Xiaofang Xiao , Guangchao Li , Guangrong Zhao , Qi Lin , Wen Ma , Hongkai Wen , Yanxiang Wang , Yiran Shen

Signed Language Processing (SLP) concerns the automated processing of signed languages, the main means of communication of Deaf and hearing impaired individuals. SLP features many different tasks, ranging from sign recognition to…

Computation and Language · Computer Science 2024-07-25 Federico Tavella , Viktor Schlegel , Marta Romeo , Aphrodite Galata , Angelo Cangelosi

Automatic Sign Language Recognition (ASLR) has emerged as a vital field for bridging the gap between deaf and hearing communities. However, the problem of sign-to-sign retrieval or detecting a specific sign within a sequence of continuous…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Samuel Ebimobowei Johnny , Blessed Guda , Emmanuel Enejo Aaron , Assane Gueye

Gestural language is used by deaf & mute communities to communicate through hand gestures & body movements that rely on visual-spatial patterns known as sign languages. Sign languages, which rely on visual-spatial patterns of hand gestures…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Rajat Singhal , Jatin Gupta , Akhil Sharma , Anushka Gupta , Navya Sharma

Voice-controlled personal and home assistants (such as the Amazon Echo and Apple Siri) are becoming increasingly popular for a variety of applications. However, the benefits of these technologies are not readily accessible to Deaf or…

Machine Learning · Computer Science 2019-09-26 Al Amin Hosain , Panneer Selvam Santhalingam , Parth Pathak , Jana Kosecka , Huzefa Rangwala

Hand gesture-based sign language recognition (SLR) is one of the most advanced applications of machine learning, and computer vision uses hand gestures. Although, in the past few years, many researchers have widely explored and studied how…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Abu Saleh Musa Miah , Md. Al Mehedi Hasan , Md Hadiuzzaman , Muhammad Nazrul Islam , Jungpil Shin

The lack of fluency in sign language remains a barrier to seamless communication for hearing and speech-impaired communities. In this work, we propose a low-cost, real-time ASL-to-speech translation glove and an exhaustive training dataset…

Computation and Language · Computer Science 2024-07-22 Aditya Makkar , Divya Makkar , Aarav Patel , Liam Hebert

In recent years, video conferencing applications have become increasingly prevalent, relying heavily on high-speed internet connectivity. When such connectivity is lacking, users often default to audio-only communication, a mode that…

Multimedia · Computer Science 2025-11-12 Panneer Selvam Santhalingam , Swann Thantsin , Ahmad Kamari , Parth Pathak , Kenneth DeHaan

Sign language is a visual language expressed through hand movements and non-manual markers. Non-manual markers include facial expressions and head movements. These expressions vary across different nations. Therefore, specialized analysis…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Yui Tatsumi , Shoko Tanaka , Shunsuke Akamatsu , Takahiro Shindo , Hiroshi Watanabe

Sign-language recognition has achieved substantial gains in classification accuracy in recent years; however, the latency and power requirements of most existing methods limit their suitability for real-time deployment. Neuromorphic sensing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Sarka Liskova , Olha Vedmedenko , Mazdak Fatahi , Matej Hoffmann , P. Michael Furlong , Giulia D Angelo

The need of sign language is increasing radically especially to hearing impaired community. Only few research groups try to automatically recognize sign language from video, colored gloves and etc. Their approach requires a valid…

Computer Vision and Pattern Recognition · Computer Science 2010-01-13 M. Krishnaveni , Dr. V. Radha

American Sign Language (ASL) is the fourth most commonly used language in the United States and is the language most commonly used by Deaf people in the United States and the English-speaking regions of Canada. Unfortunately, until…

Computer Vision and Pattern Recognition · Computer Science 2020-09-04 Nicholas Wilkins , Beck Cordes Galbraith , Ifeoma Nwogu

Most existing sign language translation (SLT) datasets are limited in scale, lack multilingual coverage, and are costly to curate due to their reliance on expert annotation and controlled recording setup. Recently, Vision Language Models…

Computation and Language · Computer Science 2025-10-30 Shakib Yazdani , Yasser Hamidullah , Cristina España-Bonet , Josef van Genabith

Sign language is commonly used by deaf or mute people to communicate but requires extensive effort to master. It is usually performed with the fast yet delicate movement of hand gestures, body posture, and even facial expressions. Current…

Computer Vision and Pattern Recognition · Computer Science 2021-10-13 Songyao Jiang , Bin Sun , Lichen Wang , Yue Bai , Kunpeng Li , Yun Fu