English
Related papers

Related papers: Enabling American Sign Language Communication Unde…

200 papers

Systems that can efficiently search collections of sign language videos have been highlighted as a useful application of sign language technology. However, the problem of searching videos beyond individual keywords has received limited…

Computer Vision and Pattern Recognition · Computer Science 2022-09-16 Amanda Duarte , Samuel Albanie , Xavier Giró-i-Nieto , Gül Varol

Communicative efficiency is a key topic in linguistics and cognitive psychology, with many studies demonstrating how the pressure to communicate with minimal effort guides the form of natural language. However, this phenomenon is rarely…

Computation and Language · Computer Science 2024-06-11 Kayo Yin , Terry Regier , Dan Klein

The people in the world who are hearing impaired face many obstacles in communication and require an interpreter to comprehend what a person is saying. There has been constant scientific research and the existing models lack the ability to…

Computer Vision and Pattern Recognition · Computer Science 2022-12-08 Shubham Thakar , Samveg Shah , Bhavya Shah , Anant V. Nimkar

The target of this research is to experiment, iterate and recommend a system that is successful in recognition of American Sign Language (ASL). It is a challenging as well as an interesting problem that if solved will bring a leap in social…

Computer Vision and Pattern Recognition · Computer Science 2018-05-18 Dhruv Rathi

American Sign Language (ASL) uses a series of hand based gestures as a replacement for words to allow the deaf to communicate. Previous work has shown that although it takes longer to make signs than to say the equivalent words, on average…

Information Theory · Computer Science 2009-12-10 Andrew Chong , Lalitha Sankar , H. Vincent Poor

There have been recent advances in computer-based recognition of isolated, citation-form signs from video. There are many challenges for such a task, not least the naturally occurring inter- and intra- signer synchronic variation in sign…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Carol Neidle

Sign Language Recognition (SLR) is an essential yet challenging task since sign language is performed with the fast and complex movement of hand gestures, body posture, and even facial expressions. %Skeleton Aware Multi-modal Sign Language…

Computer Vision and Pattern Recognition · Computer Science 2023-02-17 Maxim Novopoltsev , Leonid Verkhovtsev , Ruslan Murtazin , Dmitriy Milevich , Iuliia Zemtsova

Accurate recognition and interpretation of sign language are crucial for enhancing communication accessibility for deaf and hard of hearing individuals. However, current approaches of Isolated Sign Language Recognition (ISLR) often face…

Computer Vision and Pattern Recognition · Computer Science 2025-05-14 Karina Kvanchiani , Roman Kraynov , Elizaveta Petrova , Petr Surovcev , Aleksandr Nagaev , Alexander Kapitanov

The goal of this work is to detect and recognize sequences of letters signed using fingerspelling in British Sign Language (BSL). Previous fingerspelling recognition methods have not focused on BSL, which has a very different signing…

Computer Vision and Pattern Recognition · Computer Science 2022-11-17 K R Prajwal , Hannah Bull , Liliane Momeni , Samuel Albanie , Gül Varol , Andrew Zisserman

Sign Language helps people with Speaking and Hearing Disabilities communicate with others efficiently. Sign Language identification is a challenging area in the field of computer vision and recent developments have been able to achieve near…

Computer Vision and Pattern Recognition · Computer Science 2021-01-21 Yugam Bajaj , Puru Malhotra

Sign language is the primary communication mode for 72 million hearing-impaired individuals worldwide, necessitating effective bidirectional Sign Language Production and Sign Language Translation systems. However, functional bidirectional…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Yulong Li , Yuxuan Zhang , Feilong Tang , Ming Hu , Zhixiang Lu , Haochen Xue , Jianghao Wu , Mian Zhou , Kang Dang , Chong Li , Yifang Wang , Imran Razzak , Jionglong Su

People with vocal and hearing disabilities use sign language to express themselves using visual gestures and signs. Although sign language is a solution for communication difficulties faced by deaf people, there are still problems as most…

Computer Vision and Pattern Recognition · Computer Science 2023-05-01 Mallikharjuna Rao K , Harleen Kaur , Sanjam Kaur Bedi , M A Lekhana

Hearing-impaired is the disability of partial or total hearing loss that causes a significant problem for communication with other people in society. American Sign Language (ASL) is one of the sign languages that most commonly used language…

Computer Vision and Pattern Recognition · Computer Science 2022-06-16 Nelly Elsayed , Zag ElSayed , Anthony S. Maida

Audio is the primary modality for human communication and has driven the success of Automatic Speech Recognition (ASR) technologies. However, such audio-centric systems inherently exclude individuals who are deaf or hard of hearing. Visual…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Jeong Hun Yeo , Hyeongseop Rha , Sungjune Park , Junil Won , Yong Man Ro

Sign language is a visual language that enhances communication between people and is frequently used as the primary form of communication by people with hearing loss. Even so, not many people with hearing loss use sign language, and they…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Rupesh Kumar , Ayush Sinha , Ashutosh Bajpai , S. K Singh

Automatic sign language recognition (SLR) has become a key enabler of inclusive human-computer interaction, fostering seamless communication between deaf individuals and hearing communities. Despite significant advances in multimodal…

Human-Computer Interaction · Computer Science 2026-05-08 Xiaofang Xiao , Guangchao Li , Guangrong Zhao , Qi Lin , Wen Ma , Hongkai Wen , Yanxiang Wang , Yiran Shen

Sign languages are the language of hearing-impaired people who use visuals like the hand, facial, and body movements for communication. There are different signs and gestures representing alphabets, words, and phrases. Nowadays…

Machine Learning · Computer Science 2024-11-08 Sharvani Srivastava , Sudhakar Singh , Pooja , Shiv Prakash

Our objective is to translate continuous sign language into spoken language text. Inspired by the way human interpreters rely on context for accurate translation, we incorporate additional contextual cues together with the signing video,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Youngjoon Jang , Haran Raajesh , Liliane Momeni , Gül Varol , Andrew Zisserman

The complexity of Sign Language (SL) data processing brings many challenges. The current approach to recognition of SL signs aims to translate RGB sign language videos through pose information into Word-based ID Glosses, which serve to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Sen Fang , Yalin Feng , Chunyu Sui , Hongbin Zhong , Yanxin Zhang , Hongwei Yi , Hezhen Hu , Dimitris N. Metaxas

The deaf and hard of hearing community relies on American Sign Language (ASL) as their primary mode of communication, but communication with others who do not know ASL can be difficult, especially during emergencies where no interpreter is…

Image and Video Processing · Electrical Eng. & Systems 2023-05-12 Janice Nguyen , Y. Curtis Wang