English
Related papers

Related papers: Breaking the Barriers: Video Vision Transformers f…

200 papers

Sign language is the primary communication language for people with disabling hearing loss. Sign language recognition (SLR) systems aim to recognize sign gestures and translate them into spoken language. One of the main challenges in SLR is…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Hasan Algafri , Hamzah Luqman , Sarah Alyami , Issam Laradji

According to interviews with people who work with speech impaired persons, speech impaired people have difficulties in communicating with other people around them who do not know the sign language, and this situation may cause them to…

Computer Vision and Pattern Recognition · Computer Science 2021-02-24 Arda Mavi

In this paper, we propose a 3D Convolutional Neural Network (3DCNN) based multi-stream framework to recognize American Sign Language (ASL) manual signs (consisting of movements of the hands, as well as non-manual face movements in some…

Computer Vision and Pattern Recognition · Computer Science 2019-06-10 Longlong Jing , Elahe Vahdani , Matt Huenerfauth , Yingli Tian

Research on continuous sign language recognition (CSLR) is essential to bridge the communication gap between deaf and hearing individuals. Numerous previous studies have trained their models using the connectionist temporal classification…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Ronglai Zuo , Fangyun Wei , Brian Mak

Sign language is a beautiful visual language and is also the primary language used by speaking and hearing-impaired people. However, sign language has many complex expressions, which are difficult for the public to understand and master.…

Computer Vision and Pattern Recognition · Computer Science 2022-04-20 Ronghui Li , Lu Meng

Many technologies for human-computer interaction have been designed for hearing individuals and depend upon vocalized speech, precluding users of American Sign Language (ASL) in the Deaf community from benefiting from these advancements.…

Hand gesture-based Sign Language Recognition (SLR) serves as a crucial communication bridge between deaf and non-deaf individuals. While Graph Convolutional Networks (GCNs) are common, they are limited by their reliance on fixed skeletal…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Koki Hirooka , Abu Saleh Musa Miah , Tatsuya Murakami , Md. Al Mehedi Hasan , Yong Seok Hwang , Jungpil Shin

A primary challenge for the deaf and hearing-impaired community stems from the communication gap with the hearing society, which can greatly impact their daily lives and result in social exclusion. To foster inclusivity in society, our…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Elisa Cabana

Sign Language Recognition (SLR) is an essential yet challenging task since sign language is performed with the fast and complex movement of hand gestures, body posture, and even facial expressions. %Skeleton Aware Multi-modal Sign Language…

Computer Vision and Pattern Recognition · Computer Science 2023-02-17 Maxim Novopoltsev , Leonid Verkhovtsev , Ruslan Murtazin , Dmitriy Milevich , Iuliia Zemtsova

There is an undeniable communication barrier between deaf people and people with normal hearing ability. Although innovations in sign language translation technology aim to tear down this communication barrier, the majority of existing sign…

Computer Vision and Pattern Recognition · Computer Science 2018-10-19 Biyi Fang , Jillian Co , Mi Zhang

The primary concern of this research is to take American Sign Language (ASL) data through real time camera footage and be able to convert the data and information into text. Adding to that, we are also putting focus on creating a framework…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Hasnat Jamil Bhuiyan , Mubtasim Fuad Mozumder , Md. Rabiul Islam Khan , Md. Sabbir Ahmed , Nabuat Zaman Nahim

Visual Automatic Speech Recognition (V-ASR) is a challenging task that involves interpreting spoken language solely from visual information, such as lip movements and facial expressions. This task is notably challenging due to the absence…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Matthew Kit Khinn Teng , Haibo Zhang , Takeshi Saitoh

Sign language is the fundamental communication method among people who suffer from speech and hearing defects. The rest of the world doesn't have a clear idea of sign language. "Sign Language Communicator" (SLC) is designed to solve the…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Matheesha Fernando , Janaka Wijayanayake

Sign Language Translation (SLT) is a challenging task that aims to generate spoken language sentences from sign language videos, both of which have different grammar and word/gloss order. From a Neural Machine Translation (NMT) perspective,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Ozge Mercanoglu Sincan , Necati Cihan Camgoz , Richard Bowden

Audio-visual automatic speech recognition (AV-ASR) introduces the video modality into the speech recognition process, often by relying on information conveyed by the motion of the speaker's mouth. The use of the video signal requires…

Computer Vision and Pattern Recognition · Computer Science 2021-09-21 Dmitriy Serdyuk , Otavio Braga , Olivier Siohan

Sign Languages are expressed through hand and upper body gestures as well as facial expressions. Therefore, Sign Language Recognition (SLR) needs to focus on all such cues. Previous work uses hand-crafted mechanisms or network aggregation…

Computer Vision and Pattern Recognition · Computer Science 2020-09-30 Çağrı Gökçe , Oğulcan Özdemir , Ahmet Alp Kındıroğlu , Lale Akarun

Sign language recognition (SLR) refers to interpreting sign language glosses from given videos automatically. This research area presents a complex challenge in computer vision because of the rapid and intricate movements inherent in sign…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Muxin Pu , Mei Kuan Lim , Chun Yong Chong

Word-level sign language recognition (WSLR) has attracted attention because it is expected to overcome the communication barrier between people with speech impairment and those who can hear. In the WSLR problem, a method designed for action…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Mizuki Maruyama , Shrey Singh , Katsufumi Inoue , Partha Pratim Roy , Masakazu Iwamura , Michifumi Yoshioka

Sign Language Translation (SLT) is a challenging task that requires bridging the modality gap between visual and linguistic information while capturing subtle variations in hand shapes and movements. To address these challenges, we…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Sobhan Asasi , Mohamed Ilyas Lakhal , Ozge Mercanoglu Sincan , Richard Bowden

Accurate recognition and interpretation of sign language are crucial for enhancing communication accessibility for deaf and hard of hearing individuals. However, current approaches of Isolated Sign Language Recognition (ISLR) often face…

Computer Vision and Pattern Recognition · Computer Science 2025-05-14 Karina Kvanchiani , Roman Kraynov , Elizaveta Petrova , Petr Surovcev , Aleksandr Nagaev , Alexander Kapitanov