English
Related papers

Related papers: Sign Language Recognition based on YOLOv5 Algorith…

200 papers

Sign language recognition could significantly improve the user experience for d/Deaf people with the general consumer technology, such as IoT devices or videoconferencing. However, current sign language recognition architectures are usually…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Matyáš Boháček , Zhuo Cao , Marek Hrúz

Sign languages, used by around 70 million Deaf individuals globally, are visual languages that convey visual and contextual information. Current methods in vision-based sign language recognition (SLR) and translation (SLT) struggle with…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Yuqi Liu , Wenqian Zhang , Sihan Ren , Chengyu Huang , Jingyi Yu , Lan Xu

Millions of individuals worldwide are affected by deafness and hearing impairment. Sign language serves as a sophisticated means of communication for the deaf and hard of hearing. However, in societies that prioritize spoken languages, sign…

Computation and Language · Computer Science 2025-08-15 Safaeid Hossain Arib , Rabeya Akter , Sejuti Rahman

The past decade has seen great advancements in speech recognition for control of interactive devices, personal assistants, and computer interfaces. However, Deaf and hard-ofhearing (HoH) individuals, whose primary mode of communication is…

Signal Processing · Electrical Eng. & Systems 2021-11-19 Emre Kurtoglu , Ali C. Gurbuz , Evie A. Malaia , Darrin Griffin , Chris Crawford , Sevgi Z. Gurbuz

We use insights from research on American Sign Language (ASL) phonology to train models for isolated sign language recognition (ISLR), a step towards automatic sign language understanding. Our key insight is to explicitly recognize the role…

Computation and Language · Computer Science 2023-02-14 Lee Kezar , Jesse Thomason , Zed Sevcikova Sehyr

We present Large Sign Language Models (LSLM), a novel framework for translating 3D American Sign Language (ASL) by leveraging Large Language Models (LLMs) as the backbone, which can benefit hearing-impaired individuals' virtual…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Sen Zhang , Xiaoxiao He , Di Liu , Zhaoyang Xia , Mingyu Zhao , Chaowei Tan , Vivian Li , Bo Liu , Dimitris N. Metaxas , Mubbasir Kapadia

Sign language is a visual language used by the deaf and dumb community to communicate. However, for most recognition methods based on monocular cameras, the recognition accuracy is low and the robustness is poor. Even if the effect is good…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Zhiyu Long , Xingyou Liu , Jiaqi Qiao , Zhi Li

For a long time, detecting hand gestures and recognizing them as letters or numbers has been a challenging task. This creates communication barriers for individuals with disabilities. This paper introduces a new dataset, the Annotated…

Computer Vision and Pattern Recognition · Computer Science 2023-05-18 Sanyam Jain

This paper Traffic sign recognition plays a crucial role in the development of autonomous vehicles and advanced driver-assistance systems (ADAS). Despite significant advances in deep learning and object detection, accurately detecting and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Baba Ibrahim , Zhou Kui

Dyslexia affects reading and writing skills across many languages. This work describes a new application of YOLO-based object detection to isolate and label handwriting patterns (Normal, Reversal, Corrected) within synthetic images that…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Nora Fink

Sign language is one of the most effective communication tools for people with hearing difficulties. Most existing works focus on improving the performance of sign language tasks on RGB videos, which may suffer from degraded recording…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Pengyu Zhang , Hao Yin , Zeren Wang , Wenyue Chen , Shengming Li , Dong Wang , Huchuan Lu , Xu Jia

This paper presents an Arabic Alphabet Sign Language recognition approach, using deep learning methods in conjunction with transfer learning and transformer-based models. We study the performance of the different variants on two publicly…

Computer Vision and Pattern Recognition · Computer Science 2024-10-02 Mazen Balat , Rewaa Awaad , Hend Adel , Ahmed B. Zaky , Salah A. Aly

Sign language recognition (SLR) has recently achieved a breakthrough in performance thanks to deep neural networks trained on large annotated sign datasets. Of the many different sign languages, these annotated datasets are only available…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Ahmet Alp Kindiroglu , Ozgur Kara , Ogulcan Ozdemir , Lale Akarun

Deaf people are using sign language for communication, and it is a combination of gestures, movements, postures, and facial expressions that correspond to alphabets and words in spoken languages. The proposed Arabic sign language…

Computer Vision and Pattern Recognition · Computer Science 2023-01-10 Muhammad Al-Barham , Ahmad Jamal , Musa Al-Yaman

Automatic Sign Language Recognition (ASLR) has emerged as a vital field for bridging the gap between deaf and hearing communities. However, the problem of sign-to-sign retrieval or detecting a specific sign within a sequence of continuous…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Samuel Ebimobowei Johnny , Blessed Guda , Emmanuel Enejo Aaron , Assane Gueye

Sign language discourse is an essential mode of daily communication for the deaf and hard-of-hearing people. However, research on Bangla Sign Language (BdSL) faces notable limitations, primarily due to the lack of datasets. Recognizing…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Husne Ara Rubaiyeat , Hasan Mahmud , Ahsan Habib , Md. Kamrul Hasan

Arabic Sign Language (ArSL) is an essential communication method for individuals in the Deaf and Hard-of-Hearing community. However, existing recognition systems face significant challenges due to their reliance on single sensor approaches…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Ghadeer Alanazi , Abir Benabid

Sign language recognition (SLR) is vital for bridging communication gaps between deaf and hearing communities. Vision-based approaches suffer from occlusion, computational costs, and physical constraints. This work presents a comparison of…

Signal Processing · Electrical Eng. & Systems 2026-04-09 Meshv Patel , Bikash Baro , Sayan Bayan , Mohendra Roy

Sign languages are natural, visual-gestural languages used by Deaf communities worldwide. Over 300 distinct sign languages remain severely low-resource due to limited documentation, sparse datasets, and insufficient computational tools.…

Computation and Language · Computer Science 2026-05-13 Nigar Alishzade , Gulchin Abdullayeva

Sign Language Translation (SLT) is a challenging task due to its cross-domain nature, involving the translation of visual-gestural language to text. Many previous methods employ an intermediate representation, i.e., gloss sequences, to…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Benjia Zhou , Zhigang Chen , Albert Clapés , Jun Wan , Yanyan Liang , Sergio Escalera , Zhen Lei , Du Zhang