English
Related papers

Related papers: Continuous Saudi Sign Language Recognition: A Visi…

200 papers

People commonly communicate in English, Arabic, and Bengali spoken languages through various mediums. However, deaf and hard-of-hearing individuals primarily use body language and sign language to express their needs and achieve…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Md Hadiuzzaman , Mohammed Sowket Ali , Tamanna Sultana , Abdur Raj Shafi , Abu Saleh Musa Miah , Jungpil Shin

We present Large Sign Language Models (LSLM), a novel framework for translating 3D American Sign Language (ASL) by leveraging Large Language Models (LLMs) as the backbone, which can benefit hearing-impaired individuals' virtual…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Sen Zhang , Xiaoxiao He , Di Liu , Zhaoyang Xia , Mingyu Zhao , Chaowei Tan , Vivian Li , Bo Liu , Dimitris N. Metaxas , Mubbasir Kapadia

This study introduces an integrated approach to recognizing Arabic Sign Language (ArSL) using state-of-the-art deep learning models such as MobileNetV3, ResNet50, and EfficientNet-B2. These models are further enhanced by explainable AI…

Computer Vision and Pattern Recognition · Computer Science 2025-01-15 Mazen Balat , Rewaa Awaad , Ahmed B. Zaky , Salah A. Aly

Sign Language is the dominant yet non-primary form of communication language used in the deaf and hearing-impaired community. To make an easy and mutual communication between the hearing-impaired and the hearing communities, building a…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Razieh Rastgoo , Kourosh Kiani , Sergio Escalera , Mohammad Sabokrou

There is an undeniable communication barrier between deaf people and people with normal hearing ability. Although innovations in sign language translation technology aim to tear down this communication barrier, the majority of existing sign…

Computer Vision and Pattern Recognition · Computer Science 2018-10-19 Biyi Fang , Jillian Co , Mi Zhang

Sign language is commonly used by deaf or speech impaired people to communicate but requires significant effort to master. Sign Language Recognition (SLR) aims to bridge the gap between sign language users and others by recognizing signs…

Computer Vision and Pattern Recognition · Computer Science 2021-05-04 Songyao Jiang , Bin Sun , Lichen Wang , Yue Bai , Kunpeng Li , Yun Fu

Hearing-impaired is the disability of partial or total hearing loss that causes a significant problem for communication with other people in society. American Sign Language (ASL) is one of the sign languages that most commonly used language…

Computer Vision and Pattern Recognition · Computer Science 2022-06-16 Nelly Elsayed , Zag ElSayed , Anthony S. Maida

Sign language discourse is an essential mode of daily communication for the deaf and hard-of-hearing people. However, research on Bangla Sign Language (BdSL) faces notable limitations, primarily due to the lack of datasets. Recognizing…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Husne Ara Rubaiyeat , Hasan Mahmud , Ahsan Habib , Md. Kamrul Hasan

Many technologies for human-computer interaction have been designed for hearing individuals and depend upon vocalized speech, precluding users of American Sign Language (ASL) in the Deaf community from benefiting from these advancements.…

Current benchmarks for sign language recognition (SLR) focus mainly on isolated SLR, while there are limited datasets for continuous SLR (CSLR), which recognizes sequences of signs in a video. Additionally, existing CSLR datasets are…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Sarah Alyami , Hamzah Luqman , Sadam Al-Azani , Maad Alowaifeer , Yazeed Alharbi , Yaser Alonaizan

Sign language is the primary language for people with a hearing loss. Sign language recognition (SLR) is the automatic recognition of sign language, which represents a challenging problem for computers, though some progress has been made…

Computer Vision and Pattern Recognition · Computer Science 2021-03-10 Roman Töngi

Code-switching (CS) is common in daily conversations where more than one language is used within a sentence. The difficulties of CS speech recognition lie in alternating languages and the lack of transcribed data. Therefore, this paper uses…

Computation and Language · Computer Science 2021-10-08 Liang-Hsuan Tseng , Yu-Kuan Fu , Heng-Jui Chang , Hung-yi Lee

Sign language recognition (SLR) plays a vital role in facilitating communication for the hearing-impaired community. SLR is a weakly supervised task where entire videos are annotated with glosses, making it challenging to identify the…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Hao Chen , Jiaze Wang , Ziyu Guo , Jinpeng Li , Donghao Zhou , Bian Wu , Chenyong Guan , Guangyong Chen , Pheng-Ann Heng

Sign language translation (SLT) is an active field of study that encompasses human-computer interaction, computer vision, natural language processing and machine learning. Progress on this field could lead to higher levels of integration of…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Pedro Dal Bianco , Gastón Ríos , Franco Ronchetti , Facundo Quiroga , Oscar Stanchi , Waldo Hasperué , Alejandro Rosete

Our aim is to develop a unified model for sign language understanding, that performs sign language translation (SLT) and sign-subtitle alignment (SSA). Together, these two tasks enable the conversion of continuous signing videos into spoken…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Youngjoon Jang , Liliane Momeni , Zifan Jiang , Joon Son Chung , Gül Varol , Andrew Zisserman

Sign languages are essential for the Deaf and Hard-of-Hearing (DHH) community. Sign language generation systems have the potential to support communication by translating from written languages, such as English, into signed videos. However,…

Arabic dialect identification (ADI) tools are an important part of the large-scale data collection pipelines necessary for training speech recognition models. As these pipelines require application of ADI tools to potentially out-of-domain…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-07 Peter Sullivan , AbdelRahim Elmadany , Muhammad Abdul-Mageed

Deaf individuals confront significant communication obstacles on a daily basis. Their inability to hear makes it difficult for them to communicate with those who do not understand sign language. Moreover, it presents difficulties in…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 Velmathi G , Kaushal Goyal

Accurate recognition and interpretation of sign language are crucial for enhancing communication accessibility for deaf and hard of hearing individuals. However, current approaches of Isolated Sign Language Recognition (ISLR) often face…

Computer Vision and Pattern Recognition · Computer Science 2025-05-14 Karina Kvanchiani , Roman Kraynov , Elizaveta Petrova , Petr Surovcev , Aleksandr Nagaev , Alexander Kapitanov

Communication is defined as the act of sharing or exchanging information, ideas or feelings. To establish communication between two people, both of them are required to have knowledge and understanding of a common language. But in the case…

Computer Vision and Pattern Recognition · Computer Science 2022-03-04 Sharvani Srivastava , Amisha Gangwar , Richa Mishra , Sudhakar Singh