English
Related papers

Related papers: Continuous Saudi Sign Language Recognition: A Visi…

200 papers

Sign language recognition (SLR) for low-resource languages like Bangla suffers from signer variability, viewpoint variations, and limited annotated datasets. In this paper, we present BdSLW401, a large-scale, multi-view, word-level Bangla…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Husne Ara Rubaiyeat , Njayou Youssouf , Md Kamrul Hasan , Hasan Mahmud

Prior work on Sign Language Translation has shown that having a mid-level sign gloss representation (effectively recognizing the individual signs) improves the translation performance drastically. In fact, the current state-of-the-art in…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Necati Cihan Camgoz , Oscar Koller , Simon Hadfield , Richard Bowden

Sign languages are visual languages which convey information by signers' handshape, facial expression, body movement, and so forth. Due to the inherent restriction of combinations of these visual ingredients, there exist a significant…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Ronglai Zuo , Fangyun Wei , Brian Mak

Through this paper, we seek to reduce the communication barrier between the hearing-impaired community and the larger society who are usually not familiar with sign language in the sub-Saharan region of Africa with the largest occurrences…

Computer Vision and Pattern Recognition · Computer Science 2022-08-16 Steven Kolawole , Opeyemi Osakuade , Nayan Saxena , Babatunde Kazeem Olorisade

Sign Languages are the primary form of communication for Deaf communities across the world. To break the communication barriers between the Deaf and Hard-of-Hearing and the hearing communities, it is imperative to build systems capable of…

Machine Learning · Computer Science 2025-03-05 Chrysa Pratikaki , Panagiotis Filntisis , Athanasios Katsamanis , Anastasios Roussos , Petros Maragos

Automatic speech recognition (ASR) is crucial for human-machine interaction in diverse applications like conversational agents, industrial robotics, call center automation, and automated subtitling. However, developing high-performance ASR…

Artificial Intelligence · Computer Science 2025-04-22 Mahmoud Salhab , Marwan Elghitany , Shameed Sait , Syed Sibghat Ullah , Mohammad Abusheikh , Hasan Abusheikh

We present SignAvatars, the first large-scale, multi-prompt 3D sign language (SL) motion dataset designed to bridge the communication gap for Deaf and hard-of-hearing individuals. While there has been an exponentially growing number of…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Zhengdi Yu , Shaoli Huang , Yongkang Cheng , Tolga Birdal

Sign language translation is one of the important issues in communication between deaf and hearing people, as it expresses words through hand, body, and mouth movements. American Sign Language is one of the sign languages used, one of which…

Computation and Language · Computer Science 2024-09-18 Gregorius Guntur Sunardi Putra , Adifa Widyadhani Chanda D'Layla , Dimas Wahono , Riyanarto Sarno , Agus Tri Haryono

Sign language recognition (SLR) has recently achieved a breakthrough in performance thanks to deep neural networks trained on large annotated sign datasets. Of the many different sign languages, these annotated datasets are only available…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Ahmet Alp Kindiroglu , Ozgur Kara , Ogulcan Ozdemir , Lale Akarun

An inclusive science, technology, engineering and mathematics (STEM) workforce is needed to maintain America's leadership in the scientific enterprise. Increasing the participation of underrepresented groups in STEM, including persons with…

Human-Computer Interaction · Computer Science 2020-07-17 Meenakshi Das , Daniela Marghitu , Fatemeh Jamshidi , Mahender Mandala , Ayanna Howard

The study aims to enhance mathematics education accessibility for hard-of-hearing students by developing an accurate Palestinian sign language PSL recognition system using advanced artificial intelligence techniques. Due to the scarcity of…

Computation and Language · Computer Science 2025-08-08 Fidaa Khandaqji , Huthaifa I. Ashqar , Abdelrahem Atawnih

Crafting an effective Automatic Speech Recognition (ASR) solution for dialects demands innovative approaches that not only address the data scarcity issue but also navigate the intricacies of linguistic diversity. In this paper, we address…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-26 Ahmed Amine Ben Abdallah , Ata Kabboudi , Amir Kanoun , Salah Zaiem

In this work, our goals are two fold: large-vocabulary continuous sign language recognition (CSLR), and sign language retrieval. To this end, we introduce a multi-task Transformer model, CSLR2, that is able to ingest a signing sequence and…

Computer Vision and Pattern Recognition · Computer Science 2024-05-17 Charles Raude , K R Prajwal , Liliane Momeni , Hannah Bull , Samuel Albanie , Andrew Zisserman , Gül Varol

Self-supervised learning (SSL) based speech pre-training has attracted much attention for its capability of extracting rich representations learned from massive unlabeled data. On the other hand, the use of weakly-supervised data is less…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-30 Wangyou Zhang , Yanmin Qian

Sign Language Recognition (SLR) plays a crucial role in bridging the communication gap between the hearing-impaired community and society. This paper introduces SLRNet, a real-time webcam-based ASL recognition system using MediaPipe…

Computer Vision and Pattern Recognition · Computer Science 2025-06-18 Sharvari Kamble

The people in the world who are hearing impaired face many obstacles in communication and require an interpreter to comprehend what a person is saying. There has been constant scientific research and the existing models lack the ability to…

Computer Vision and Pattern Recognition · Computer Science 2022-12-08 Shubham Thakar , Samveg Shah , Bhavya Shah , Anant V. Nimkar

This paper introduces the RGB Arabic Alphabet Sign Language (AASL) dataset. AASL comprises 7,856 raw and fully labelled RGB images of the Arabic sign language alphabets, which to our best knowledge is the first publicly available RGB…

Computer Vision and Pattern Recognition · Computer Science 2023-01-31 Muhammad Al-Barham , Adham Alsharkawi , Musa Al-Yaman , Mohammad Al-Fetyani , Ashraf Elnagar , Ahmad Abu SaAleek , Mohammad Al-Odat

Sign language to spoken language audio translation is important to connect the hearing- and speech-challenged humans with others. We consider sign language videos with isolated sign sequences rather than continuous grammatical signing. Such…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Harsh Kavediya , Vighnesh Nayak , Bheeshm Sharma , Balamurugan Palaniappan

Sign language is the preferred method of communication of deaf or mute people, but similar to any language, it is difficult to learn and represents a significant barrier for those who are hard of hearing or unable to speak. A person's…

Computer Vision and Pattern Recognition · Computer Science 2022-12-26 Neil Song , Yu Xiang

The goal of sign language recognition (SLR) is to help those who are hard of hearing or deaf overcome the communication barrier. Most existing approaches can be typically divided into two lines, i.e., Skeleton-based and RGB-based methods,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Xiaolong Shen , Zhedong Zheng , Yi Yang