English
Related papers

Related papers: A Transformer-Based Multi-Stream Approach for Isol…

200 papers

Sign Language Recognition (SLR) is an essential yet challenging task since sign language is performed with the fast and complex movement of hand gestures, body posture, and even facial expressions. %Skeleton Aware Multi-modal Sign Language…

Computer Vision and Pattern Recognition · Computer Science 2023-02-17 Maxim Novopoltsev , Leonid Verkhovtsev , Ruslan Murtazin , Dmitriy Milevich , Iuliia Zemtsova

Helping deaf and hard-of-hearing people communicate more easily is the main goal of Automatic Sign Language Translation. Although most past research has focused on turning sign language into text, doing the reverse, turning spoken English…

Computer Vision and Pattern Recognition · Computer Science 2025-07-10 Kazi Mahathir Rahman , Naveed Imtiaz Nafis , Md. Farhan Sadik , Mohammad Al Rafi , Mehedi Hasan Shahed

Sign language to spoken language audio translation is important to connect the hearing- and speech-challenged humans with others. We consider sign language videos with isolated sign sequences rather than continuous grammatical signing. Such…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Harsh Kavediya , Vighnesh Nayak , Bheeshm Sharma , Balamurugan Palaniappan

Research on continuous sign language recognition (CSLR) is essential to bridge the communication gap between deaf and hearing individuals. Numerous previous studies have trained their models using the connectionist temporal classification…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Ronglai Zuo , Fangyun Wei , Brian Mak

Road sign recognition is one of the core technologies in Intelligent Transport Systems. In the current study, a robust and real-time method is presented to identify and detect the roads speed signs in road image in different situations. In…

Computer Vision and Pattern Recognition · Computer Science 2014-07-22 Reza Azad , Babak Azad , Iman Tavakoli Kazerooni

An robust sign language recognition system can greatly alleviate communication barriers, particularly for people who struggle with verbal communication. This is crucial for human growth and progress as it enables the expression of thoughts,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Md Shamimul Islam , A. J. M. Akhtarujjaman Joha , Md Nur Hossain , Sohaib Abdullah , Ibrahim Elwarfalli , Md Mahedi Hasan

In general, speech processing models consist of a language model along with an acoustic model. Regardless of the language model's complexity and variants, three critical pre-processing steps are needed in language models: cleaning,…

Audio and Speech Processing · Electrical Eng. & Systems 2021-12-16 Romina Oji , Seyedeh Fatemeh Razavi , Sajjad Abdi Dehsorkh , Alireza Hariri , Hadi Asheri , Reshad Hosseini

The ambition of a character recognition system is to transform a text document typed on paper into a digital format that can be manipulated by word processor software Unlike other languages, Arabic has unique features, while other language…

Computation and Language · Computer Science 2010-06-15 A. A Zaidan , B. B Zaidan , Hamid. A. Jalab , Hamdan. O. Alanazi , Rami Alnaqeib

Non-native speakers (NNSs) face significant language barriers in multilingual communication with native speakers (NSs). While AI-mediated communication (AIMC) tools offer efficient one-time assistance, they often overlook opportunities for…

Human-Computer Interaction · Computer Science 2026-01-27 Peinuan Qin , Yugin Tan , Jingzhu Chen , Nattapat Boonprakong , Zicheng Zhu , Naomi Yamashita , Yi-Chieh Lee

Speech Emotion Recognition (SER) is of great importance in Human-Computer Interaction (HCI), as it provides a deeper understanding of the situation and results in better interaction. In recent years, various machine learning and Deep…

Sound · Computer Science 2022-11-15 Ali Yazdani , Hossein Simchi , Yasser Shekofteh

The recent surge in large language models has automated translations of spoken and written languages. However, these advances remain largely inaccessible to American Sign Language (ASL) users, whose language relies on complex visual cues.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Daniel Perkins , Davis Hunter , Dhrumil Patel , Galen Flanagan

Deep learning models have improved sign language-to-text translation and made it easier for non-signers to understand signed messages. When the goal is spoken communication, a naive approach is to convert signed messages into text and then…

Sound · Computer Science 2026-04-14 Toranosuke Manabe , Yuto Shibata , Shinnosuke Takamichi , Yoshimitsu Aoki

This paper proposes a simple transfer learning baseline for sign language translation. Existing sign language datasets (e.g. PHOENIX-2014T, CSL-Daily) contain only about 10K-20K pairs of sign videos, gloss annotations and texts, which are…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Yutong Chen , Fangyun Wei , Xiao Sun , Zhirong Wu , Stephen Lin

Spelling correction is a remarkable challenge in the field of natural language processing. The objective of spelling correction tasks is to recognize and rectify spelling errors automatically. The development of applications that can…

Computation and Language · Computer Science 2024-05-07 Mohammad Dehghani , Heshaam Faili

The lack of fluency in sign language remains a barrier to seamless communication for hearing and speech-impaired communities. In this work, we propose a low-cost, real-time ASL-to-speech translation glove and an exhaustive training dataset…

Computation and Language · Computer Science 2024-07-22 Aditya Makkar , Divya Makkar , Aarav Patel , Liam Hebert

Sign Languages (SL) serve as the primary mode of communication for the Deaf and Hard of Hearing communities. Deep learning methods for SL recognition and translation have achieved promising results. However, Sign Language Production (SLP)…

Computer Vision and Pattern Recognition · Computer Science 2024-04-08 Vasileios Baltatzis , Rolandos Alexandros Potamias , Evangelos Ververas , Guanxiong Sun , Jiankang Deng , Stefanos Zafeiriou

Sign language recognition and translation technologies have the potential to increase access and inclusion of deaf signing communities, but research progress is bottlenecked by a lack of representative data. We introduce a new resource for…

Computation and Language · Computer Science 2023-10-03 Lee Kezar , Elana Pontecorvo , Adele Daniels , Connor Baer , Ruth Ferster , Lauren Berger , Jesse Thomason , Zed Sevcikova Sehyr , Naomi Caselli

After the interviews, it has been comprehended that speech-impaired individuals who use sign languages have difficulty communicating with other people who do not know sign language. Due to the communication problems, the sense of…

Computer Vision and Pattern Recognition · Computer Science 2022-03-09 Arda Mavi , Zeynep Dikle

Sign languages use multiple asynchronous information channels (articulators), not just the hands but also the face and body, which computational approaches often ignore. In this paper we tackle the multi-articulatory sign language…

Computer Vision and Pattern Recognition · Computer Science 2020-09-02 Necati Cihan Camgoz , Oscar Koller , Simon Hadfield , Richard Bowden

Sign language discourse is an essential mode of daily communication for the deaf and hard-of-hearing people. However, research on Bangla Sign Language (BdSL) faces notable limitations, primarily due to the lack of datasets. Recognizing…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Husne Ara Rubaiyeat , Hasan Mahmud , Ahsan Habib , Md. Kamrul Hasan