English
Related papers

Related papers: Real-time Sign Language Recognition Using MobileNe…

200 papers

Sign language to text is a crucial technology that can break down communication barriers for individuals with hearing difficulties. We replicate and try to improve on a recently published study. We evaluate models using BLEU and rBLEU…

Computation and Language · Computer Science 2024-02-13 Parsheeta Roy , Ji-Eun Han , Srishti Chouhan , Bhaavanaa Thumu

Signal recognition is one of significant and challenging tasks in the signal processing and communications field. It is often a common situation that there's no training data accessible for some signal classes to perform a recognition task.…

Machine Learning · Computer Science 2021-05-12 Yihong Dong , Xiaohan Jiang , Huaji Zhou , Yun Lin , Qingjiang Shi

With the growing Deaf and Hard of Hearing population worldwide and the persistent shortage of certified sign language interpreters, there is a pressing need for an efficient, signs-driven, integrated end-to-end translation system, from sign…

Artificial Intelligence · Computer Science 2025-02-17 Nada Shahin , Leila Ismail

Automatic Sign Language (SL) recognition is an important task in the computer vision community. To build a robust SL recognition system, we need a considerable amount of data which is lacking particularly in Indian sign language (ISL). In…

Computer Vision and Pattern Recognition · Computer Science 2024-09-30 Suvajit Patra , Arkadip Maitra , Megha Tiwari , K. Kumaran , Swathy Prabhu , Swami Punyeshwarananda , Soumitra Samanta

Languages usually switch within a multilingual speech signal, especially in a bilingual society. This phenomenon is referred to as code-switching (CS), making automatic speech recognition (ASR) challenging under a multilingual scenario. We…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-02 Hexin Liu , Leibny Paola Garcia , Xiangyu Zhang , Andy W. H. Khong , Sanjeev Khudanpur

This work dedicates to continuous sign language recognition (CSLR), which is a weakly supervised task dealing with the recognition of continuous signs from videos, without any prior knowledge about the temporal boundaries between…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Fangyun Wei , Yutong Chen

Sign language translation is one of the important issues in communication between deaf and hearing people, as it expresses words through hand, body, and mouth movements. American Sign Language is one of the sign languages used, one of which…

Computation and Language · Computer Science 2024-09-18 Gregorius Guntur Sunardi Putra , Adifa Widyadhani Chanda D'Layla , Dimas Wahono , Riyanarto Sarno , Agus Tri Haryono

Our objective is to translate continuous sign language into spoken language text. Inspired by the way human interpreters rely on context for accurate translation, we incorporate additional contextual cues together with the signing video,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Youngjoon Jang , Haran Raajesh , Liliane Momeni , Gül Varol , Andrew Zisserman

Sign Language Translation (SLT) is a challenging task that aims to translate sign videos into spoken language. Inspired by the strong translation capabilities of large language models (LLMs) that are trained on extensive multilingual text…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Jia Gong , Lin Geng Foo , Yixuan He , Hossein Rahmani , Jun Liu

Sign Language (SL), as the mother tongue of the deaf community, is a special visual language that most hearing people cannot understand. In recent years, neural Sign Language Translation (SLT), as a possible way for bridging communication…

Computation and Language · Computer Science 2022-11-02 Jiangbin Zheng , Siyuan Li , Cheng Tan , Chong Wu , Yidong Chen , Stan Z. Li

Audio is the primary modality for human communication and has driven the success of Automatic Speech Recognition (ASR) technologies. However, such audio-centric systems inherently exclude individuals who are deaf or hard of hearing. Visual…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Jeong Hun Yeo , Hyeongseop Rha , Sungjune Park , Junil Won , Yong Man Ro

Spoken language Identification (LID) systems are needed to identify the language(s) present in a given audio sample, and typically could be the first step in many speech processing related tasks such as automatic speech recognition (ASR).…

Computation and Language · Computer Science 2020-10-15 Pradeep Rangan , Sundeep Teki , Hemant Misra

The proposed model aims to develop a speech recognition technology for hearing, speech, or cognitively disabled people. All the available technology in the field of speech recognition doesn't come with an interface for communication for…

Sound · Computer Science 2024-07-23 Ritabrata Roy Choudhury

Sign Language Machine Translation (SLMT) aims to bridge communication between Deaf and hearing individuals. However, its progress is constrained by scarce datasets, limited signer diversity, and large domain gaps between sign motion…

Computation and Language · Computer Science 2026-03-23 Nada Shahin , Leila Ismail

Helping deaf and hard-of-hearing people communicate more easily is the main goal of Automatic Sign Language Translation. Although most past research has focused on turning sign language into text, doing the reverse, turning spoken English…

Computer Vision and Pattern Recognition · Computer Science 2025-07-10 Kazi Mahathir Rahman , Naveed Imtiaz Nafis , Md. Farhan Sadik , Mohammad Al Rafi , Mehedi Hasan Shahed

Sign language recognition (SLR) facilitates communication between deaf and hearing individuals. Deep learning is widely used to develop SLR-based systems; however, it is computationally intensive and requires substantial computational…

Robotics · Computer Science 2025-12-24 Nitin Kumar Singh , Arie Rachmad Syulistyo , Yuichiro Tanaka , Hakaru Tamukoh

Independent Sign Language Recognition is a complex visual recognition problem that combines several challenging tasks of Computer Vision due to the necessity to exploit and fuse information from hand gestures, body features and facial…

Computer Vision and Pattern Recognition · Computer Science 2020-12-11 Agelos Kratimenos , Georgios Pavlakos , Petros Maragos

In this paper, we present our solution to the Cross-View Isolated Sign Language Recognition (CV-ISLR) challenge held at WWW 2025. CV-ISLR addresses a critical issue in traditional Isolated Sign Language Recognition (ISLR), where existing…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Fei Wang , Kun Li , Yiqi Nie , Zhangling Duan , Peng Zou , Zhiliang Wu , Yuwei Wang , Yanyan Wei

Speech is the fundamental means of communication between humans. The advent of AI and sophisticated speech technologies have led to the rapid proliferation of human-to-computer-based interactions, fueled primarily by Automatic Speech…

Computation and Language · Computer Science 2022-12-01 Mikel K. Ngueajio , Gloria Washington

Sign language is a visual language used by the deaf and dumb community to communicate. However, for most recognition methods based on monocular cameras, the recognition accuracy is low and the robustness is poor. Even if the effect is good…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Zhiyu Long , Xingyou Liu , Jiaqi Qiao , Zhi Li