English
Related papers

Related papers: Towards Online Continuous Sign Language Recognitio…

200 papers

Sign Language Production (SLP) is the tough task of turning sign language into sign videos. The main goal of SLP is to create these videos using a sign gloss. In this research, we've developed a new method to make high-quality sign videos…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Pan Xie , Taiyi Peng , Yao Du , Qipeng Zhang

Continuous Sign Language Recognition (CSLR) faces multiple challenges, including significant inter-signer variability and poor generalization to novel sentence structures. Traditional solutions frequently fail to handle these issues…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Md Rezwanul Haque , Md. Milon Islam , S M Taslim Uddin Raju , Fakhri Karray

Sign language translation (SLT), which generates text in a spoken language from visual content in a sign language, is important to assist the hard-of-hearing community for their communications. Inspired by neural machine translation (NMT),…

Computer Vision and Pattern Recognition · Computer Science 2021-11-16 Jichao Kan , Kun Hu , Markus Hagenbuchner , Ah Chung Tsoi , Mohammed Bennamounm , Zhiyong Wang

Continuously recognizing sign gestures and converting them to glosses plays a key role in bridging the gap between the hearing and hearing-impaired communities. This involves recognizing and interpreting the hands, face, and body gestures…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Samuel Ebimobowei Johnny , Blessed Guda , Andrew Blayama Stephen , Assane Gueye

Sign language, which conveys meaning through gestures, is the chief means of communication among deaf people. Recognizing sign language in natural settings presents significant challenges due to factors such as lighting, background clutter,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Bowen Shi

Spoken language recognition (SLR) is the task of automatically identifying the language present in a speech signal. Existing SLR models are either too computationally expensive or too large to run effectively on devices with limited…

Computation and Language · Computer Science 2023-06-06 Oriol Nieto , Zeyu Jin , Franck Dernoncourt , Justin Salamon

Sign language recognition is crucial for individuals with hearing impairments to break communication barriers. However, previous approaches have had to choose between efficiency and accuracy. Such as RNNs, LSTMs, and GCNs, had problems with…

Computation and Language · Computer Science 2025-06-30 Tinh Nguyen , Minh Khue Phan Tran

Sign language visual recognition from continuous multi-modal streams is still one of the most challenging fields. Recent advances in human actions recognition are exploiting the ascension of GPU-based learning from massive data, and are…

Computer Vision and Pattern Recognition · Computer Science 2020-09-23 Bassem Seddik , Najoua Essoukri Ben Amara

Recent work on end-to-end automatic speech recognition (ASR) has shown that the connectionist temporal classification (CTC) loss can be used to convert acoustics to phone or character sequences. Such systems are used with a dictionary and…

Computation and Language · Computer Science 2017-03-23 Kartik Audhkhasi , Bhuvana Ramabhadran , George Saon , Michael Picheny , David Nahamoo

Recognition of text on word or line images, without the need for sub-word segmentation has become the mainstream of research and development of text recognition for Indian languages. Modelling unsegmented sequences using Connectionist…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Minesh Mathew , Ajoy Mondal , CV Jawahar

The field of sign language translation has witnessed significant progress in the translation between sign and spoken languages, but the translation between sign languages remains largely unexplored and out of reach. The latter can help 1.5…

Computation and Language · Computer Science 2026-05-21 Zetian Wu , Bowen Xie , Wuyang Meng , Milan Gautam , Stefan Lee , Liang Huang

Computational sign language research lacks the large-scale datasets that enables the creation of useful reallife applications. To date, most research has been limited to prototype systems on small domains of discourse, e.g. weather…

Computer Vision and Pattern Recognition · Computer Science 2021-05-07 Necati Cihan Camgoz , Ben Saunders , Guillaume Rochette , Marco Giovanelli , Giacomo Inches , Robin Nachtrab-Ribback , Richard Bowden

Transformers have become the dominant architecture for sequence modeling tasks such as natural language processing or audio processing, and they are now even considered for tasks that are not naturally sequential such as image…

Machine Learning · Computer Science 2024-03-05 Jorg Bornschein , Yazhe Li , Amal Rannen-Triki

In end-to-end automatic speech recognition (ASR), a model is expected to implicitly learn representations suitable for recognizing a word-level sequence. However, the huge abstraction gap between input acoustic signals and output linguistic…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-09 Yosuke Higuchi , Keita Karube , Tetsuji Ogawa , Tetsunori Kobayashi

Although Transformers have gained success in several speech processing tasks like spoken language understanding (SLU) and speech translation (ST), achieving online processing while keeping competitive performance is still essential for…

Computation and Language · Computer Science 2022-04-20 Keqi Deng , Shinji Watanabe , Jiatong Shi , Siddhant Arora

Sign Language Recognition (SLR) is an important step in facilitating the communication among deaf people and the rest of society. Existing Persian sign language recognition systems are mainly restricted to static signs which are not very…

Computer Vision and Pattern Recognition · Computer Science 2019-12-05 Saeideh Ghanbari Azar , Hadi Seyedarabi

Recently, deep end-to-end learning has been studied for intent classification in Spoken Language Understanding (SLU). However, end-to-end models require a large amount of speech data with intent labels, and highly optimized models are…

Computation and Language · Computer Science 2024-05-27 Suyoung Kim , Jiyeon Hwang , Ho-Young Jung

We extend the frameworks of Serialized Output Training (SOT) to address practical needs of both streaming and offline automatic speech recognition (ASR) applications. Our approach focuses on balancing latency and accuracy, catering to…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-18 Aswin Shanmugam Subramanian , Amit Das , Naoyuki Kanda , Jinyu Li , Xiaofei Wang , Yifan Gong

In recent years, deep learning techniques have been used to develop sign language recognition systems, potentially serving as a communication tool for millions of hearing-impaired individuals worldwide. However, there are inherent…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Alvaro Leandro Cavalcante Carneiro , Denis Henrique Pinheiro Salvadeo , Lucas de Brito Silva

Sign language recognition (SLR) facilitates communication between deaf and hearing communities. Deep learning based SLR models are commonly used but require extensive computational resources, making them unsuitable for deployment on edge…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Nitin Kumar Singh , Arie Rachmad Syulistyo , Yuichiro Tanaka , Hakaru Tamukoh