中文
相关论文

相关论文: Improving Continuous Sign Language Recognition wit…

200 篇论文

Continuously recognizing sign gestures and converting them to glosses plays a key role in bridging the gap between the hearing and hearing-impaired communities. This involves recognizing and interpreting the hands, face, and body gestures…

计算机视觉与模式识别 · 计算机科学 2025-07-29 Samuel Ebimobowei Johnny , Blessed Guda , Andrew Blayama Stephen , Assane Gueye

. Continuous Sign Language Recognition (CSLR) is a long challenging task in Computer Vision due to the difficulties in detecting the explicit boundaries between the words in a sign sentence. To deal with this challenge, we propose a…

计算机视觉与模式识别 · 计算机科学 2023-06-02 Razieh Rastgoo , Kourosh Kiani , Sergio Escalera

Continuous sign language recognition (CSLR) requires precise spatio-temporal modeling to accurately recognize sequences of gestures in videos. Existing frameworks often rely on CNN-based spatial backbones combined with temporal convolution…

计算机视觉与模式识别 · 计算机科学 2025-12-30 Ahmed Abul Hasanaath , Hamzah Luqman

Recent advances in sign language research have benefited from CNN-based backbones, which are primarily transferred from traditional computer vision tasks (\eg object identification, image recognition). However, these CNN-based backbones…

计算机视觉与模式识别 · 计算机科学 2025-05-20 Shiwei Gan , Yafeng Yin , Zhiwei Jiang , Hongkai Wen , Lei Xie , Sanglu Lu

Since the superiority of Transformer in learning long-term dependency, the sign language Transformer model achieves remarkable progress in Sign Language Recognition (SLR) and Translation (SLT). However, there are several issues with the…

计算机视觉与模式识别 · 计算机科学 2021-07-28 Pan Xie , Mengyi Zhao , Xiaohui Hu

Continuous Sign Language Recognition (CSLR) has achieved remarkable progress in recent years; however, most existing methods are developed under single-view settings and thus remain insufficiently robust to viewpoint variations in…

计算机视觉与模式识别 · 计算机科学 2026-04-21 Xu Wang , Shengeng Tang , Wan Jiang , Yaxiong Wang , Lechao Cheng , Richang Hong

Continuous sign language recognition (SLR) deals with unaligned video-text pair and uses the word error rate (WER), i.e., edit distance, as the main evaluation metric. Since it is not differentiable, we usually instead optimize the learning…

计算机视觉与模式识别 · 计算机科学 2020-10-13 Junfu Pu , Wengang Zhou , Hezhen Hu , Houqiang Li

Continuous sign language recognition (SLR) is a challenging task that requires learning on both spatial and temporal dimensions of signing frame sequences. Most recent work accomplishes this by using CNN and RNN hybrid networks. However,…

计算机视觉与模式识别 · 计算机科学 2020-12-08 Ka Leong Cheng , Zhaoyang Yang , Qifeng Chen , Yu-Wing Tai

Changes in facial expression, head movement, body movement and gesture movement are remarkable cues in sign language recognition, and most of the current continuous sign language recognition(CSLR) research methods mainly focus on static…

计算机视觉与模式识别 · 计算机科学 2024-03-01 Qidan Zhu , Jing Li , Fei Yuan , Quan Gan

The objective of this work is to find temporal boundaries between signs in continuous sign language. Motivated by the paucity of annotation available for this task, we propose a simple yet effective algorithm to improve segmentation…

计算机视觉与模式识别 · 计算机科学 2021-04-29 Katrin Renz , Nicolaj C. Stache , Neil Fox , Gül Varol , Samuel Albanie

The complexity of Sign Language (SL) data processing brings many challenges. The current approach to recognition of SL signs aims to translate RGB sign language videos through pose information into Word-based ID Glosses, which serve to…

计算机视觉与模式识别 · 计算机科学 2026-04-20 Sen Fang , Yalin Feng , Chunyu Sui , Hongbin Zhong , Yanxin Zhang , Hongwei Yi , Hezhen Hu , Dimitris N. Metaxas

Sign languages are visual languages, with vocabularies as rich as their spoken language counterparts. However, current deep-learning based Sign Language Production (SLP) models produce under-articulated skeleton pose sequences from…

计算机视觉与模式识别 · 计算机科学 2022-03-30 Ben Saunders , Necati Cihan Camgoz , Richard Bowden

Sign Language Recognition (SLR) is an essential yet challenging task since sign language is performed with the fast and complex movement of hand gestures, body posture, and even facial expressions. %Skeleton Aware Multi-modal Sign Language…

计算机视觉与模式识别 · 计算机科学 2023-02-17 Maxim Novopoltsev , Leonid Verkhovtsev , Ruslan Murtazin , Dmitriy Milevich , Iuliia Zemtsova

Sign language recognition (SLR) refers to interpreting sign language glosses from given videos automatically. This research area presents a complex challenge in computer vision because of the rapid and intricate movements inherent in sign…

计算机视觉与模式识别 · 计算机科学 2025-03-27 Muxin Pu , Mei Kuan Lim , Chun Yong Chong

Sign language representation learning presents unique challenges due to the complex spatio-temporal nature of signs and the scarcity of labeled datasets. Existing methods often rely either on models pre-trained on general visual tasks, that…

计算机视觉与模式识别 · 计算机科学 2025-03-12 Ryan Wong , Necati Cihan Camgoz , Richard Bowden

A machine can understand human activities, and the meaning of signs can help overcome the communication barriers between the inaudible and ordinary people. Sign Language Recognition (SLR) is a fascinating research area and a crucial task…

计算机视觉与模式识别 · 计算机科学 2024-09-02 M. Madhiarasan , Partha Pratim Roy

Accurate recognition and interpretation of sign language are crucial for enhancing communication accessibility for deaf and hard of hearing individuals. However, current approaches of Isolated Sign Language Recognition (ISLR) often face…

计算机视觉与模式识别 · 计算机科学 2025-05-14 Karina Kvanchiani , Roman Kraynov , Elizaveta Petrova , Petr Surovcev , Aleksandr Nagaev , Alexander Kapitanov

The objective of this work is to annotate sign instances across a broad vocabulary in continuous sign language. We train a Transformer model to ingest a continuous signing stream and output a sequence of written tokens on a large-scale…

计算机视觉与模式识别 · 计算机科学 2021-03-31 Gül Varol , Liliane Momeni , Samuel Albanie , Triantafyllos Afouras , Andrew Zisserman

Continuous Sign Language Recognition (CSLR) is a crucial task for understanding the languages of deaf communities. Contemporary keypoint-based approaches typically rely on spatio-temporal encoding, where spatial interactions among keypoints…

计算机视觉与模式识别 · 计算机科学 2026-03-18 Suvajit Patra , Soumitra Samanta

Sign languages are visual languages which convey information by signers' handshape, facial expression, body movement, and so forth. Due to the inherent restriction of combinations of these visual ingredients, there exist a significant…

计算机视觉与模式识别 · 计算机科学 2023-03-22 Ronglai Zuo , Fangyun Wei , Brian Mak