中文
相关论文

相关论文: Skeleton Aware Multi-modal Sign Language Recogniti…

200 篇论文

Pre-training has proven effective for learning transferable features in sign language understanding (SLU) tasks. Recently, skeleton-based methods have gained increasing attention because they can robustly handle variations in subjects and…

计算机视觉与模式识别 · 计算机科学 2026-04-01 Muxin Pu , Mei Kuan Lim , Chun Yong Chong , Chen Change Loy

Sign language is a visual language used by the deaf and dumb community to communicate. However, for most recognition methods based on monocular cameras, the recognition accuracy is low and the robustness is poor. Even if the effect is good…

计算机视觉与模式识别 · 计算机科学 2024-07-03 Zhiyu Long , Xingyou Liu , Jiaqi Qiao , Zhi Li

Zero-Shot Learning (ZSL) has rapidly advanced in recent years. Towards overcoming the annotation bottleneck in the Sign Language Recognition (SLR), we explore the idea of Zero-Shot Sign Language Recognition (ZS-SLR) with no annotated visual…

计算机视觉与模式识别 · 计算机科学 2021-09-06 Razieh Rastgoo , Kourosh Kiani , Sergio Escalera , Mohammad Sabokrou

Skeleton-based action recognition has garnered significant attention due to the utilization of concise and resilient skeletons. Nevertheless, the absence of detailed body information in skeletons restricts performance, while other…

计算机视觉与模式识别 · 计算机科学 2024-08-16 Jinfu Liu , Chen Chen , Mengyuan Liu

Sign languages are the language of hearing-impaired people who use visuals like the hand, facial, and body movements for communication. There are different signs and gestures representing alphabets, words, and phrases. Nowadays…

机器学习 · 计算机科学 2024-11-08 Sharvani Srivastava , Sudhakar Singh , Pooja , Shiv Prakash

Recent advances in skeleton-based action recognition increasingly leverage semantic priors from Large Language Models (LLMs) to enrich skeletal representations. However, the LLM is typically queried in isolation from the recognition model…

计算机视觉与模式识别 · 计算机科学 2026-03-13 Hongda Liu , Yunfan Liu , Changlu Wang , Yunlong Wang , Zhenan Sun

Self-supervised learning (SSL), which aims to learn meaningful prior representations from unlabeled data, has been proven effective for skeleton-based action understanding. Different from the image domain, skeleton data possesses sparser…

计算机视觉与模式识别 · 计算机科学 2025-12-29 Jiahang Zhang , Lilang Lin , Shuai Yang , Jiaying Liu

Skeleton-based human action recognition has achieved remarkable progress in recent years. However, most existing GCN-based methods rely on short-range motion topologies, which not only struggle to capture long-range joint dependencies and…

计算机视觉与模式识别 · 计算机科学 2026-03-31 Ruosi Wang , Fangwei Zuo , Lei Li , Zhaoqiang Xia

Recent advances in tracking sensors and pose estimation software enable smart systems to use trajectories of skeleton joint locations for supervised learning. We study the problem of accurately recognizing sign language words, which is key…

计算机视觉与模式识别 · 计算机科学 2022-02-04 Joachim Gudmundsson , Martin P. Seybold , John Pfeifer

Sign language recognition (SLR) plays a crucial role in bridging the communication gap between the hearing and vocally impaired community and the rest of the society. Word-level sign language recognition (WSLR) is the first important step…

计算机视觉与模式识别 · 计算机科学 2020-12-03 Anirudh Tunga , Sai Vidyaranya Nuthalapati , Juan Wachs

Sign language is the preferred method of communication of deaf or mute people, but similar to any language, it is difficult to learn and represents a significant barrier for those who are hard of hearing or unable to speak. A person's…

计算机视觉与模式识别 · 计算机科学 2022-12-26 Neil Song , Yu Xiang

Skeleton-based action recognition has made great progress recently, but many problems still remain unsolved. For example, most of the previous methods model the representations of skeleton sequences without abundant spatial structure…

计算机视觉与模式识别 · 计算机科学 2018-12-04 Chenyang Si , Ya Jing , Wei Wang , Liang Wang , Tieniu Tan

Sign language is a visual language that enhances communication between people and is frequently used as the primary form of communication by people with hearing loss. Even so, not many people with hearing loss use sign language, and they…

计算机视觉与模式识别 · 计算机科学 2023-05-25 Rupesh Kumar , Ayush Sinha , Ashutosh Bajpai , S. K Singh

Many technologies for human-computer interaction have been designed for hearing individuals and depend upon vocalized speech, precluding users of American Sign Language (ASL) in the Deaf community from benefiting from these advancements.…

Millions of hearing impaired people around the world routinely use some variants of sign languages to communicate, thus the automatic translation of a sign language is meaningful and important. Currently, there are two sub-problems in Sign…

计算机视觉与模式识别 · 计算机科学 2025-09-16 Jie Huang , Wengang Zhou , Qilin Zhang , Houqiang Li , Weiping Li

Skeleton-based action recognition has attracted lots of research attention. Recently, to build an accurate skeleton-based action recognizer, a variety of works have been proposed. Among them, some works use large model architectures as…

计算机视觉与模式识别 · 计算机科学 2024-04-02 Haoxuan Qu , Yujun Cai , Jun Liu

Sign language serves as a non-vocal means of communication, transmitting information and significance through gestures, facial expressions, and bodily movements. The majority of current approaches for sign language recognition (SLR) and…

计算机视觉与模式识别 · 计算机科学 2024-05-10 Mo Guan , Yan Wang , Guangkun Ma , Jiarui Liu , Mingzu Sun

Sign languages are visual languages, with vocabularies as rich as their spoken language counterparts. However, current deep-learning based Sign Language Production (SLP) models produce under-articulated skeleton pose sequences from…

计算机视觉与模式识别 · 计算机科学 2022-03-30 Ben Saunders , Necati Cihan Camgoz , Richard Bowden

Sign language recognition (SLR) is a machine learning task aiming to identify signs in videos. Due to the scarcity of annotated data, unsupervised methods like contrastive learning have become promising in this field. They learn meaningful…

计算机视觉与模式识别 · 计算机科学 2026-03-09 Ariel Basso Madjoukeng , Jérôme Fink , Pierre Poitier , Edith Belise Kenmogne , Benoit Frenay

Sign Language Recognition (SLR) plays a crucial role in bridging the communication gap between the hearing-impaired community and society. This paper introduces SLRNet, a real-time webcam-based ASL recognition system using MediaPipe…

计算机视觉与模式识别 · 计算机科学 2025-06-18 Sharvari Kamble