English
Related papers

Related papers: Hierarchical I3D for Sign Spotting

200 papers

Isolated Sign Language Recognition (ISLR) is crucial for scalable sign language technology, yet language-specific approaches limit current models. To address this, we propose a one-shot learning approach that generalises across languages…

Computation and Language · Computer Science 2025-02-28 Toon Vandendriessche , Mathieu De Coster , Annelies Lejon , Joni Dambre

Accurate recognition and interpretation of sign language are crucial for enhancing communication accessibility for deaf and hard of hearing individuals. However, current approaches of Isolated Sign Language Recognition (ISLR) often face…

Computer Vision and Pattern Recognition · Computer Science 2025-05-14 Karina Kvanchiani , Roman Kraynov , Elizaveta Petrova , Petr Surovcev , Aleksandr Nagaev , Alexander Kapitanov

In this paper, we focus on the task of one-shot sign spotting, i.e. given an example of an isolated sign (query), we want to identify whether/where this sign appears in a continuous, co-articulated sign language video (target). To achieve…

Computer Vision and Pattern Recognition · Computer Science 2021-11-23 Tao Jiang , Necati Cihan Camgoz , Richard Bowden

The focus of this work is $\textit{sign spotting}$ - given a video of an isolated sign, our task is to identify $\textit{whether}$ and $\textit{where}$ it has been signed in a continuous, co-articulated sign language video. To achieve this…

Computer Vision and Pattern Recognition · Computer Science 2022-05-10 Gül Varol , Liliane Momeni , Samuel Albanie , Triantafyllos Afouras , Andrew Zisserman

The recent surge in large language models has automated translations of spoken and written languages. However, these advances remain largely inaccessible to American Sign Language (ASL) users, whose language relies on complex visual cues.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Daniel Perkins , Davis Hunter , Dhrumil Patel , Galen Flanagan

In this paper, we present our solution to the Cross-View Isolated Sign Language Recognition (CV-ISLR) challenge held at WWW 2025. CV-ISLR addresses a critical issue in traditional Isolated Sign Language Recognition (ISLR), where existing…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Fei Wang , Kun Li , Yiqi Nie , Zhangling Duan , Peng Zou , Zhiliang Wu , Yuwei Wang , Yanyan Wei

Isolated Sign Language Recognition (ISLR) is critical for bridging the communication gap between the Deaf and Hard-of-Hearing (DHH) community and the hearing world. However, robust ISLR is fundamentally constrained by data scarcity and the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Meher Md Saad

The focus of this work is sign spotting - given a video of an isolated sign, our task is to identify whether and where it has been signed in a continuous, co-articulated sign language video. To achieve this sign spotting task, we train a…

Computer Vision and Pattern Recognition · Computer Science 2020-10-09 Liliane Momeni , Gül Varol , Samuel Albanie , Triantafyllos Afouras , Andrew Zisserman

This work dedicates to continuous sign language recognition (CSLR), which is a weakly supervised task dealing with the recognition of continuous signs from videos, without any prior knowledge about the temporal boundaries between…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Fangyun Wei , Yutong Chen

Millions of hearing impaired people around the world routinely use some variants of sign languages to communicate, thus the automatic translation of a sign language is meaningful and important. Currently, there are two sub-problems in Sign…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Jie Huang , Wengang Zhou , Qilin Zhang , Houqiang Li , Weiping Li

The performances of Sign Language Recognition (SLR) systems have improved considerably in recent years. However, several open challenges still need to be solved to allow SLR to be useful in practice. The research in the field is in its…

Computer Vision and Pattern Recognition · Computer Science 2021-05-12 Ozge Mercanoglu Sincan , Julio C. S. Jacques Junior , Sergio Escalera , Hacer Yalim Keles

. Continuous Sign Language Recognition (CSLR) is a long challenging task in Computer Vision due to the difficulties in detecting the explicit boundaries between the words in a sign sentence. To deal with this challenge, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Razieh Rastgoo , Kourosh Kiani , Sergio Escalera

Sign Language Recognition (SLR) has garnered significant attention from researchers in recent years, particularly the intricate domain of Continuous Sign Language Recognition (CSLR), which presents heightened complexity compared to Isolated…

Computer Vision and Pattern Recognition · Computer Science 2024-02-23 Razieh Rastgoo , Kourosh Kiani , Sergio Escalera

Automatic Sign Language Recognition (ASLR) has emerged as a vital field for bridging the gap between deaf and hearing communities. However, the problem of sign-to-sign retrieval or detecting a specific sign within a sequence of continuous…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Samuel Ebimobowei Johnny , Blessed Guda , Emmanuel Enejo Aaron , Assane Gueye

Effective communication is paramount for the inclusion of deaf individuals in society. However, persistent communication barriers due to limited Sign Language (SL) knowledge hinder their full participation. In this context, Sign Language…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Carlos Eduardo G. R. Alves , Francisco de Assis Boldt , Thiago M. Paixão

Systems that can efficiently search collections of sign language videos have been highlighted as a useful application of sign language technology. However, the problem of searching videos beyond individual keywords has received limited…

Computer Vision and Pattern Recognition · Computer Science 2022-09-16 Amanda Duarte , Samuel Albanie , Xavier Giró-i-Nieto , Gül Varol

Video Semantic Role Labeling (VidSRL) aims to detect the salient events from given videos, by recognizing the predict-argument event structures and the interrelationships between events. While recent endeavors have put forth methods for…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Yu Zhao , Hao Fei , Yixin Cao , Bobo Li , Meishan Zhang , Jianguo Wei , Min Zhang , Tat-Seng Chua

Sign spotting, the task of identifying and localizing individual signs within continuous sign language video, plays a pivotal role in scaling dataset annotations and addressing the severe data scarcity issue in sign language translation.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 JianHe Low , Ozge Mercanoglu Sincan , Richard Bowden

This paper presents an in-depth analysis of various self-supervision methods for isolated sign language recognition (ISLR). We consider four recently introduced transformer-based approaches to self-supervised learning from videos, and four…

Computer Vision and Pattern Recognition · Computer Science 2023-09-07 Marcelo Sandoval-Castaneda , Yanhong Li , Diane Brentari , Karen Livescu , Gregory Shakhnarovich

Sign language translation (SLT) aims to interpret sign video sequences into text-based natural language sentences. Sign videos consist of continuous sequences of sign gestures with no clear boundaries in between. Existing SLT models usually…

Computer Vision and Pattern Recognition · Computer Science 2020-10-13 Dongxu Li , Chenchen Xu , Xin Yu , Kaihao Zhang , Ben Swift , Hanna Suominen , Hongdong Li
‹ Prev 1 2 3 10 Next ›