English
Related papers

Related papers: Fine-Tuning Video Transformers for Word-Level Bang…

200 papers

Sign language recognition (SLR) technology has enormous promise to improve communication and accessibility for the difficulty of hearing. This paper presents a novel approach for identifying gestures in TSL using the YOLOv5 object…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Vipul Reddy. P , Vishnu Vardhan Reddy. B , Sukriti

Sign language recognition (SLR) refers to interpreting sign language glosses from given videos automatically. This research area presents a complex challenge in computer vision because of the rapid and intricate movements inherent in sign…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Muxin Pu , Mei Kuan Lim , Chun Yong Chong

Bangla Sign Language Translation (BdSLT) has been severely constrained so far as the language itself is very low resource. Standard sentence level dataset creation for BdSLT is of immense importance for developing AI based assistive tools…

Computation and Language · Computer Science 2025-11-27 Husne Ara Rubaiyeat , Hasan Mahmud , Md Kamrul Hasan

Automatic sign language recognition (SLR) has become a key enabler of inclusive human-computer interaction, fostering seamless communication between deaf individuals and hearing communities. Despite significant advances in multimodal…

Human-Computer Interaction · Computer Science 2026-05-08 Xiaofang Xiao , Guangchao Li , Guangrong Zhao , Qi Lin , Wen Ma , Hongkai Wen , Yanxiang Wang , Yiran Shen

Sign language recognition (SLR) facilitates communication between deaf and hearing individuals. Deep learning is widely used to develop SLR-based systems; however, it is computationally intensive and requires substantial computational…

Robotics · Computer Science 2025-12-24 Nitin Kumar Singh , Arie Rachmad Syulistyo , Yuichiro Tanaka , Hakaru Tamukoh

Current benchmarks for sign language recognition (SLR) focus mainly on isolated SLR, while there are limited datasets for continuous SLR (CSLR), which recognizes sequences of signs in a video. Additionally, existing CSLR datasets are…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Sarah Alyami , Hamzah Luqman , Sadam Al-Azani , Maad Alowaifeer , Yazeed Alharbi , Yaser Alonaizan

A machine can understand human activities, and the meaning of signs can help overcome the communication barriers between the inaudible and ordinary people. Sign Language Recognition (SLR) is a fascinating research area and a crucial task…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 M. Madhiarasan , Partha Pratim Roy

Recent progress in fine-grained gesture and action classification, and machine translation, point to the possibility of automated sign language recognition becoming a reality. A key stumbling block in making progress towards this goal is a…

Computer Vision and Pattern Recognition · Computer Science 2021-10-14 Samuel Albanie , Gül Varol , Liliane Momeni , Triantafyllos Afouras , Joon Son Chung , Neil Fox , Andrew Zisserman

Sign Language Recognition (SLR) is a challenging research area in computer vision. To tackle the annotation bottleneck in SLR, we formulate the problem of Zero-Shot Sign Language Recognition (ZS-SLR) and propose a two-stream model from two…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Razieh Rastgoo , Kourosh Kiani , Sergio Escalera

Sign language recognition (SLR) is a machine learning task aiming to identify signs in videos. Due to the scarcity of annotated data, unsupervised methods like contrastive learning have become promising in this field. They learn meaningful…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Ariel Basso Madjoukeng , Jérôme Fink , Pierre Poitier , Edith Belise Kenmogne , Benoit Frenay

Sign languages serve as essential communication systems for individuals with hearing and speech impairments. However, digital linguistic dataset resources for underrepresented sign languages, such as Nepali Sign Language (NSL), remain…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Birat Poudel , Satyam Ghimire , Sijan Bhattarai , Saurav Bhandari , Suramya Sharma Dahal

Sign language recognition (SLR) is a weakly supervised task that annotates sign videos as textual glosses. Recent studies show that insufficient training caused by the lack of large-scale available sign datasets becomes the main bottleneck…

Computer Vision and Pattern Recognition · Computer Science 2023-04-13 Jiangbin Zheng , Yile Wang , Cheng Tan , Siyuan Li , Ge Wang , Jun Xia , Yidong Chen , Stan Z. Li

Bangla Sign Language (BdSL) translation represents a low-resource NLP task due to the lack of large-scale datasets that address sentence-level translation. Correspondingly, existing research in this field has been limited to word and…

Computation and Language · Computer Science 2025-11-12 Neelavro Saha , Rafi Shahriyar , Nafis Ashraf Roudra , Saadman Sakib , Annajiat Alim Rasel

Recent advancements in the field of computer vision with the help of deep neural networks have led us to explore and develop many existing challenges that were once unattended due to the lack of necessary technologies. Hand Sign/Gesture…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Shahjalal Ahmed , Md. Rafiqul Islam , Jahid Hassan , Minhaz Uddin Ahmed , Bilkis Jamal Ferdosi , Sanjay Saha , Md. Shopon

Sign language is the primary communication language for people with disabling hearing loss. Sign language recognition (SLR) systems aim to recognize sign gestures and translate them into spoken language. One of the main challenges in SLR is…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Hasan Algafri , Hamzah Luqman , Sarah Alyami , Issam Laradji

Sign Language Recognition (SLR) has garnered significant attention from researchers in recent years, particularly the intricate domain of Continuous Sign Language Recognition (CSLR), which presents heightened complexity compared to Isolated…

Computer Vision and Pattern Recognition · Computer Science 2024-02-23 Razieh Rastgoo , Kourosh Kiani , Sergio Escalera

Sign Language Translation (SLT) is a challenging task that aims to generate spoken language sentences from sign language videos, both of which have different grammar and word/gloss order. From a Neural Machine Translation (NMT) perspective,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Ozge Mercanoglu Sincan , Necati Cihan Camgoz , Richard Bowden

Sign language translation (SLT) addresses the problem of translating information from a sign language in video to a spoken language in text. Existing studies, while showing progress, are often limited to narrow domains and/or few sign…

Computation and Language · Computer Science 2024-07-17 Biao Zhang , Garrett Tanzer , Orhan Firat

Sign Language Translation (SLT) is a core task in the field of AI-assisted disability. Traditional SLT methods are typically based on visible light videos, which are easily affected by factors such as lighting variations, rapid hand…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Shiao Wang , Xiao Wang , Duoqing Yang , Yao Rong , Fuling Wang , Jianing Li , Lin Zhu , Bo Jiang

In this work, our goals are two fold: large-vocabulary continuous sign language recognition (CSLR), and sign language retrieval. To this end, we introduce a multi-task Transformer model, CSLR2, that is able to ingest a signing sequence and…

Computer Vision and Pattern Recognition · Computer Science 2024-05-17 Charles Raude , K R Prajwal , Liliane Momeni , Hannah Bull , Samuel Albanie , Andrew Zisserman , Gül Varol