English
Related papers

Related papers: Isharah: A Large-Scale Multi-Scene Dataset for Con…

200 papers

Sign language is commonly used by deaf or speech impaired people to communicate but requires significant effort to master. Sign Language Recognition (SLR) aims to bridge the gap between sign language users and others by recognizing signs…

Computer Vision and Pattern Recognition · Computer Science 2021-05-04 Songyao Jiang , Bin Sun , Lichen Wang , Yue Bai , Kunpeng Li , Yun Fu

An robust sign language recognition system can greatly alleviate communication barriers, particularly for people who struggle with verbal communication. This is crucial for human growth and progress as it enables the expression of thoughts,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Md Shamimul Islam , A. J. M. Akhtarujjaman Joha , Md Nur Hossain , Sohaib Abdullah , Ibrahim Elwarfalli , Md Mahedi Hasan

Bangladeshi Sign Language (BdSL) is a commonly used medium of communication for the hearing-impaired people in Bangladesh. A real-time BdSL interpreter with no controlled lab environment has a broad social impact and an interesting avenue…

Computer Vision and Pattern Recognition · Computer Science 2021-10-05 Oishee Bintey Hoque , Mohammad Imrul Jubair , Al-Farabi Akash , Saiful Islam

Most existing sign language translation (SLT) datasets are limited in scale, lack multilingual coverage, and are costly to curate due to their reliance on expert annotation and controlled recording setup. Recently, Vision Language Models…

Computation and Language · Computer Science 2025-10-30 Shakib Yazdani , Yasser Hamidullah , Cristina España-Bonet , Josef van Genabith

Word-level sign language recognition (WSLR) is a fundamental task in sign language interpretation. It requires models to recognize isolated sign words from videos. However, annotating WSLR data needs expert knowledge, thus limiting WSLR…

Computer Vision and Pattern Recognition · Computer Science 2020-03-18 Dongxu Li , Xin Yu , Chenchen Xu , Lars Petersson , Hongdong Li

Sign language translation (SLT) is a challenging task that involves translating sign language images into spoken language. For SLT models to perform this task successfully, they must bridge the modality gap and identify subtle variations in…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Jungeun Kim , Hyeongwoo Jeon , Jongseong Bae , Ha Young Kim

This paper introduces TVB-HKSL-News, a new Hong Kong sign language (HKSL) dataset collected from a TV news program over a period of 7 months. The dataset is collected to enrich resources for HKSL and support research in large-vocabulary…

Computation and Language · Computer Science 2024-05-03 Zhe Niu , Ronglai Zuo , Brian Mak , Fangyun Wei

Sign languages are visual languages, with vocabularies as rich as their spoken language counterparts. However, current deep-learning based Sign Language Production (SLP) models produce under-articulated skeleton pose sequences from…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Ben Saunders , Necati Cihan Camgoz , Richard Bowden

As part of the development of an educational tool that can help students achieve fluency in American Sign Language (ASL) through independent and interactive practice with immediate feedback, this paper introduces a near real-time system to…

Computer Vision and Pattern Recognition · Computer Science 2020-05-04 Elahe Vahdani , Longlong Jing , Yingli Tian , Matt Huenerfauth

Even for better-studied sign languages like American Sign Language (ASL), data is the bottleneck for machine learning research. The situation is worse yet for the many other sign languages used by Deaf/Hard of Hearing communities around the…

Computation and Language · Computer Science 2024-07-17 Garrett Tanzer , Biao Zhang

Sign(ed) languages use gestures, such as hand or head movements, for communication. Sign language recognition is an assistive technology for individuals with hearing disability and its goal is to improve such individuals' life quality by…

Human-Computer Interaction · Computer Science 2019-11-04 Mohammad Eslami , Mahdi Karami , Sedigheh Eslami , Solale Tabarestani , Farah Torkamani-Azar , Christoph Meinel

Sign language is the primary language for people with a hearing loss. Sign language recognition (SLR) is the automatic recognition of sign language, which represents a challenging problem for computers, though some progress has been made…

Computer Vision and Pattern Recognition · Computer Science 2021-03-10 Roman Töngi

Automatic sign language recognition (SLR) is an important topic within the areas of human-computer interaction and machine learning. On the one hand, it poses a complex challenge that requires the intervention of various knowledge areas,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Franco Ronchetti , Facundo Manuel Quiroga , César Estrebou , Laura Lanzarini , Alejandro Rosete

Sign language is a visual language that enhances communication between people and is frequently used as the primary form of communication by people with hearing loss. Even so, not many people with hearing loss use sign language, and they…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Rupesh Kumar , Ayush Sinha , Ashutosh Bajpai , S. K Singh

Automatic speech processing systems are employed more and more often in real environments. Although the underlying speech technology is mostly language independent, differences between languages with respect to their structure and grammar…

Computation and Language · Computer Science 2012-03-20 A. M. Riad , Hamdy K. Elmonier , Samaa. M. Shohieb , A. S. Asem

People commonly communicate in English, Arabic, and Bengali spoken languages through various mediums. However, deaf and hard-of-hearing individuals primarily use body language and sign language to express their needs and achieve…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Md Hadiuzzaman , Mohammed Sowket Ali , Tamanna Sultana , Abdur Raj Shafi , Abu Saleh Musa Miah , Jungpil Shin

To be truly understandable and accepted by Deaf communities, an automatic Sign Language Production (SLP) system must generate a photo-realistic signer. Prior approaches based on graphical avatars have proven unpopular, whereas recent neural…

Computer Vision and Pattern Recognition · Computer Science 2020-11-30 Ben Saunders , Necati Cihan Camgoz , Richard Bowden

The Speaker Diarization and Recognition (SDR) task aims to predict "who spoke when and what" within an audio clip, which is a crucial task in various real-world multi-speaker scenarios such as meeting transcription and dialogue systems.…

Sound · Computer Science 2026-01-06 Han Yin , Yafeng Chen , Chong Deng , Luyao Cheng , Hui Wang , Chao-Hong Tan , Qian Chen , Wen Wang , Xiangang Li

This paper presents a system which can recognise hand poses & gestures from the Indian Sign Language (ISL) in real-time using grid-based features. This system attempts to bridge the communication gap between the hearing and speech impaired…

Computer Vision and Pattern Recognition · Computer Science 2021-08-26 Kartik Shenoy , Tejas Dastane , Varun Rao , Devendra Vyavaharkar

Sign Language Translation (SLT) is a task that has not been studied relatively much compared to the study of Sign Language Recognition (SLR). However, the SLR is a study that recognizes the unique grammar of sign language, which is…

Computer Vision and Pattern Recognition · Computer Science 2022-06-15 Youngmin Kim , Minji Kwak , Dain Lee , Yeongeun Kim , Hyeongboo Baek