English
Related papers

Related papers: ISLTranslate: Dataset for Translating Indian Sign …

200 papers

Kenyan Sign Language (KSL) is the primary language used by the deaf community in Kenya. It is the medium of instruction from Pre-primary 1 to university among deaf learners, facilitating their education and academic achievement. Kenyan Sign…

Artificial Intelligence · Computer Science 2024-10-25 Lilian Wanzare , Joel Okutoyi , Maurine Kang'ahi , Mildred Ayere

The field of sign language translation has witnessed significant progress in the translation between sign and spoken languages, but the translation between sign languages remains largely unexplored and out of reach. The latter can help 1.5…

Computation and Language · Computer Science 2026-05-21 Zetian Wu , Bowen Xie , Wuyang Meng , Milan Gautam , Stefan Lee , Liang Huang

Speech translation for Indian languages remains a challenging task due to the scarcity of large-scale, publicly available datasets that capture the linguistic diversity and domain coverage essential for real-world applications. Existing…

Current benchmarks for sign language recognition (SLR) focus mainly on isolated SLR, while there are limited datasets for continuous SLR (CSLR), which recognizes sequences of signs in a video. Additionally, existing CSLR datasets are…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Sarah Alyami , Hamzah Luqman , Sadam Al-Azani , Maad Alowaifeer , Yazeed Alharbi , Yaser Alonaizan

There is an undeniable communication barrier between deaf people and people with normal hearing ability. Although innovations in sign language translation technology aim to tear down this communication barrier, the majority of existing sign…

Computer Vision and Pattern Recognition · Computer Science 2018-10-19 Biyi Fang , Jillian Co , Mi Zhang

People commonly communicate in English, Arabic, and Bengali spoken languages through various mediums. However, deaf and hard-of-hearing individuals primarily use body language and sign language to express their needs and achieve…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Md Hadiuzzaman , Mohammed Sowket Ali , Tamanna Sultana , Abdur Raj Shafi , Abu Saleh Musa Miah , Jungpil Shin

Gloss is a written approximation that bridges Sign Language (SL) and its corresponding spoken language. Despite a deaf and hard-of-hearing population of at least 3 million in Bangladesh, Bangla Sign Language (BdSL) remains largely…

Computation and Language · Computer Science 2026-05-05 Sharif Mohammad Abdullah , Abhijit Paul , Shubhashis Roy Dipta , Zarif Masud , Shebuti Rayana , Ahmedul Kabir

Transliteration is very important in the Indian language context due to the usage of multiple scripts and the widespread use of romanized inputs. However, few training and evaluation sets are publicly available. We introduce Aksharantar,…

Computation and Language · Computer Science 2023-10-27 Yash Madhani , Sushane Parthan , Priyanka Bedekar , Gokul NC , Ruchi Khapra , Anoop Kunchukuttan , Pratyush Kumar , Mitesh M. Khapra

Deaf individuals confront significant communication obstacles on a daily basis. Their inability to hear makes it difficult for them to communicate with those who do not understand sign language. Moreover, it presents difficulties in…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 Velmathi G , Kaushal Goyal

Sign language is an essential means of communication for millions of people around the world and serves as their primary language. However, most communication tools are developed for spoken and written languages which can cause problems and…

Computation and Language · Computer Science 2024-07-16 Ali Ghadami , Alireza Taheri , Ali Meghdari

India has 1369 languages of which 22 are official. About 13 different scripts are used to represent these languages. A Common Label Set (CLS) was developed based on phonetics to address the issue of large vocabulary of units required in the…

Computation and Language · Computer Science 2025-02-24 Utkarsh P

Automatic Sign Language (SL) recognition is an important task in the computer vision community. To build a robust SL recognition system, we need a considerable amount of data which is lacking particularly in Indian sign language (ISL). In…

Computer Vision and Pattern Recognition · Computer Science 2024-09-30 Suvajit Patra , Arkadip Maitra , Megha Tiwari , K. Kumaran , Swathy Prabhu , Swami Punyeshwarananda , Soumitra Samanta

Existing work on sign language translation - that is, translation from sign language videos into sentences in a written language - has focused mainly on (1) data collected in a controlled environment or (2) data in a specific domain, which…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Bowen Shi , Diane Brentari , Greg Shakhnarovich , Karen Livescu

One of the factors that have hindered progress in the areas of sign language recognition, translation, and production is the absence of large annotated datasets. Towards this end, we introduce How2Sign, a multimodal and multiview continuous…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Amanda Duarte , Shruti Palaskar , Lucas Ventura , Deepti Ghadiyaram , Kenneth DeHaan , Florian Metze , Jordi Torres , Xavier Giro-i-Nieto

Sign language recognition is a challenging and often underestimated problem comprising multi-modal articulators (handshape, orientation, movement, upper body and face) that integrate asynchronously on multiple streams. Learning powerful…

Computer Vision and Pattern Recognition · Computer Science 2019-11-22 Hamid Reza Vaezi Joze , Oscar Koller

Sign language recognition involves modeling complex multichannel information, such as hand shapes and movements while relying on sufficient sign language-specific data. However, sign languages are often under-resourced, posing a significant…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Hossein Ranjbar , Alireza Taheri

Recent advances in Deep Learning and Computer Vision have been successfully leveraged to serve marginalized communities in various contexts. One such area is Sign Language - a primary means of communication for the deaf community. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Haz Sameen Shahgir , Khondker Salman Sayeed , Md Toki Tahmid , Tanjeem Azwad Zaman , Md. Zarif Ul Alam

Sign languages are essential for the Deaf and Hard-of-Hearing (DHH) community. Sign language generation systems have the potential to support communication by translating from written languages, such as English, into signed videos. However,…

Sign language (SL) is an essential communication form for hearing-impaired and deaf people, enabling engagement within the broader society. Despite its significance, limited public awareness of SL often leads to inequitable access to…

Computation and Language · Computer Science 2025-09-04 Soukeina Elhassen , Lama Al Khuzayem , Areej Alhothali , Ohoud Alzamzami , Nahed Alowaidi

Sign language recognition and translation technologies have the potential to increase access and inclusion of deaf signing communities, but research progress is bottlenecked by a lack of representative data. We introduce a new resource for…

Computation and Language · Computer Science 2023-10-03 Lee Kezar , Elana Pontecorvo , Adele Daniels , Connor Baer , Ruth Ferster , Lauren Berger , Jesse Thomason , Zed Sevcikova Sehyr , Naomi Caselli