English
Related papers

Related papers: ASL STEM Wiki: Dataset and Benchmark for Interpret…

200 papers

While the last decade has witnessed significant advancements in Automatic Speech Recognition (ASR) systems, performance of these systems for individuals with speech disabilities remains inadequate, partly due to limited public training…

Sign Language helps people with Speaking and Hearing Disabilities communicate with others efficiently. Sign Language identification is a challenging area in the field of computer vision and recent developments have been able to achieve near…

Computer Vision and Pattern Recognition · Computer Science 2021-01-21 Yugam Bajaj , Puru Malhotra

Semantic Textual Similarity (STS) is a crucial component of many Natural Language Processing (NLP) applications. However, existing approaches typically reduce semantic nuances to a single score, limiting interpretability. To address this,…

Computation and Language · Computer Science 2026-05-15 Diego Miguel Lozano , Daryna Dementieva , Alexander Fraser

Emotional voice communication plays a crucial role in effective daily interactions. Deaf and hard-of-hearing (DHH) individuals often rely on facial expressions to supplement sign language to convey emotions, as the use of voice is limited.…

Human-Computer Interaction · Computer Science 2024-12-10 Hyunchul Lim , Minghan Gao , Franklin Mingzhe Li , Nam Anh Dang , Ianip Sit , Michelle M Olson , Cheng Zhang

In recent years, deep learning techniques have been used to develop sign language recognition systems, potentially serving as a communication tool for millions of hearing-impaired individuals worldwide. However, there are inherent…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Alvaro Leandro Cavalcante Carneiro , Denis Henrique Pinheiro Salvadeo , Lucas de Brito Silva

With the recent advancements in intelligent personal assistants (IPAs), their popularity is rapidly increasing when it comes to utilizing Automatic Speech Recognition within households. In this study, we used a Wizard-of-Oz methodology to…

Human-Computer Interaction · Computer Science 2024-05-16 Nina Tran , Paige DeVries , Matthew Seita , Raja Kushalnagar , Abraham Glasser , Christian Vogler

Exam documents are essential educational materials for exam preparation. However, they pose a significant academic barrier for blind and visually impaired students, as they are often created without accessibility considerations. Typically,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 David Wilkening , Omar Moured , Thorsten Schwarz , Karin Muller , Rainer Stiefelhagen

We present Large Sign Language Models (LSLM), a novel framework for translating 3D American Sign Language (ASL) by leveraging Large Language Models (LLMs) as the backbone, which can benefit hearing-impaired individuals' virtual…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Sen Zhang , Xiaoxiao He , Di Liu , Zhaoyang Xia , Mingyu Zhao , Chaowei Tan , Vivian Li , Bo Liu , Dimitris N. Metaxas , Mubbasir Kapadia

Large Language Models (LLMs) have shown remarkable capabilities, not only in generating human-like text, but also in acquiring knowledge. This highlights the need to go beyond the typical Natural Language Processing downstream benchmarks…

Computation and Language · Computer Science 2025-01-03 Ahmad Mustapha , Hadi Al-Khansa , Hadi Al-Mubasher , Aya Mourad , Ranam Hamoud , Hasan El-Husseini , Marwah Al-Sakkaf , Mariette Awad

Vision-based sign language recognition aims at helping deaf people to communicate with others. However, most existing sign language datasets are limited to a small number of words. Due to the limited vocabulary size, models learned from…

Computer Vision and Pattern Recognition · Computer Science 2020-01-22 Dongxu Li , Cristian Rodriguez Opazo , Xin Yu , Hongdong Li

Structured hand gestures that incorporate visual motions and signs are used in sign language. Sign language is a valuable means of daily communication for individuals who are deaf or have speech impairments, but it is still rare among…

Sign language processing technology development relies on extensive and reliable datasets, instructions, and ethical guidelines. We present a comprehensive Azerbaijani Sign Language Dataset (AzSLD) collected from diverse sign language users…

Computation and Language · Computer Science 2025-01-16 Nigar Alishzade , Jamaladdin Hasanov

New deep-learning architectures are created every year, achieving state-of-the-art results in image recognition and leading to the belief that, in a few years, complex tasks such as sign language translation will be considerably easier,…

Computer Vision and Pattern Recognition · Computer Science 2021-04-05 Alvaro Leandro Cavalcante Carneiro , Lucas de Brito Silva , Denis Henrique Pinheiro Salvadeo

Despite efforts to increase the representation of disabled people in AI datasets, accessibility datasets are often annotated by crowdworkers without disability-specific expertise, leading to inconsistent or inaccurate labels. This paper…

Human-Computer Interaction · Computer Science 2026-02-12 Xinru Tang , Jingjin Li , Shaomei Wu

Artificial intelligence (AI) is transforming elementary STEM education, yet evidence remains fragmented. This systematic review synthesizes 258 studies (2020-2025) examining AI applications across eight categories: intelligent tutoring…

Computers and Society · Computer Science 2025-11-07 Majid Memari , Krista Ruggles

Learning disabilities like dysgraphia, dyslexia, dyspraxia, etc. interfere with academic achievements but have also long terms consequences beyond the academic time. It is widely admitted that between 5% to 10% of the world population is…

Other Computer Science · Computer Science 2020-05-14 Gilles Richard , Mathieu Serrurier

Sign languages are the language of hearing-impaired people who use visuals like the hand, facial, and body movements for communication. There are different signs and gestures representing alphabets, words, and phrases. Nowadays…

Machine Learning · Computer Science 2024-11-08 Sharvani Srivastava , Sudhakar Singh , Pooja , Shiv Prakash

Sign languages serve as essential communication systems for individuals with hearing and speech impairments. However, digital linguistic dataset resources for underrepresented sign languages, such as Nepali Sign Language (NSL), remain…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Birat Poudel , Satyam Ghimire , Sijan Bhattarai , Saurav Bhandari , Suramya Sharma Dahal

Scientific innovation relies on detailed workflows, which include critical steps such as analyzing literature, generating ideas, validating these ideas, interpreting results, and inspiring follow-up research. However, scientific…

Computation and Language · Computer Science 2024-06-11 Xingjian Zhang , Yutong Xie , Jin Huang , Jinge Ma , Zhaoying Pan , Qijia Liu , Ziyang Xiong , Tolga Ergen , Dongsub Shim , Honglak Lee , Qiaozhu Mei

Deaf people are more heavily affected by the digital divide than many would expect. Moreover, most accessibility guidelines addressing their needs just deal with captioning and audio-content transcription. However, this approach to the…

Human-Computer Interaction · Computer Science 2025-09-03 Fabrizio Borgia , Claudia S. Bianchini , Maria de Marsico