English
Related papers

Related papers: American Sign Language Recognition Using RF Sensin…

200 papers

This paper employs a multimodal approach for continuous sign recognition by first using ML for detecting the start and end frames of signs in videos of American Sign Language (ASL) sentences, and then by recognizing the segmented signs. For…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Mingyu Zhao , Zhanfu Yang , Yang Zhou , Zhaoyang Xia , Can Jin , Xiaoxiao He , Dimitris N. Metaxas

AI-driven sign language interpretation is limited by a lack of high-quality annotated data. New datasets including ASL STEM Wiki and FLEURS-ASL contain professional interpreters and 100s of hours of data but remain only partially annotated…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Colin Lea , Vasileios Baltatzis , Connor Gillis , Raja Kushalnagar , Lorna Quandt , Leah Findlater

Deaf individuals confront significant communication obstacles on a daily basis. Their inability to hear makes it difficult for them to communicate with those who do not understand sign language. Moreover, it presents difficulties in…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 Velmathi G , Kaushal Goyal

Looking up an unknown sign in an ASL dictionary can be difficult. Most ASL dictionaries are organized based on English glosses, despite the fact that (1) there is no convention for assigning English-based glosses to ASL signs; and (2) there…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Carol Neidle , Augustine Opoku , Carey Ballard , Yang Zhou , Xiaoxiao He , Gregory Dimitriadis , Dimitris Metaxas

In the fast-paced field of human-computer interaction (HCI) and virtual reality (VR), automatic gesture recognition has become increasingly essential. This is particularly true for the recognition of hand signs, providing an intuitive way…

Computer Vision and Pattern Recognition · Computer Science 2024-02-21 Christian Schuessler , Wenxuan Zhang , Johanna Bräunig , Marcel Hoffmann , Michael Stelzig , Martin Vossiek

Automatic speech recognition (ASR) systems, increasingly prevalent in education, healthcare, employment, and mobile technology, face significant challenges in inclusivity, particularly for the 80 million-strong global community of people…

Computation and Language · Computer Science 2024-05-13 Dena Mujtaba , Nihar R. Mahapatra , Megan Arney , J. Scott Yaruss , Hope Gerlach-Houck , Caryn Herring , Jia Bin

New deep-learning architectures are created every year, achieving state-of-the-art results in image recognition and leading to the belief that, in a few years, complex tasks such as sign language translation will be considerably easier,…

Computer Vision and Pattern Recognition · Computer Science 2021-04-05 Alvaro Leandro Cavalcante Carneiro , Lucas de Brito Silva , Denis Henrique Pinheiro Salvadeo

Unlike spoken languages where the use of prosodic features to convey emotion is well studied, indicators of emotion in sign language remain poorly understood, creating communication barriers in critical settings. Sign languages present…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Phoebe Chua , Cathy Mengying Fang , Takehiko Ohkawa , Raja Kushalnagar , Suranga Nanayakkara , Pattie Maes

Albanian Sign Language (AlbSL) is relatively new and until now there doesn't exist a system that is able to recognize Albanian signs by using natural user interfaces (NUI). The aim of this paper is to present a real-time gesture recognition…

Human-Computer Interaction · Computer Science 2016-08-11 Eriglen Gani , Alda Kika

Sign language is the fundamental communication method among people who suffer from speech and hearing defects. The rest of the world doesn't have a clear idea of sign language. "Sign Language Communicator" (SLC) is designed to solve the…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Matheesha Fernando , Janaka Wijayanayake

Sign Language Recognition (SLR) is an important step in facilitating the communication among deaf people and the rest of society. Existing Persian sign language recognition systems are mainly restricted to static signs which are not very…

Computer Vision and Pattern Recognition · Computer Science 2019-12-05 Saeideh Ghanbari Azar , Hadi Seyedarabi

While federated learning (FL) and differential privacy (DP) have been extensively studied, their application to automatic speech recognition (ASR) remains largely unexplored due to the challenges in training large transformer models.…

Spoken language recognition (SLR) is the task of automatically identifying the language present in a speech signal. Existing SLR models are either too computationally expensive or too large to run effectively on devices with limited…

Computation and Language · Computer Science 2023-06-06 Oriol Nieto , Zeyu Jin , Franck Dernoncourt , Justin Salamon

Recent progress in fine-grained gesture and action classification, and machine translation, point to the possibility of automated sign language recognition becoming a reality. A key stumbling block in making progress towards this goal is a…

Computer Vision and Pattern Recognition · Computer Science 2021-10-14 Samuel Albanie , Gül Varol , Liliane Momeni , Triantafyllos Afouras , Joon Son Chung , Neil Fox , Andrew Zisserman

Sign languages are visual languages, with vocabularies as rich as their spoken language counterparts. However, current deep-learning based Sign Language Production (SLP) models produce under-articulated skeleton pose sequences from…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Ben Saunders , Necati Cihan Camgoz , Richard Bowden

Sign language is an essential means of communication for millions of people around the world and serves as their primary language. However, most communication tools are developed for spoken and written languages which can cause problems and…

Computation and Language · Computer Science 2024-07-16 Ali Ghadami , Alireza Taheri , Ali Meghdari

Existing work on sign language translation - that is, translation from sign language videos into sentences in a written language - has focused mainly on (1) data collected in a controlled environment or (2) data in a specific domain, which…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Bowen Shi , Diane Brentari , Greg Shakhnarovich , Karen Livescu

The detection of the environment where user is located, is of extreme use for the identification of Activities of Daily Living (ADL). ADL can be identified by use of the sensors available in many off-the-shelf mobile devices, including…

Sound · Computer Science 2017-11-02 Ivan Miguel Pires , Nuno M. Garcia , Nuno Pombo , Francisco Flórez-Revuelta

Automatic Speech Recognition (ASR) systems in real-world settings need to handle imperfect audio, often degraded by hardware limitations or environmental noise, while accommodating diverse user groups. In human-robot interaction (HRI),…

Robotics · Computer Science 2025-08-26 Theresa Pekarek Rosin , Julia Gachot , Henri-Leon Kordt , Matthias Kerzel , Stefan Wermter

Automatic Sign Language Recognition (ASLR) has emerged as a vital field for bridging the gap between deaf and hearing communities. However, the problem of sign-to-sign retrieval or detecting a specific sign within a sequence of continuous…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Samuel Ebimobowei Johnny , Blessed Guda , Emmanuel Enejo Aaron , Assane Gueye