English
Related papers

Related papers: Continuous Sign Language Recognition System using …

200 papers

Sign spotting, the task of identifying and localizing individual signs within continuous sign language video, plays a pivotal role in scaling dataset annotations and addressing the severe data scarcity issue in sign language translation.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 JianHe Low , Ozge Mercanoglu Sincan , Richard Bowden

Sign language recognition could significantly improve the user experience for d/Deaf people with the general consumer technology, such as IoT devices or videoconferencing. However, current sign language recognition architectures are usually…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Matyáš Boháček , Zhuo Cao , Marek Hrúz

We developed an American Sign Language (ASL) learning platform in a Virtual Reality (VR) environment to facilitate immersive interaction and real-time feedback for ASL learners. We describe the first game to use an interactive teaching…

American Sign Language (ASL) is the fourth most commonly used language in the United States and is the language most commonly used by Deaf people in the United States and the English-speaking regions of Canada. Unfortunately, until…

Computer Vision and Pattern Recognition · Computer Science 2020-09-04 Nicholas Wilkins , Beck Cordes Galbraith , Ifeoma Nwogu

Computers still have a long way to go before they can interact with users in a truly natural fashion. From a users perspective, the most natural way to interact with a computer would be through a speech and gesture interface. Although…

Computation and Language · Computer Science 2013-04-12 Maher Jebali , Patrice Dalle , Mohamed Jemni

Human body pose estimation and hand detection are two important tasks for systems that perform computer vision-based sign language recognition(SLR). However, both tasks are challenging, especially when the input is color videos, with no…

Computer Vision and Pattern Recognition · Computer Science 2016-04-21 Srujana Gattupalli , Amir Ghaderi , Vassilis Athitsos

Previous audio-visual speech separation methods use the synchronization of the speaker's facial movement and speech in the video to supervise the speech separation in a self-supervised way. In this paper, we propose a model to solve the…

Audio and Speech Processing · Electrical Eng. & Systems 2023-11-06 Jiasong Wu , Xuan Li , Taotao Li , Fanman Meng , Youyong Kong , Guanyu Yang , Lotfi Senhadji , Huazhong Shu

This study explores integrating sign language into virtual reality (VR) by examining the comprehensibility and user experience of viewing American Sign Language (ASL) videos captured with body-mounted 360-degree cameras. Ten participants…

Human-Computer Interaction · Computer Science 2026-02-27 Gauri Umesh Rajmane , Ziming Li , Tae Oh , Roshan Peiris

Signed languages are the primary means of communication for many deaf and hard of hearing individuals. Since signed languages exhibit all the fundamental linguistic properties of natural language, we believe that tools and theories of…

Computation and Language · Computer Science 2021-07-26 Kayo Yin , Amit Moryossef , Julie Hochgesang , Yoav Goldberg , Malihe Alikhani

Indian Sign Language has limited resources for developing machine learning and data-driven approaches for automated language processing. Though text/audio-based language processing techniques have shown colossal research interest and…

Computation and Language · Computer Science 2024-07-09 Abhinav Joshi , Romit Mohanty , Mounika Kanakanti , Andesha Mangla , Sudeep Choudhary , Monali Barbate , Ashutosh Modi

An robust sign language recognition system can greatly alleviate communication barriers, particularly for people who struggle with verbal communication. This is crucial for human growth and progress as it enables the expression of thoughts,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Md Shamimul Islam , A. J. M. Akhtarujjaman Joha , Md Nur Hossain , Sohaib Abdullah , Ibrahim Elwarfalli , Md Mahedi Hasan

Sign language serves as a non-vocal means of communication, transmitting information and significance through gestures, facial expressions, and bodily movements. The majority of current approaches for sign language recognition (SLR) and…

Computer Vision and Pattern Recognition · Computer Science 2024-05-10 Mo Guan , Yan Wang , Guangkun Ma , Jiarui Liu , Mingzu Sun

Sign Language Recognition (SLR) has garnered significant attention from researchers in recent years, particularly the intricate domain of Continuous Sign Language Recognition (CSLR), which presents heightened complexity compared to Isolated…

Computer Vision and Pattern Recognition · Computer Science 2024-02-23 Razieh Rastgoo , Kourosh Kiani , Sergio Escalera

Sign language recognition and translation technologies have the potential to increase access and inclusion of deaf signing communities, but research progress is bottlenecked by a lack of representative data. We introduce a new resource for…

Computation and Language · Computer Science 2023-10-03 Lee Kezar , Elana Pontecorvo , Adele Daniels , Connor Baer , Ruth Ferster , Lauren Berger , Jesse Thomason , Zed Sevcikova Sehyr , Naomi Caselli

Recent advancements in the field of computer vision with the help of deep neural networks have led us to explore and develop many existing challenges that were once unattended due to the lack of necessary technologies. Hand Sign/Gesture…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Shahjalal Ahmed , Md. Rafiqul Islam , Jahid Hassan , Minhaz Uddin Ahmed , Bilkis Jamal Ferdosi , Sanjay Saha , Md. Shopon

Artificial agents, particularly humanoid robots, interact with their environment, objects, and people using cameras, actuators, and physical presence. Their communication methods are often pre-programmed, limiting their actions and…

Artificial Intelligence · Computer Science 2024-06-17 Federico Tavella , Aphrodite Galata , Angelo Cangelosi

Arabic Sign Language (ArSL) is an essential communication method for individuals in the Deaf and Hard-of-Hearing community. However, existing recognition systems face significant challenges due to their reliance on single sensor approaches…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Ghadeer Alanazi , Abir Benabid

Over 5% of the world's population (466 million people) has disabling hearing loss. 4 million are children. They can be hard of hearing or deaf. Deaf people mostly have profound hearing loss. Which implies very little or no hearing. Over the…

Computation and Language · Computer Science 2020-05-05 Salma El Anigri , Mohammed Majid Himmi , Abdelhak Mahmoudi

This research explores the positive application of deepfake technology for upper body generation, specifically sign language for the Deaf and Hard of Hearing (DHoH) community. Given the complexity of sign language and the scarcity of…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Shahzeb Naeem , Muhammad Riyyan Khan , Usman Tariq , Abhinav Dhall , Carlos Ivan Colon , Hasan Al-Nashash

Sign language is a set of gestures that deaf people use to communicate. Unfortunately, normal people don't understand it, which creates a communication gap that needs to be filled. Because of the variations in (Egyptian Sign Language) ESL…

Computer Vision and Pattern Recognition · Computer Science 2021-12-27 Ahmed Elhagry , Rawan Glalal Elrayes