English
Related papers

Related papers: Sign Language Recognition Analysis using Multimoda…

200 papers

We are releasing a dataset containing videos of both fluent and non-fluent signers using American Sign Language (ASL), which were collected using a Kinect v2 sensor. This dataset was collected as a part of a project to develop and evaluate…

Computation and Language · Computer Science 2022-07-11 Saad Hassan , Matthew Seita , Larwan Berke , Yingli Tian , Elaine Gale , Sooyeon Lee , Matt Huenerfauth

Despite tremendous progress in natural language processing using deep learning techniques in recent years, sign language production and comprehension has advanced very little. One critical barrier is the lack of largescale datasets…

Computation and Language · Computer Science 2022-10-14 Yehong Jiang

The past decade has seen great advancements in speech recognition for control of interactive devices, personal assistants, and computer interfaces. However, Deaf and hard-ofhearing (HoH) individuals, whose primary mode of communication is…

Signal Processing · Electrical Eng. & Systems 2021-11-19 Emre Kurtoglu , Ali C. Gurbuz , Evie A. Malaia , Darrin Griffin , Chris Crawford , Sevgi Z. Gurbuz

Sign language is the primary communication language for people with disabling hearing loss. Sign language recognition (SLR) systems aim to recognize sign gestures and translate them into spoken language. One of the main challenges in SLR is…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Hasan Algafri , Hamzah Luqman , Sarah Alyami , Issam Laradji

Sign language is a visual language that enhances communication between people and is frequently used as the primary form of communication by people with hearing loss. Even so, not many people with hearing loss use sign language, and they…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Rupesh Kumar , Ayush Sinha , Ashutosh Bajpai , S. K Singh

Automatic sign language recognition is a research area that encompasses human-computer interaction, computer vision and machine learning. Robust automatic recognition of sign language could assist in the translation process and the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Franco Ronchetti , Facundo Manuel Quiroga , César Estrebou , Laura Lanzarini , Alejandro Rosete

Sign(ed) languages use gestures, such as hand or head movements, for communication. Sign language recognition is an assistive technology for individuals with hearing disability and its goal is to improve such individuals' life quality by…

Human-Computer Interaction · Computer Science 2019-11-04 Mohammad Eslami , Mahdi Karami , Sedigheh Eslami , Solale Tabarestani , Farah Torkamani-Azar , Christoph Meinel

It has always been a rather tough task to communicate with someone possessing a hearing impairment. One of the most tested ways to establish such a communication is through the use of sign based languages. However, not many people are aware…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Sharanya Mukherjee , Md Hishaam Akhtar , Kannadasan R

Sign Language helps people with Speaking and Hearing Disabilities communicate with others efficiently. Sign Language identification is a challenging area in the field of computer vision and recent developments have been able to achieve near…

Computer Vision and Pattern Recognition · Computer Science 2021-01-21 Yugam Bajaj , Puru Malhotra

Inspired by recent developments in natural language processing, we propose a novel approach to sign language processing based on phonological properties validated by American Sign Language users. By taking advantage of datasets composed of…

Computation and Language · Computer Science 2024-07-25 Federico Tavella , Aphrodite Galata , Angelo Cangelosi

The count of people suffering from various levels of hearing loss reached 1.57 billion in 2019. This huge number tends to suffer on many personal and professional levels and strictly needs to be included with the rest of society healthily.…

Signal Processing · Electrical Eng. & Systems 2023-12-20 Basma Kalandar , Ziemowit Dworakowski

People with vocal and hearing disabilities use sign language to express themselves using visual gestures and signs. Although sign language is a solution for communication difficulties faced by deaf people, there are still problems as most…

Computer Vision and Pattern Recognition · Computer Science 2023-05-01 Mallikharjuna Rao K , Harleen Kaur , Sanjam Kaur Bedi , M A Lekhana

Automatic Sign Language (SL) recognition is an important task in the computer vision community. To build a robust SL recognition system, we need a considerable amount of data which is lacking particularly in Indian sign language (ISL). In…

Computer Vision and Pattern Recognition · Computer Science 2024-09-30 Suvajit Patra , Arkadip Maitra , Megha Tiwari , K. Kumaran , Swathy Prabhu , Swami Punyeshwarananda , Soumitra Samanta

Sign language visual recognition from continuous multi-modal streams is still one of the most challenging fields. Recent advances in human actions recognition are exploiting the ascension of GPU-based learning from massive data, and are…

Computer Vision and Pattern Recognition · Computer Science 2020-09-23 Bassem Seddik , Najoua Essoukri Ben Amara

This paper investigates RF-based system for automatic American Sign Language (ASL) recognition. We consider radar for ASL by joint spatio-temporal preprocessing of radar returns using time frequency (TF) analysis and high-resolution receive…

Signal Processing · Electrical Eng. & Systems 2022-04-01 Gavin MacLaughlin , Jack Malcolm , Syed Ali Hamza

American Sign Language (ASL) is the fourth most commonly used language in the United States and is the language most commonly used by Deaf people in the United States and the English-speaking regions of Canada. Unfortunately, until…

Computer Vision and Pattern Recognition · Computer Science 2020-09-04 Nicholas Wilkins , Beck Cordes Galbraith , Ifeoma Nwogu

Signed Language Processing (SLP) concerns the automated processing of signed languages, the main means of communication of Deaf and hearing impaired individuals. SLP features many different tasks, ranging from sign recognition to…

Computation and Language · Computer Science 2024-07-25 Federico Tavella , Viktor Schlegel , Marta Romeo , Aphrodite Galata , Angelo Cangelosi

We introduce the problem of zero-shot sign language recognition (ZSSLR), where the goal is to leverage models learned over the seen sign class examples to recognize the instances of unseen signs. To this end, we propose to utilize the…

Computer Vision and Pattern Recognition · Computer Science 2019-07-25 Yunus Can Bilge , Nazli Ikizler-Cinbis , Ramazan Gokberk Cinbis

Sign language recognition is a challenging problem where signs are identified by simultaneous local and global articulations of multiple sources, i.e. hand shape and orientation, hand movements, body posture, and facial expressions. Solving…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Ozge Mercanoglu Sincan , Hacer Yalim Keles

This study explores integrating sign language into virtual reality (VR) by examining the comprehensibility and user experience of viewing American Sign Language (ASL) videos captured with body-mounted 360-degree cameras. Ten participants…

Human-Computer Interaction · Computer Science 2026-02-27 Gauri Umesh Rajmane , Ziming Li , Tae Oh , Roshan Peiris