English
Related papers

Related papers: Continuous Sign Language Recognition System using …

200 papers

Sign Language Production (SLP) is the task of generating sign language video from spoken language inputs. The field has seen a range of innovations over the last few years, with the introduction of deep learning-based approaches providing…

The deaf and hard of hearing community relies on American Sign Language (ASL) as their primary mode of communication, but communication with others who do not know ASL can be difficult, especially during emergencies where no interpreter is…

Image and Video Processing · Electrical Eng. & Systems 2023-05-12 Janice Nguyen , Y. Curtis Wang

Sign Language Production (SLP) is the tough task of turning sign language into sign videos. The main goal of SLP is to create these videos using a sign gloss. In this research, we've developed a new method to make high-quality sign videos…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Pan Xie , Taiyi Peng , Yao Du , Qipeng Zhang

Emotional voice communication plays a crucial role in effective daily interactions. Deaf and hard-of-hearing (DHH) individuals often rely on facial expressions to supplement sign language to convey emotions, as the use of voice is limited.…

Human-Computer Interaction · Computer Science 2024-12-10 Hyunchul Lim , Minghan Gao , Franklin Mingzhe Li , Nam Anh Dang , Ianip Sit , Michelle M Olson , Cheng Zhang

In this research, we present our findings to recognize American Sign Language from series of hand gestures. While most researches in literature focus only on static handshapes, our work target dynamic hand gestures. Since dynamic signs…

Computer Vision and Pattern Recognition · Computer Science 2022-05-26 Nguyen Huu Phong , Bernardete Ribeiro

The American Sign Language Linguistic Research Project (ASLLRP) provides Internet access to high-quality ASL video data, generally including front and side views and a close-up of the face. The manual and non-manual components of the…

Computation and Language · Computer Science 2022-01-21 Carol Neidle , Augustine Opoku , Dimitris Metaxas

Sign language (SL) is an essential communication form for hearing-impaired and deaf people, enabling engagement within the broader society. Despite its significance, limited public awareness of SL often leads to inequitable access to…

Computation and Language · Computer Science 2025-09-04 Soukeina Elhassen , Lama Al Khuzayem , Areej Alhothali , Ohoud Alzamzami , Nahed Alowaidi

Sign language recognition is a difficult task, yet required for many applications in real-time speed. Using RGB cameras for recognition of sign languages is not very successful in practical situations and accurate 3D imaging requires…

Multimedia · Computer Science 2011-05-05 Morteza Zahedi , Ali Reza Manashty

Sign Language Production (SLP) is the process of converting the complex input text into a real video. Most previous works focused on the Text2Gloss, Gloss2Pose, Pose2Vid stages, and some concentrated on Prompt2Gloss and Text2Avatar stages.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Sen Fang , Yalin Feng , Hongbin Zhong , Yanxin Zhang , Dimitris N. Metaxas

Sign language is a natural and visual form of language that uses movements and expressions to convey meaning, serving as a crucial means of communication for individuals who are deaf or hard-of-hearing (DHH). However, the number of people…

Robotics · Computer Science 2026-02-27 Guanren Qiao , Sixu Lin , Ronglai Zuo , Zhizheng Wu , Kui Jia , Guiliang Liu

Body language (BL) refers to the non-verbal communication expressed through physical movements, gestures, facial expressions, and postures. It is a form of communication that conveys information, emotions, attitudes, and intentions without…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Li Liu , Lufei Gao , Wentao Lei , Fengji Ma , Xiaotian Lin , Jinting Wang

We introduce a goal-oriented conversational AI system enhanced with American Sign Language (ASL) instructions, presenting the first implementation of such a system on a worldwide multimodal conversational AI platform. Accessible through a…

Computation and Language · Computer Science 2024-10-21 Mert İnan , Katherine Atwell , Anthony Sicilia , Lorna Quandt , Malihe Alikhani

Continuously recognizing sign gestures and converting them to glosses plays a key role in bridging the gap between the hearing and hearing-impaired communities. This involves recognizing and interpreting the hands, face, and body gestures…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Samuel Ebimobowei Johnny , Blessed Guda , Andrew Blayama Stephen , Assane Gueye

Technological advancements and innovations are advancing our daily life in all the ways possible but there is a larger section of society who are deprived of accessing the benefits due to their physical inabilities. To reap the real…

Computation and Language · Computer Science 2024-05-14 Abhinand K. , Abhiram B. Nair , Dhananjay C. , Hanan Hamza , Mohammed Fawaz J. , Rahma Fahim K. , Anoop V. S

Sign language translation is one of the important issues in communication between deaf and hearing people, as it expresses words through hand, body, and mouth movements. American Sign Language is one of the sign languages used, one of which…

Computation and Language · Computer Science 2024-09-18 Gregorius Guntur Sunardi Putra , Adifa Widyadhani Chanda D'Layla , Dimas Wahono , Riyanarto Sarno , Agus Tri Haryono

Automatic sign language recognition is a research area that encompasses human-computer interaction, computer vision and machine learning. Robust automatic recognition of sign language could assist in the translation process and the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Franco Ronchetti , Facundo Manuel Quiroga , César Estrebou , Laura Lanzarini , Alejandro Rosete

With approximately 7,000 languages spoken worldwide, current large language models (LLMs) support only a small subset. Prior research indicates LLMs can learn new languages for certain tasks without supervised data. We extend this…

Computation and Language · Computer Science 2026-01-29 Zhaolin Li , Jan Niehues

In the realm of multimodal communication, sign language is, and continues to be, one of the most understudied areas. In line with recent advances in the field of deep learning, there are far reaching implications and applications that…

Computer Vision and Pattern Recognition · Computer Science 2017-11-21 Vivek Bheda , Dianna Radpour

Sign Languages are expressed through hand and upper body gestures as well as facial expressions. Therefore, Sign Language Recognition (SLR) needs to focus on all such cues. Previous work uses hand-crafted mechanisms or network aggregation…

Computer Vision and Pattern Recognition · Computer Science 2020-09-30 Çağrı Gökçe , Oğulcan Özdemir , Ahmet Alp Kındıroğlu , Lale Akarun

Inspired by recent developments in natural language processing, we propose a novel approach to sign language processing based on phonological properties validated by American Sign Language users. By taking advantage of datasets composed of…

Computation and Language · Computer Science 2024-07-25 Federico Tavella , Aphrodite Galata , Angelo Cangelosi