English
Related papers

Related papers: American Sign Language Handshapes Reflect Pressure…

200 papers

Sign language recognition is a challenging gesture sequence recognition problem, characterized by quick and highly coarticulated motion. In this paper we focus on recognition of fingerspelling sequences in American Sign Language (ASL)…

Computer Vision and Pattern Recognition · Computer Science 2019-08-29 Bowen Shi , Aurora Martinez Del Rio , Jonathan Keane , Diane Brentari , Greg Shakhnarovich , Karen Livescu

Signed Language Processing (SLP) concerns the automated processing of signed languages, the main means of communication of Deaf and hearing impaired individuals. SLP features many different tasks, ranging from sign recognition to…

Computation and Language · Computer Science 2024-07-25 Federico Tavella , Viktor Schlegel , Marta Romeo , Aphrodite Galata , Angelo Cangelosi

This works aims to design a statistical machine translation from English text to American Sign Language (ASL). The system is based on Moses tool with some modifications and the results are synthesized through a 3D avatar for interpretation.…

Computation and Language · Computer Science 2011-12-02 Achraf Othman , Mohamed Jemni

We introduce a goal-oriented conversational AI system enhanced with American Sign Language (ASL) instructions, presenting the first implementation of such a system on a worldwide multimodal conversational AI platform. Accessible through a…

Computation and Language · Computer Science 2024-10-21 Mert İnan , Katherine Atwell , Anthony Sicilia , Lorna Quandt , Malihe Alikhani

Helping deaf and hard-of-hearing people communicate more easily is the main goal of Automatic Sign Language Translation. Although most past research has focused on turning sign language into text, doing the reverse, turning spoken English…

Computer Vision and Pattern Recognition · Computer Science 2025-07-10 Kazi Mahathir Rahman , Naveed Imtiaz Nafis , Md. Farhan Sadik , Mohammad Al Rafi , Mehedi Hasan Shahed

With the recent advancements in intelligent personal assistants (IPAs), their popularity is rapidly increasing when it comes to utilizing Automatic Speech Recognition within households. In this study, we used a Wizard-of-Oz methodology to…

Human-Computer Interaction · Computer Science 2024-05-16 Nina Tran , Paige DeVries , Matthew Seita , Raja Kushalnagar , Abraham Glasser , Christian Vogler

This paper introduces an open-source interface for American Sign Language fingerspell recognition and semantic pose retrieval, aimed to serve as a stepping stone towards more advanced sign language translation systems. Utilizing a…

Computation and Language · Computer Science 2024-08-20 Kevin Jose Thomas

Despite tremendous progress in natural language processing using deep learning techniques in recent years, sign language production and comprehension has advanced very little. One critical barrier is the lack of largescale datasets…

Computation and Language · Computer Science 2022-10-14 Yehong Jiang

Searching for unfamiliar American Sign Language (ASL) signs is challenging for learners because, unlike spoken languages, they cannot type a text-based query to look up an unfamiliar sign. Advances in isolated sign recognition have enabled…

Human-Computer Interaction · Computer Science 2025-04-09 Saad Hassan , Matyas Bohacek , Chaelin Kim , Denise Crochet

This research paper describes a realtime system for identifying American Sign Language (ASL) movements that employs modern computer vision and machine learning approaches. The suggested method makes use of the Mediapipe library for feature…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Rupesh Kumar , Ashutosh Bajpai , Ayush Sinha

People with speech and hearing impairments often rely on sign language to communicate with others but most of the general population cannot understand sign language and sign language itself is a difficult language to learn, so there is a…

Human-Computer Interaction · Computer Science 2020-09-10 Sai Charan Bodda , Palki Gupta , Gaurav Joshi , Ayush Chaturvedi

Sign Language is the dominant yet non-primary form of communication language used in the deaf and hearing-impaired community. To make an easy and mutual communication between the hearing-impaired and the hearing communities, building a…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Razieh Rastgoo , Kourosh Kiani , Sergio Escalera , Mohammad Sabokrou

We use insights from research on American Sign Language (ASL) phonology to train models for isolated sign language recognition (ISLR), a step towards automatic sign language understanding. Our key insight is to explicitly recognize the role…

Computation and Language · Computer Science 2023-02-14 Lee Kezar , Jesse Thomason , Zed Sevcikova Sehyr

American Sign Language recognition is a difficult gesture recognition problem, characterized by fast, highly articulate gestures. These are comprised of arm movements with different hand shapes, facial expression and head movements. Among…

Computer Vision and Pattern Recognition · Computer Science 2020-03-20 Al Amin Hosain , Panneer Selvam Santhalingam , Parth Pathak , Huzefa Rangwala , Jana Kosecka

AI-driven sign language interpretation is limited by a lack of high-quality annotated data. New datasets including ASL STEM Wiki and FLEURS-ASL contain professional interpreters and 100s of hours of data but remain only partially annotated…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Colin Lea , Vasileios Baltatzis , Connor Gillis , Raja Kushalnagar , Lorna Quandt , Leah Findlater

The target of this research is to experiment, iterate and recommend a system that is successful in recognition of American Sign Language (ASL). It is a challenging as well as an interesting problem that if solved will bring a leap in social…

Computer Vision and Pattern Recognition · Computer Science 2018-05-18 Dhruv Rathi

Translating written sentences from oral languages to a sequence of manual and non-manual gestures plays a crucial role in building a more inclusive society for deaf and hard-of-hearing people. Facial expressions (non-manual), in particular,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Rafael Azevedo , Thiago Coutinho , João Ferreira , Thiago Gomes , Erickson Nascimento

Sign languages are multi-channel languages that communicate information through not just the hands (manual signals) but also facial expressions and upper body movements (non-manual signals). However, since automatic sign language…

Computation and Language · Computer Science 2024-06-12 Jung-Ho Kim , Mathew Huerta-Enochian , Changyong Ko , Du Hui Lee

Sign languages play a crucial role in the communication of deaf communities, but they are often marginalized, limiting access to essential services such as healthcare and education. This study proposes an automatic sign language recognition…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Fraisse Sacré Takouchouang , Ho Tuong Vinh

Sign language translation is one of the important issues in communication between deaf and hearing people, as it expresses words through hand, body, and mouth movements. American Sign Language is one of the sign languages used, one of which…

Computation and Language · Computer Science 2024-09-18 Gregorius Guntur Sunardi Putra , Adifa Widyadhani Chanda D'Layla , Dimas Wahono , Riyanarto Sarno , Agus Tri Haryono