English
Related papers

Related papers: American Sign Language Alphabet Recognition using …

200 papers

In this paper, we develop four spiking neural network (SNN) models for two static American Sign Language (ASL) hand gesture classification tasks, i.e., the ASL Alphabet and ASL Digits. The SNN models are deployed on Intel's neuromorphic…

Machine Learning · Computer Science 2022-10-04 MohammadReza Mohammadi , Peyton Chandarana , James Seekings , Sara Hendrix , Ramtin Zand

Arabic text recognition is a challenging task because of the cursive nature of Arabic writing system, its joint writing scheme, the large number of ligatures and many other challenges. Deep Learning DL models achieved significant progress…

Computer Vision and Pattern Recognition · Computer Science 2020-09-07 Mohammad Fasha , Bassam Hammo , Nadim Obeid , Jabir Widian

Sign language recognition is a challenging gesture sequence recognition problem, characterized by quick and highly coarticulated motion. In this paper we focus on recognition of fingerspelling sequences in American Sign Language (ASL)…

Computer Vision and Pattern Recognition · Computer Science 2019-08-29 Bowen Shi , Aurora Martinez Del Rio , Jonathan Keane , Diane Brentari , Greg Shakhnarovich , Karen Livescu

I propose a state of the art deep neural architectural solution for handwritten character recognition for Bengali alphabets, compound characters as well as numerical digits that achieves state-of-the-art accuracy 96.8% in just 11 epochs.…

Computer Vision and Pattern Recognition · Computer Science 2020-09-22 Akash Roy

We address the problem of automatic American Sign Language fingerspelling recognition from video. Prior work has largely relied on frame-level labels, hand-crafted features, or other constraints, and has been hampered by the scarcity of…

Computation and Language · Computer Science 2019-02-19 Bowen Shi , Karen Livescu

Voice-controlled personal and home assistants (such as the Amazon Echo and Apple Siri) are becoming increasingly popular for a variety of applications. However, the benefits of these technologies are not readily accessible to Deaf or…

Machine Learning · Computer Science 2019-09-26 Al Amin Hosain , Panneer Selvam Santhalingam , Parth Pathak , Jana Kosecka , Huzefa Rangwala

We present Large Sign Language Models (LSLM), a novel framework for translating 3D American Sign Language (ASL) by leveraging Large Language Models (LLMs) as the backbone, which can benefit hearing-impaired individuals' virtual…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Sen Zhang , Xiaoxiao He , Di Liu , Zhaoyang Xia , Mingyu Zhao , Chaowei Tan , Vivian Li , Bo Liu , Dimitris N. Metaxas , Mubbasir Kapadia

In this thesis, we study the problem of recognizing video sequences of fingerspelled letters in American Sign Language (ASL). Fingerspelling comprises a significant but relatively understudied part of ASL, and recognizing it is challenging…

Computation and Language · Computer Science 2016-08-31 Taehwan Kim

Signed Language Processing (SLP) concerns the automated processing of signed languages, the main means of communication of Deaf and hearing impaired individuals. SLP features many different tasks, ranging from sign recognition to…

Computation and Language · Computer Science 2024-07-25 Federico Tavella , Viktor Schlegel , Marta Romeo , Aphrodite Galata , Angelo Cangelosi

As handwriting input becomes more prevalent, the large symbol inventory required to support Chinese handwriting recognition poses unique challenges. This paper describes how the Apple deep learning recognition system can accurately handle…

Computer Vision and Pattern Recognition · Computer Science 2020-05-19 Youssouf Chherawala , Hans J. G. A. Dolfing , Ryan S. Dixon , Jerome R. Bellegarda

This paper presents a thoroughly automated method for identifying and interpreting cuneiform characters via advanced deep-learning algorithms. Five distinct deep-learning models were trained on a comprehensive dataset of cuneiform…

Computation and Language · Computer Science 2025-05-09 Shahad Elshehaby , Alavikunhu Panthakkan , Hussain Al-Ahmad , Mina Al-Saad

Sign language is commonly used by deaf or mute people to communicate but requires extensive effort to master. It is usually performed with the fast yet delicate movement of hand gestures, body posture, and even facial expressions. Current…

Computer Vision and Pattern Recognition · Computer Science 2021-10-13 Songyao Jiang , Bin Sun , Lichen Wang , Yue Bai , Kunpeng Li , Yun Fu

Natural language processing for sign language video - including tasks like recognition, translation, and search - is crucial for making artificial intelligence technologies accessible to deaf individuals, and is gaining research interest in…

Computer Vision and Pattern Recognition · Computer Science 2022-03-28 Bowen Shi , Diane Brentari , Greg Shakhnarovich , Karen Livescu

We study the problem of recognizing video sequences of fingerspelled letters in American Sign Language (ASL). Fingerspelling comprises a significant but relatively understudied part of ASL. Recognizing fingerspelling is challenging for a…

Computation and Language · Computer Science 2016-09-27 Taehwan Kim , Jonathan Keane , Weiran Wang , Hao Tang , Jason Riggle , Gregory Shakhnarovich , Diane Brentari , Karen Livescu

Sign languages are visual languages, with vocabularies as rich as their spoken language counterparts. However, current deep-learning based Sign Language Production (SLP) models produce under-articulated skeleton pose sequences from…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Ben Saunders , Necati Cihan Camgoz , Richard Bowden

Active deep learning classification of hyperspectral images is considered in this paper. Deep learning has achieved success in many applications, but good-quality labeled samples are needed to construct a deep learning network. It is…

Machine Learning · Computer Science 2016-12-04 Peng Liu , Hui Zhang , Kie B. Eom

We are releasing a dataset containing videos of both fluent and non-fluent signers using American Sign Language (ASL), which were collected using a Kinect v2 sensor. This dataset was collected as a part of a project to develop and evaluate…

Computation and Language · Computer Science 2022-07-11 Saad Hassan , Matthew Seita , Larwan Berke , Yingli Tian , Elaine Gale , Sooyeon Lee , Matt Huenerfauth

Progress in machine understanding of sign languages has been slow and hampered by limited data. In this paper, we present FSboard, an American Sign Language fingerspelling dataset situated in a mobile text entry use case, collected from 147…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Manfred Georg , Garrett Tanzer , Saad Hassan , Maximus Shengelia , Esha Uboweja , Sam Sepah , Sean Forbes , Thad Starner

Deep learning approaches to natural language processing have made great strides in recent years. While these models produce symbols that convey vast amounts of diverse knowledge, it is unclear how such symbols are grounded in data from the…

Computer Vision and Pattern Recognition · Computer Science 2023-09-13 James Robert Kubricht , Zhaoyuan Yang , Jianwei Qiu , Peter Henry Tu

This study presents a novel approach for enhancing American Sign Language (ASL) recognition using Graph Convolutional Networks (GCNs) integrated with successive residual connections. The method leverages the MediaPipe framework to extract…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Ushnish Sarkar , Archisman Chakraborti , Tapas Samanta , Sarbajit Pal , Amitabha Das