English
Related papers

Related papers: Improving Handshape Representations for Sign Langu…

200 papers

Subtle hand differences make sign language recognition challenging, yet many existing methods rely on encoders pretrained on generic action datasets that poorly capture such fine-grained cues. We propose a self-supervised pretraining method…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Kunyuan Xie , Zhixi Cai , Kalin Stefanov

Sign language visual recognition from continuous multi-modal streams is still one of the most challenging fields. Recent advances in human actions recognition are exploiting the ascension of GPU-based learning from massive data, and are…

Computer Vision and Pattern Recognition · Computer Science 2020-09-23 Bassem Seddik , Najoua Essoukri Ben Amara

The target of this research is to experiment, iterate and recommend a system that is successful in recognition of American Sign Language (ASL). It is a challenging as well as an interesting problem that if solved will bring a leap in social…

Computer Vision and Pattern Recognition · Computer Science 2018-05-18 Dhruv Rathi

Sign language segmentation is a crucial task in sign language processing systems. It enables downstream tasks such as sign recognition, transcription, and machine translation. In this work, we consider two kinds of segmentation:…

Computation and Language · Computer Science 2023-10-31 Amit Moryossef , Zifan Jiang , Mathias Müller , Sarah Ebling , Yoav Goldberg

In this paper, a comparative experimental assessment of computer vision-based methods for sign language recognition is conducted. By implementing the most recent deep neural network methods in this field, a thorough evaluation on multiple…

Hand and face play an important role in expressing sign language. Their features are usually especially leveraged to improve system performance. However, to effectively extract visual representations and capture trajectories for hands and…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Lianyu Hu , Liqing Gao , Zekang liu , Wei Feng

We address the task of American Sign Language fingerspelling translation using videos in the wild. We exploit advances in more accurate hand pose estimation and propose a novel architecture that leverages the transformer based…

Computer Vision and Pattern Recognition · Computer Science 2023-11-22 Pooya Fayyazsanavi , Negar Nejatishahidin , Jana Kosecka

Abusive behaviors are common on online social networks. The increasing frequency of antisocial behaviors forces the hosts of online platforms to find new solutions to address this problem. Automating the moderation process has thus received…

Social and Information Networks · Computer Science 2021-01-21 Noé Cecillon , Vincent Labatut , Richard Dufour , Georges Linares

Sign Language Recognition (SLR) is an essential yet challenging task since sign language is performed with the fast and complex movement of hand gestures, body posture, and even facial expressions. %Skeleton Aware Multi-modal Sign Language…

Computer Vision and Pattern Recognition · Computer Science 2023-02-17 Maxim Novopoltsev , Leonid Verkhovtsev , Ruslan Murtazin , Dmitriy Milevich , Iuliia Zemtsova

Hand gesture serves as a crucial role during the expression of sign language. Current deep learning based methods for sign language understanding (SLU) are prone to over-fitting due to insufficient sign data resource and suffer limited…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Hezhen Hu , Weichao Zhao , Wengang Zhou , Houqiang Li

This work presents a meta study covering around 300 published sign language recognition papers with over 400 experimental results. It includes most papers between the start of the field in 1983 and 2020. Additionally, it covers a…

Computer Vision and Pattern Recognition · Computer Science 2020-09-01 Oscar Koller

A persistent challenge in sign language video processing, including the task of sign to written language translation, is how we learn representations of sign language in an effective and efficient way that preserves the important attributes…

Computation and Language · Computer Science 2025-06-04 Shester Gueuwou , Xiaodan Du , Greg Shakhnarovich , Karen Livescu

Fingerspelling is a significant component of Sign Language (SL), allowing the interpretation of proper names, characterized by fast hand movements during signing. Although previous works on fingerspelling recognition have focused on…

Computer Vision and Pattern Recognition · Computer Science 2025-05-16 Pavel Korotaev , Petr Surovtsev , Alexander Kapitanov , Karina Kvanchiani , Aleksandr Nagaev

Neural Sign Language Production (SLP) aims to automatically translate from spoken language sentences to sign language videos. Historically the SLP task has been broken into two steps; Firstly, translating from a spoken language sentence to…

Computation and Language · Computer Science 2022-10-13 Harry Walsh , Ben Saunders , Richard Bowden

This work presents an approach for recognizing isolated sign language gestures using skeleton-based pose data extracted from video sequences. A Graph-GRU temporal network is proposed to model both spatial and temporal dependencies between…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 B. Mederos , J. Mejía , A. Medina-Reyes , Y. Espinosa-Almeyda , J. D. Díaz-Roman , I. Rodríguez-Mederos , M. Mejía-Carreon , F. Gonzalez-Lopez

The automatic interpretation of sign languages is a challenging task, as it requires the usage of high-level vision and high-level motion processing systems for providing accurate image perception. In this paper, we use Convolutional Neural…

Computer Vision and Pattern Recognition · Computer Science 2020-10-16 Gustaf Halvardsson , Johanna Peterson , César Soto-Valero , Benoit Baudry

Automatic sign language recognition is a research area that encompasses human-computer interaction, computer vision and machine learning. Robust automatic recognition of sign language could assist in the translation process and the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Franco Ronchetti , Facundo Manuel Quiroga , César Estrebou , Laura Lanzarini , Alejandro Rosete

We study the problem of recognizing video sequences of fingerspelled letters in American Sign Language (ASL). Fingerspelling comprises a significant but relatively understudied part of ASL. Recognizing fingerspelling is challenging for a…

Computation and Language · Computer Science 2016-09-27 Taehwan Kim , Jonathan Keane , Weiran Wang , Hao Tang , Jason Riggle , Gregory Shakhnarovich , Diane Brentari , Karen Livescu

Recently brain networks have been widely adopted to study brain dynamics, brain development and brain diseases. Graph representation learning techniques on brain functional networks can facilitate the discovery of novel biomarkers for…

Machine Learning · Computer Science 2022-07-19 Haoteng Tang , Guixiang Ma , Lei Guo , Xiyao Fu , Heng Huang , Liang Zhang

Even today in Twenty First Century Handwritten communication has its own stand and most of the times, in daily life it is globally using as means of communication and recording the information like to be shared with others. Challenges in…

Artificial Intelligence · Computer Science 2012-05-18 Yusuf Perwej , Ashish Chaturvedi