English
Related papers

Related papers: Learning to Score Sign Language with Two-stage Met…

200 papers

Evaluating sign language generation is often done through back-translation, where generated signs are first recognized back to text and then compared to a reference using text-based metrics. However, this two-step evaluation pipeline…

Computation and Language · Computer Science 2025-09-05 Saki Imai , Mert İnan , Anthony Sicilia , Malihe Alikhani

Sign language is the fundamental communication method among people who suffer from speech and hearing defects. The rest of the world doesn't have a clear idea of sign language. "Sign Language Communicator" (SLC) is designed to solve the…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Matheesha Fernando , Janaka Wijayanayake

In this paper, a comparative experimental assessment of computer vision-based methods for sign language recognition is conducted. By implementing the most recent deep neural network methods in this field, a thorough evaluation on multiple…

Sign Language Recognition has emerged as one of the important area of research in Computer Vision. The difficulty faced by the researchers is that the instances of signs vary with both motion and appearance. Thus, in this paper a novel…

Computer Vision and Pattern Recognition · Computer Science 2013-06-07 Joyeeta Singha , Karen Das

Sign Language Recognition (SLR) is an essential yet challenging task since sign language is performed with the fast and complex movement of hand gestures, body posture, and even facial expressions. %Skeleton Aware Multi-modal Sign Language…

Computer Vision and Pattern Recognition · Computer Science 2023-02-17 Maxim Novopoltsev , Leonid Verkhovtsev , Ruslan Murtazin , Dmitriy Milevich , Iuliia Zemtsova

Accurate recognition and interpretation of sign language are crucial for enhancing communication accessibility for deaf and hard of hearing individuals. However, current approaches of Isolated Sign Language Recognition (ISLR) often face…

Computer Vision and Pattern Recognition · Computer Science 2025-05-14 Karina Kvanchiani , Roman Kraynov , Elizaveta Petrova , Petr Surovcev , Aleksandr Nagaev , Alexander Kapitanov

The application of machine-learning solutions to movement assessment from skeleton videos has attracted significant research attention in recent years. This advancement has made rehabilitation at home more accessible, utilizing movement…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Tal Hakim

Systems that can efficiently search collections of sign language videos have been highlighted as a useful application of sign language technology. However, the problem of searching videos beyond individual keywords has received limited…

Computer Vision and Pattern Recognition · Computer Science 2022-09-16 Amanda Duarte , Samuel Albanie , Xavier Giró-i-Nieto , Gül Varol

Like speech, signs are composed of discrete, recombinable features called phonemes. Prior work shows that models which can recognize phonemes are better at sign recognition, motivating deeper exploration into strategies for modeling sign…

Computation and Language · Computer Science 2023-10-03 Lee Kezar , Riley Carlin , Tejas Srinivasan , Zed Sehyr , Naomi Caselli , Jesse Thomason

We propose a real-time 3D human pose estimation and motion analysis method termed RePose for rehabilitation training. It is capable of real-time monitoring and evaluation of patients'motion during rehabilitation, providing immediate…

Computer Vision and Pattern Recognition · Computer Science 2026-01-05 Junxiao Xue , Pavel Smirnov , Ziao Li , Yunyun Shi , Shi Chen , Xinyi Yin , Xiaohan Yue , Lei Wang , Yiduo Wang , Feng Lin , Yijia Chen , Xiao Ma , Xiaoran Yan , Qing Zhang , Fengjian Xue , Xuecheng Wu

The need of sign language is increasing radically especially to hearing impaired community. Only few research groups try to automatically recognize sign language from video, colored gloves and etc. Their approach requires a valid…

Computer Vision and Pattern Recognition · Computer Science 2010-01-13 M. Krishnaveni , Dr. V. Radha

Historically, sign language machine translation has been posed as a sentence-level task: datasets consisting of continuous narratives are chopped up and presented to the model as isolated clips. In this work, we explore the limitations of…

Computation and Language · Computer Science 2024-06-18 Garrett Tanzer , Maximus Shengelia , Ken Harrenstien , David Uthus

Human action recognition and analysis have great demand and important application significance in video surveillance, video retrieval, and human-computer interaction. The task of human action quality evaluation requires the intelligent…

Computer Vision and Pattern Recognition · Computer Science 2022-04-21 Shunli Wang , Dingkang Yang , Peng Zhai , Qing Yu , Tao Suo , Zhan Sun , Ka Li , Lihua Zhang

Sign language is a visual language used by the deaf and dumb community to communicate. However, for most recognition methods based on monocular cameras, the recognition accuracy is low and the robustness is poor. Even if the effect is good…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Zhiyu Long , Xingyou Liu , Jiaqi Qiao , Zhi Li

Fingerspelling, in which words are signed letter by letter, is an important component of American Sign Language. Most previous work on automatic fingerspelling recognition has assumed that the boundaries of fingerspelling regions in signing…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Bowen Shi , Diane Brentari , Greg Shakhnarovich , Karen Livescu

Sign language is a visual language expressed through hand movements and non-manual markers. Non-manual markers include facial expressions and head movements. These expressions vary across different nations. Therefore, specialized analysis…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Yui Tatsumi , Shoko Tanaka , Shunsuke Akamatsu , Takahiro Shindo , Hiroshi Watanabe

In recent years, there has been a considerable amount of research in the Gesture Recognition domain, mainly owing to the technological advancements in Computer Vision. Various new applications have been conceptualised and developed in this…

Computer Vision and Pattern Recognition · Computer Science 2023-12-04 Kshitij Deshpande , Varad Mashalkar , Kaustubh Mhaisekar , Amaan Naikwadi , Archana Ghotkar

Over the years, hand gesture recognition has been mostly addressed considering hand trajectories in isolation. However, in most sign languages, hand gestures are defined on a particular context (body region). We propose a pipeline to…

Computer Vision and Pattern Recognition · Computer Science 2016-07-22 Marc Martínez-Camarena , Jose Oramas , Mario Montagud-Climent , Tinne Tuytelaars

Automatic emotion recognition has become a trending research topic in the past decade. While works based on facial expressions or speech abound, recognizing affect from body gestures remains a less explored topic. We present a new…

Computer Vision and Pattern Recognition · Computer Science 2018-01-24 Fatemeh Noroozi , Ciprian Adrian Corneanu , Dorota Kamińska , Tomasz Sapiński , Sergio Escalera , Gholamreza Anbarjafari

Researches on signed languages still strongly dissociate lin- guistic issues related on phonological and phonetic aspects, and gesture studies for recognition and synthesis purposes. This paper focuses on the imbrication of motion and…

Computation and Language · Computer Science 2012-10-30 Sylvie Gibet , Pierre-François Marteau , Kyle Duarte