English
Related papers

Related papers: Pose-Based Sign Language Appearance Transfer

200 papers

Our objective is to translate continuous sign language into spoken language text. Inspired by the way human interpreters rely on context for accurate translation, we incorporate additional contextual cues together with the signing video,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Youngjoon Jang , Haran Raajesh , Liliane Momeni , Gül Varol , Andrew Zisserman

We present the first method that automatically transfers poses between stylized 3D characters without skeletal rigging. In contrast to previous attempts to learn pose transformations on fixed or topology-equivalent skeleton templates, our…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Zhouyingcheng Liao , Jimei Yang , Jun Saito , Gerard Pons-Moll , Yang Zhou

We propose a lightweight real-time sign language detection model, as we identify the need for such a case in videoconferencing. We extract optical flow features based on human pose estimation and, using a linear classifier, show these…

Computer Vision and Pattern Recognition · Computer Science 2020-09-15 Amit Moryossef , Ioannis Tsochantaridis , Roee Aharoni , Sarah Ebling , Srini Narayanan

Over the years, hand gesture recognition has been mostly addressed considering hand trajectories in isolation. However, in most sign languages, hand gestures are defined on a particular context (body region). We propose a pipeline to…

Computer Vision and Pattern Recognition · Computer Science 2016-07-22 Marc Martínez-Camarena , Jose Oramas , Mario Montagud-Climent , Tinne Tuytelaars

Bangladeshi Sign Language (BdSL) - like other sign languages - is tough to learn for general people, especially when it comes to expressing letters. In this poster, we propose PerSign, a system that can reproduce a person's image by…

Computer Vision and Pattern Recognition · Computer Science 2022-09-30 Mohammad Imrul Jubair , Ali Ahnaf , Tashfiq Nahiyan Khan , Ullash Bhattacharjee , Tanjila Joti

We propose a method to transfer pose and expression between face images. Given a source and target face portrait, the model produces an output image in which the pose and expression of the source face image are transferred onto the target…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Petr Jahoda , Jan Cech

In computer vision, human pose synthesis and transfer deal with probabilistic image generation of a person in a previously unseen pose from an already available observation of that person. Though researchers have recently proposed several…

Computer Vision and Pattern Recognition · Computer Science 2025-02-19 Prasun Roy , Subhankar Ghosh , Saumik Bhattacharya , Umapada Pal , Michael Blumenstein

Automatic Sign Language Recognition (ASLR) has emerged as a vital field for bridging the gap between deaf and hearing communities. However, the problem of sign-to-sign retrieval or detecting a specific sign within a sequence of continuous…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Samuel Ebimobowei Johnny , Blessed Guda , Emmanuel Enejo Aaron , Assane Gueye

Sign language generation aims to produce diverse sign representations based on spoken language. However, achieving realistic and naturalistic generation remains a significant challenge due to the complexity of sign language, which…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Xu Wang , Shengeng Tang , Lechao Cheng , Feng Li , Shuo Wang , Richang Hong

Learning semantic attributes for person re-identification and description-based person search has gained increasing interest due to attributes' great potential as a pose and view-invariant representation. However, existing attribute-centric…

Computer Vision and Pattern Recognition · Computer Science 2017-06-13 Zhiyuan Shi , Timothy M. Hospedales , Tao Xiang

This paper presents a novel method for learning a pose lexicon comprising semantic poses defined by textual instructions and their associated visual poses defined by visual features. The proposed method simultaneously takes two input…

Computer Vision and Pattern Recognition · Computer Science 2016-11-15 Lijuan Zhou , Wanqing Li , Philip Ogunbona

The complexity of Sign Language (SL) data processing brings many challenges. The current approach to recognition of SL signs aims to translate RGB sign language videos through pose information into Word-based ID Glosses, which serve to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Sen Fang , Yalin Feng , Chunyu Sui , Hongbin Zhong , Yanxin Zhang , Hongwei Yi , Hezhen Hu , Dimitris N. Metaxas

Sign language is a visual language used by the deaf and dumb community to communicate. However, for most recognition methods based on monocular cameras, the recognition accuracy is low and the robustness is poor. Even if the effect is good…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Zhiyu Long , Xingyou Liu , Jiaqi Qiao , Zhi Li

Sign language is a visual language that enhances communication between people and is frequently used as the primary form of communication by people with hearing loss. Even so, not many people with hearing loss use sign language, and they…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Rupesh Kumar , Ayush Sinha , Ashutosh Bajpai , S. K Singh

Human pose information is a critical component in many downstream image processing tasks, such as activity recognition and motion tracking. Likewise, a pose estimator for the illustrated character domain would provide a valuable prior for…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Shuhong Chen , Matthias Zwicker

In this paper, a novel approach to sign language recognition based on state tying in each of data streams is presented. In this framework, it is assumed that hand gesture signal is represented in terms of six synchronous data streams, i.e.,…

Other Computer Science · Computer Science 2024-07-17 Jiyong Ma , Wen Gao , Chunli Wang

Sign language translation from text to video plays a crucial role in enabling effective communication for Deaf and hard--of--hearing individuals. A major challenge lies in generating accurate and natural body poses and movements that…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Zetian Wu , Tianshuo Zhou , Stefan Lee , Liang Huang

Person re-identification (re-ID) concerns the matching of subject images across different camera views in a multi camera surveillance system. One of the major challenges in person re-ID is pose variations across the camera network, which…

Computer Vision and Pattern Recognition · Computer Science 2021-04-29 Amena Khatun , Simon Denman , Sridha Sridharan , Clinton Fookes

Sign language translation remains a challenging task due to the scarcity of large-scale, sentence-aligned datasets. Prior arts have focused on various feature extraction and architectural changes to support neural machine translation for…

Computation and Language · Computer Science 2025-11-04 Abhinav Joshi , Vaibhav Sharma , Sanjeet Singh , Ashutosh Modi

Sign Language helps people with Speaking and Hearing Disabilities communicate with others efficiently. Sign Language identification is a challenging area in the field of computer vision and recent developments have been able to achieve near…

Computer Vision and Pattern Recognition · Computer Science 2021-01-21 Yugam Bajaj , Puru Malhotra