English
Related papers

Related papers: Neural Sign Actors: A diffusion model for 3D sign …

200 papers

A machine can understand human activities, and the meaning of signs can help overcome the communication barriers between the inaudible and ordinary people. Sign Language Recognition (SLR) is a fascinating research area and a crucial task…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 M. Madhiarasan , Partha Pratim Roy

Deaf individuals confront significant communication obstacles on a daily basis. Their inability to hear makes it difficult for them to communicate with those who do not understand sign language. Moreover, it presents difficulties in…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 Velmathi G , Kaushal Goyal

Hand gesture-based Sign Language Recognition (SLR) serves as a crucial communication bridge between deaf and non-deaf individuals. While Graph Convolutional Networks (GCNs) are common, they are limited by their reliance on fixed skeletal…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Koki Hirooka , Abu Saleh Musa Miah , Tatsuya Murakami , Md. Al Mehedi Hasan , Yong Seok Hwang , Jungpil Shin

Deaf people are using sign language for communication, and it is a combination of gestures, movements, postures, and facial expressions that correspond to alphabets and words in spoken languages. The proposed Arabic sign language…

Computer Vision and Pattern Recognition · Computer Science 2023-01-10 Muhammad Al-Barham , Ahmad Jamal , Musa Al-Yaman

Sign language transition generation seeks to convert discrete sign language segments into continuous sign videos by synthesizing smooth transitions. However,most existing methods merely concatenate isolated signs, resulting in poor visual…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Jiashu He , Jiayi He , Shengeng Tang , Huixia Ben , Lechao Cheng , Richang Hong

Sign language is the preferred method of communication of deaf or mute people, but similar to any language, it is difficult to learn and represents a significant barrier for those who are hard of hearing or unable to speak. A person's…

Computer Vision and Pattern Recognition · Computer Science 2022-12-26 Neil Song , Yu Xiang

Text-conditioned video diffusion models have emerged as a powerful tool in the realm of video generation and editing. But their ability to capture the nuances of human movement remains under-explored. Indeed the ability of these models to…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Paul Janson , Tiberiu Popa , Eugene Belilovsky

Translating written sentences from oral languages to a sequence of manual and non-manual gestures plays a crucial role in building a more inclusive society for deaf and hard-of-hearing people. Facial expressions (non-manual), in particular,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Rafael Azevedo , Thiago Coutinho , João Ferreira , Thiago Gomes , Erickson Nascimento

Automatic sign language recognition (SLR) has become a key enabler of inclusive human-computer interaction, fostering seamless communication between deaf individuals and hearing communities. Despite significant advances in multimodal…

Human-Computer Interaction · Computer Science 2026-05-08 Xiaofang Xiao , Guangchao Li , Guangrong Zhao , Qi Lin , Wen Ma , Hongkai Wen , Yanxiang Wang , Yiran Shen

Signed distance map (SDM) is a common representation of surfaces in medical image analysis and machine learning. The computational complexity of SDM for 3D parametric shapes is often a bottleneck in many applications, thus limiting their…

Sign Language Translation (SLT) is a promising technology to bridge the communication gap between the deaf and the hearing people. Recently, researchers have adopted Neural Machine Translation (NMT) methods, which usually require…

Computation and Language · Computer Science 2023-03-22 Biao Fu , Peigen Ye , Liang Zhang , Pei Yu , Cong Hu , Yidong Chen , Xiaodong Shi

The Arabic Sign Language has endorsed outstanding research achievements for identifying gestures and hand signs using the deep learning methodology. The term "forms of communication" refers to the actions used by hearing-impaired people to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-14 Rady El Rwelli , Osama R. Shahin , Ahmed I. Taloba

Word-level sign language recognition (WSLR) has attracted attention because it is expected to overcome the communication barrier between people with speech impairment and those who can hear. In the WSLR problem, a method designed for action…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Mizuki Maruyama , Shrey Singh , Katsufumi Inoue , Partha Pratim Roy , Masakazu Iwamura , Michifumi Yoshioka

Sign language visual recognition from continuous multi-modal streams is still one of the most challenging fields. Recent advances in human actions recognition are exploiting the ascension of GPU-based learning from massive data, and are…

Computer Vision and Pattern Recognition · Computer Science 2020-09-23 Bassem Seddik , Najoua Essoukri Ben Amara

Clothed avatar generation has wide applications in virtual and augmented reality, filmmaking, and more. Previous methods have achieved success in generating diverse digital avatars, however, generating avatars with disentangled components…

Computer Vision and Pattern Recognition · Computer Science 2025-09-08 Weitian Zhang , Yichao Yan , Sijing Wu , Manwen Liao , Xiaokang Yang

Sign language, which conveys meaning through gestures, is the chief means of communication among deaf people. Recognizing sign language in natural settings presents significant challenges due to factors such as lighting, background clutter,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Bowen Shi

Speech-driven 3D facial animation has recently garnered attention due to its cost-effective usability in multimedia production. However, most current advances overlook the intelligibility of lip movements, limiting the realism of facial…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Han EunGi , Oh Hyun-Bin , Kim Sung-Bin , Corentin Nivelet Etcheberry , Suekyeong Nam , Janghoon Joo , Tae-Hyun Oh

Recently, text-to-image generation has exhibited remarkable advancements, with the ability to produce visually impressive results. In contrast, text-to-3D generation has not yet reached a comparable level of quality. Existing methods…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Yukang Cao , Yan-Pei Cao , Kai Han , Ying Shan , Kwan-Yee K. Wong

Implicit neural fields, typically encoded by a multilayer perceptron (MLP) that maps from coordinates (e.g., xyz) to signals (e.g., signed distances), have shown remarkable promise as a high-fidelity and compact representation. However, the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Ziya Erkoç , Fangchang Ma , Qi Shan , Matthias Nießner , Angela Dai

Large Language Models (LLMs) have recently garnered significant attention, primarily for their capabilities in text-based interactions. However, natural human interaction often relies on speech, necessitating a shift towards voice-based…

Computation and Language · Computer Science 2025-08-08 Wenqian Cui , Dianzhi Yu , Xiaoqi Jiao , Ziqiao Meng , Guangyan Zhang , Qichao Wang , Yiwen Guo , Irwin King