English
Related papers

Related papers: Evaluation of Generative Models for Emotional 3D A…

200 papers

Speech-driven 3D facial animation technology has been developed for years, but its practical application still lacks expectations. The main challenges lie in data limitations, lip alignment, and the naturalness of facial expressions.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Xiangyu Liang , Wenlin Zhuang , Tianyong Wang , Guangxing Geng , Guangyue Geng , Haifeng Xia , Siyu Xia

We review human evaluation practices in automatic, speech-driven 3D gesture generation and find a lack of standardisation and frequent use of flawed experimental setups. This leads to a situation where it is impossible to know how different…

Gestures are central to human communication, enriching interactions through non-verbal expression. Virtual avatars increasingly use AI-generated gestures to enhance life-likeness, yet evaluations have largely been confined to 2D. Virtual…

Human-Computer Interaction · Computer Science 2025-09-17 Axel Wiebe Werner , Jonas Beskow , Anna Deichler

Generating vivid and emotional 3D co-speech gestures is crucial for virtual avatar animation in human-machine interaction applications. While the existing methods enable generating the gestures to follow a single emotion label, they…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Xingqun Qi , Jiahao Pan , Peng Li , Ruibin Yuan , Xiaowei Chi , Mengfei Li , Wenhan Luo , Wei Xue , Shanghang Zhang , Qifeng Liu , Yike Guo

Human emotion synthesis is a crucial aspect of affective computing. It involves using computational methods to mimic and convey human emotions through various modalities, with the goal of enabling more natural and effective human-computer…

Machine Learning · Computer Science 2024-12-11 Fei Ma , Yukan Li , Yifan Xie , Ying He , Yi Zhang , Hongwei Ren , Zhou Liu , Wei Yao , Fuji Ren , Fei Richard Yu , Shiguang Ni

The creation of virtual humans increasingly leverages automated synthesis of speech and gestures, enabling expressive, adaptable agents that effectively engage users. However, the independent development of voice and gesture generation…

Graphics · Computer Science 2025-07-02 Haoyang Du , Kiran Chhatre , Christopher Peters , Brian Keegan , Rachel McDonnell , Cathy Ennis

Virtual human animations have a wide range of applications in virtual and augmented reality. While automatic generation methods of animated virtual humans have been developed, assessing their quality remains challenging. Recently,…

Graphics · Computer Science 2025-11-17 Rim Rekik , Stefanie Wuhrer , Ludovic Hoyet , Katja Zibrek , Anne-Hélène Olivier

Generative AI systems are increasingly capable of expressing emotions via text and imagery. Effective emotional expression will likely play a major role in the efficacy of AI systems -- particularly those designed to support human mental…

This paper proposes a novel 3D speech-to-animation (STA) generation framework designed to address the shortcomings of existing models in producing diverse and emotionally resonant animations. Current STA models often generate animations…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Xulong Zhang , Xiaoyang Qu , Haoxiang Shi , Chunguang Xiao , Jianzong Wang

Unsupervised generation of clothed virtual humans with various appearance and animatable poses is important for creating 3D human avatars and other AR/VR applications. Existing methods are either limited to rigid object modeling, or not…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Jianfeng Zhang , Zihang Jiang , Dingdong Yang , Hongyi Xu , Yichun Shi , Guoxian Song , Zhongcong Xu , Xinchao Wang , Jiashi Feng

Synthesizing realistic data samples is of great value for both academic and industrial communities. Deep generative models have become an emerging topic in various research areas like computer vision and signal processing. Affective…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Noushin Hajarolasvadi , Miguel Arjona Ramírez , Hasan Demirel

The development of increasingly realistic experimental stimuli and task environments is important for understanding behavior outside the laboratory. We report a process for generating 3D human model stimuli that combines commonly used…

Neurons and Cognition · Quantitative Biology 2016-06-17 Jean M. Vettel , Justin Kantner , Matthew Jaswa , Michael Miller

Human emotions analysis has been the focus of many studies, especially in the field of Affective Computing, and is important for many applications, e.g. human-computer intelligent interaction, stress analysis, interactive games, animations,…

Computer Vision and Pattern Recognition · Computer Science 2020-05-13 Mohammad Rami Koujan , Luma Alharbawee , Giorgos Giannakakis , Nicolas Pugeault , Anastasios Roussos

The capacity to create realistic virtual humans has progressed significantly, and such characters can be found in many applications across entertainment, education and health. As an essential element of interactive virtual humans,…

Graphics · Computer Science 2026-05-12 Haoyang Du , Yinghan Xu , John Dingliana , Brian Keegan , Rachel McDonnell , Cathy Ennis

Affective computing stands at the forefront of artificial intelligence (AI), seeking to imbue machines with the ability to comprehend and respond to human emotions. Central to this field is emotion recognition, which endeavors to identify…

Machine Learning · Computer Science 2024-07-08 Fei Ma , Yucheng Yuan , Yifan Xie , Hongwei Ren , Ivan Liu , Ying He , Fuji Ren , Fei Richard Yu , Shiguang Ni

3D human interaction generation has emerged as a key research area, focusing on producing dynamic and contextually relevant interactions between humans and various interactive entities. Recent rapid advancements in 3D model representation…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Siyuan Fan , Wenke Huang , Xiantao Cai , Bo Du

To be widely adopted, 3D facial avatars must be animated easily, realistically, and directly from speech signals. While the best recent methods generate 3D animations that are synchronized with the input audio, they largely ignore the…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Radek Daněček , Kiran Chhatre , Shashank Tripathi , Yandong Wen , Michael J. Black , Timo Bolkart

Traditional 3D modeling requires technical expertise, specialized software, and time-intensive processes, making it inaccessible for many users. Our research aims to lower these barriers by combining generative AI and augmented reality (AR)…

Graphics · Computer Science 2025-05-01 Majid Behravan , Maryam Haghani , Denis Gracanin

Emotion recognition and generation have emerged as crucial topics in Artificial Intelligence research, playing a significant role in enhancing human-computer interaction within healthcare, customer service, and other fields. Although…

Machine Learning · Computer Science 2025-02-12 Rebecca Mobbs , Dimitrios Makris , Vasileios Argyriou

Photo-realistic and controllable 3D avatars are crucial for various applications such as virtual and mixed reality (VR/MR), telepresence, gaming, and film production. Traditional methods for avatar creation often involve time-consuming…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Keqiang Sun , Amin Jourabloo , Riddhish Bhalodia , Moustafa Meshry , Yu Rong , Zhengyu Yang , Thu Nguyen-Phuoc , Christian Haene , Jiu Xu , Sam Johnson , Hongsheng Li , Sofien Bouaziz
‹ Prev 1 2 3 10 Next ›