English
Related papers

Related papers: Express4D: Expressive, Friendly, and Extensible 4D…

200 papers

Editing and manipulating facial features in videos is an interesting and important field of research with a plethora of applications, ranging from movie post-production and visual effects to realistic avatars for video games and virtual…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Girish Kumar Solanki , Anastasios Roussos

Language-guided scene-aware human motion generation has great significance for entertainment and robotics. In response to the limitations of existing datasets, we introduce LaserHuman, a pioneering dataset engineered to revolutionize…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Peishan Cong , Ziyi Wang , Zhiyang Dou , Yiming Ren , Wei Yin , Kai Cheng , Yujing Sun , Xiaoxiao Long , Xinge Zhu , Yuexin Ma

Semantic segmentation takes pivotal roles in various applications such as autonomous driving and medical image analysis. When deploying segmentation models in practice, it is critical to test their behaviors in varied and complex scenes in…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Zijin Yin , Bing Li , Kongming Liang , Hao Sun , Zhongjiang He , Zhanyu Ma , Jun Guo

Facial emotion recognition is a vast and complex problem space within the domain of computer vision and thus requires a universally accepted baseline method with which to evaluate proposed models. While test datasets have served this…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Nyle Siddiqui , Rushit Dave , Tyler Bauer , Thomas Reither , Dylan Black , Mitchell Hanson

Generating animal faces using generative AI techniques is challenging because the available training images are limited both in quantity and variation, particularly for facial expressions across individuals. In this study, we focus on…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Takuya Igaue , Catia Correia-Caeiro , Akito Yoshida , Takako Miyabe-Nishiwaki , Ryusuke Hayashi

Facial Expression Recognition is a vital research topic in most fields ranging from artificial intelligence and gaming to Human-Computer Interaction (HCI) and Psychology. This paper proposes a hybrid model for Facial Expression recognition,…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Ozioma Collins Oguine , Kanyifeechukwu Jane Oguine , Hashim Ibrahim Bisallah , Daniel Ofuani

A novel procedure is presented in this paper, for training a deep convolutional and recurrent neural network, taking into account both the available training data set and some information extracted from similar networks trained with other…

Machine Learning · Computer Science 2018-09-13 Dimitrios Kollias , Stefanos Zafeiriou

Audio-driven 3D facial animation has been widely explored, but achieving realistic, human-like performance is still unsolved. This is due to the lack of available 3D datasets, models, and standard evaluation metrics. To address this, we…

Computer Vision and Pattern Recognition · Computer Science 2019-05-09 Daniel Cudeiro , Timo Bolkart , Cassidy Laidlaw , Anurag Ranjan , Michael J. Black

Current facial emotion recognition systems are predominately trained to predict a fixed set of predefined categories or abstract dimensional values. This constrained form of supervision hinders generalization and applicability, as it…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Licai Sun , Xingxun Jiang , Haoyu Chen , Yante Li , Zheng Lian , Biu Liu , Yuan Zong , Wenming Zheng , Jukka M. Leppänen , Guoying Zhao

Recent advances in facial expression synthesis have shown promising results using diverse expression representations including facial action units. Facial action units for an elaborate facial expression synthesis need to be intuitively…

Computer Vision and Pattern Recognition · Computer Science 2020-07-17 Joanna Hong , Jung Uk Kim , Sangmin Lee , Yong Man Ro

Facial expressions are vital in human communication and significantly influence outcomes in human-robot interaction (HRI), such as likeability, trust, and companionship. However, current methods for generating robotic facial expressions are…

Robotics · Computer Science 2025-03-04 Victor Nikhil Antony , Maia Stiber , Chien-Ming Huang

Audio-driven 3D facial animation aims to generate synchronized lip movements and vivid facial expressions from arbitrary audio clips. While existing methods can produce synchronized lip motions, they often rely on predefined identity or…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Xuangeng Chu , Yuan Gan , Ziteng Cui , Shuhong Liu , Jian Wang , Bing Zhou , Tatsuya Harada

The generation of stylistic 3D facial animations driven by speech presents a significant challenge as it requires learning a many-to-many mapping between speech, style, and the corresponding natural facial motion. However, existing methods…

Computer Vision and Pattern Recognition · Computer Science 2024-05-15 Zhiyao Sun , Tian Lv , Sheng Ye , Matthieu Lin , Jenny Sheng , Yu-Hui Wen , Minjing Yu , Yong-Jin Liu

Speech-driven 3D facial animation with accurate lip synchronization has been widely studied. However, synthesizing realistic motions for the entire face during speech has rarely been explored. In this work, we present a joint audio-text…

Computer Vision and Pattern Recognition · Computer Science 2021-12-08 Yingruo Fan , Zhaojiang Lin , Jun Saito , Wenping Wang , Taku Komura

4D facial expression synthesizing is a critical problem in the fields of computer vision and graphics. Current methods lack flexibility and smoothness when simulating the inter-frame motion of expression sequences. In this paper, we propose…

Graphics · Computer Science 2026-03-12 Xin Lu , Chuanqing Zhuang. Zhengda Lu , Yiqun Wang , Jun Xiao

Speech-driven 3D facial animation has attracted increasing interest since its potential to generate expressive and temporally synchronized digital humans. While recent works have begun to explore emotion-aware animation, they still depend…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Xin Lu , Chuanqing Zhuang , Chenxi Jin , Zhengda Lu , Yiqun Wang , Wu Liu , Jun Xiao

Realistic, high-fidelity 3D facial animations are crucial for expressive avatar systems in human-computer interaction and accessibility. Although prior methods show promising quality, their reliance on the mesh domain limits their ability…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Alexandre Symeonidis-Herzig , Özge Mercanoğlu Sincan , Richard Bowden

One-shot talking face generation aims at synthesizing a high-quality talking face video from an arbitrary portrait image, driven by a video or an audio segment. One challenging quality factor is the resolution of the output video: higher…

Computer Vision and Pattern Recognition · Computer Science 2022-03-18 Fei Yin , Yong Zhang , Xiaodong Cun , Mingdeng Cao , Yanbo Fan , Xuan Wang , Qingyan Bai , Baoyuan Wu , Jue Wang , Yujiu Yang

Facial expression is one of the most external indications of a person's feelings and emotions. In daily conversation, according to the psychologist, only 7% and 38% of information is communicated through words and sounds respective, while…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Mengyu Rao , Ruyi Bao , Liangshun Dong

Human emotional expression is inherently dynamic, complex, and fluid, characterized by smooth transitions in intensity throughout verbal communication. However, the modeling of such intensity fluctuations has been largely overlooked by…

Sound · Computer Science 2024-10-01 Jingyi Xu , Hieu Le , Zhixin Shu , Yang Wang , Yi-Hsuan Tsai , Dimitris Samaras