English
Related papers

Related papers: Face Animation with an Attribute-Guided Diffusion …

200 papers

Facial attributes are important since they provide a detailed description and determine the visual appearance of human faces. In this paper, we aim at converting a face image to a sketch while simultaneously generating facial attributes. To…

Computer Vision and Pattern Recognition · Computer Science 2019-08-29 Hao Tang , Xinya Chen , Wei Wang , Dan Xu , Jason J. Corso , Nicu Sebe , Yan Yan

The pose-guided person image generation task requires synthesizing photorealistic images of humans in arbitrary poses. The existing approaches use generative adversarial networks that do not necessarily maintain realistic textures or need…

Computer Vision and Pattern Recognition · Computer Science 2023-03-02 Ankan Kumar Bhunia , Salman Khan , Hisham Cholakkal , Rao Muhammad Anwer , Jorma Laaksonen , Mubarak Shah , Fahad Shahbaz Khan

Audio-driven facial reenactment is a crucial technique that has a range of applications in film-making, virtual avatars and video conferences. Existing works either employ explicit intermediate face representations (e.g., 2D facial…

Computer Vision and Pattern Recognition · Computer Science 2023-06-14 Ricong Huang , Peiwen Lai , Yipeng Qin , Guanbin Li

Diffusion models have achieved remarkable success in image synthesis. However, addressing artifacts and unrealistic regions remains a critical challenge. We propose self-refining diffusion, a novel framework that enhances image generation…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Seoyeon Lee , Gwangyeol Yu , Chaewon Kim , Jonghyuk Park

The automatic generation of diverse and human-like facial reactions in dyadic dialogue remains a critical challenge for human-computer interaction systems. Existing methods fail to model the stochasticity and dynamics inherent in real human…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Luo Cheng , Song Siyang , Yan Siyuan , Yu Zhen , Ge Zongyuan

Face editing methods, essential for tasks like virtual avatars, digital human synthesis and identity preservation, have traditionally been built upon GAN-based techniques, while recent focus has shifted to diffusion-based models due to…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Mengting Wei , Tuomas Varanka , Yante Li , Xingxun Jiang , Huai-Qian Khor , Guoying Zhao

Recent advances in talking face generation have significantly improved facial animation synthesis. However, existing approaches face fundamental limitations: 3DMM-based methods maintain temporal consistency but lack fine-grained regional…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Kangwei Liu , Junwu Liu , Yun Cao , Jinlin Guo , Xiaowei Yi

The success of face recognition (FR) systems has led to serious privacy concerns due to potential unauthorized surveillance and user tracking on social networks. Existing methods for enhancing privacy fail to generate natural face images…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Liqin Wang , Qianyue Hu , Wei Lu , Xiangyang Luo

The performance of facial super-resolution methods relies on their ability to recover facial structures and salient features effectively. Even though the convolutional neural network and generative adversarial network-based methods deliver…

Computer Vision and Pattern Recognition · Computer Science 2021-11-23 Abhishek Srivastava , Sukalpa Chanda , Umapada Pal

Generating high-quality and person-generic visual dubbing remains a challenge. Recent innovation has seen the advent of a two-stage paradigm, decoupling the rendering and lip synchronization process facilitated by intermediate…

Computer Vision and Pattern Recognition · Computer Science 2024-01-15 Tao Liu , Chenpeng Du , Shuai Fan , Feilong Chen , Kai Yu

Portrait editing is a popular subject in photo manipulation. The Generative Adversarial Network (GAN) advances the generating of realistic faces and allows more face editing. In this paper, we argue about three issues in existing…

Computer Vision and Pattern Recognition · Computer Science 2019-05-27 Shuyang Gu , Jianmin Bao , Hao Yang , Dong Chen , Fang Wen , Lu Yuan

In this research work we have proposed high-level ChildDiffusion framework capable of generating photorealistic child facial samples and further embedding several intelligent augmentations on child facial data using short text prompts,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Muhammad Ali Farooq , Wang Yao , Peter Corcoran

Adversarial attacks involve adding perturbations to the source image to cause misclassification by the target model, which demonstrates the potential of attacking face recognition models. Existing adversarial face image generation methods…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Decheng Liu , Xijun Wang , Chunlei Peng , Nannan Wang , Ruiming Hu , Xinbo Gao

Speech-driven 3D facial animation aims to generate realistic lip movements and facial expressions for 3D head models from arbitrary audio clips. Although existing diffusion-based methods are capable of producing natural motions, their slow…

Computer Vision and Pattern Recognition · Computer Science 2025-09-05 Xuangeng Chu , Nabarun Goswami , Ziteng Cui , Hanqin Wang , Tatsuya Harada

Diffusion models have shown promise in forecasting future data from multivariate time series. However, few existing methods account for recurring structures, or patterns, that appear within the data. We present Pattern-Guided Diffusion…

Machine Learning · Computer Science 2025-12-17 Vivian Lin , Kuk Jin Jang , Wenwen Si , Insup Lee

For the last decades, the concern of producing convincing facial animation has garnered great interest, that has only been accelerating with the recent explosion of 3D content in both entertainment and professional activities. The use of…

Graphics · Computer Science 2020-10-13 Eloïse Berson , Catherine Soladié , Nicolas Stoiber

Diffusion models are known for generating high-quality images, causing serious security concerns. To combat this, most efforts rely on deep neural networks (e.g., CNNs and Transformers), while largely overlooking the potential of…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Mengxin Fu , Yuezun Li

The ability to create high-quality 3D faces from a single image has become increasingly important with wide applications in video conferencing, AR/VR, and advanced video editing in movie industries. In this paper, we propose Face Diffusion…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Hao Zhang , Yanbo Xu , Tianyuan Dai , Yu-Wing Tai , Chi-Keung Tang

Deep learning has significantly advanced PET image re-construction, achieving remarkable improvements in image quality through direct training on sinogram or image data. Traditional methods often utilize masks for inpainting tasks, but…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Bin Huang , Binzhong He , Yanhan Chen , Zhili Liu , Xinyue Wang , Binxuan Li , Qiegen Liu

Diffusion models have achieved remarkable success in image and video generation. In this work, we demonstrate that diffusion models can also \textit{generate high-performing neural network parameters}. Our approach is simple, utilizing an…

Machine Learning · Computer Science 2025-01-03 Kai Wang , Dongwen Tang , Boya Zeng , Yida Yin , Zhaopan Xu , Yukun Zhou , Zelin Zang , Trevor Darrell , Zhuang Liu , Yang You