English
Related papers

Related papers: AniPortraitGAN: Animatable 3D Portrait Generation …

200 papers

Recent work has shown generative adversarial networks (GANs) can generate highly realistic images, that are often indistinguishable (by humans) from real images. Most images so generated are not contained in the training dataset, suggesting…

Computer Vision and Pattern Recognition · Computer Science 2020-08-11 Miaoyun Zhao , Yulai Cong , Lawrence Carin

Creating 3D head avatars is a significant yet challenging task for many applicated scenarios. Previous studies have set out to learn 3D human head generative models using massive 2D image data. Although these models are highly generalizable…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Yiyu Zhuang , Yuxiao He , Jiawei Zhang , Yanwen Wang , Jiahe Zhu , Yao Yao , Siyu Zhu , Xun Cao , Hao Zhu

This paper addresses the challenge of reconstructing an animatable human model from a multi-view video. Some recent works have proposed to decompose a non-rigidly deforming scene into a canonical neural radiance field and a set of…

Computer Vision and Pattern Recognition · Computer Science 2023-05-05 Sida Peng , Zhen Xu , Junting Dong , Qianqian Wang , Shangzhan Zhang , Qing Shuai , Hujun Bao , Xiaowei Zhou

Photo-realistic re-rendering of a human from a single image with explicit control over body pose, shape and appearance enables a wide range of applications, such as human appearance transfer, virtual try-on, motion imitation, and novel view…

Computer Vision and Pattern Recognition · Computer Science 2021-02-23 Kripasindhu Sarkar , Vladislav Golyanik , Lingjie Liu , Christian Theobalt

2D portrait animation has experienced significant advancements in recent years. Much research has utilized the prior knowledge embedded in large generative diffusion models to enhance high-quality image manipulation. However, most methods…

Computer Vision and Pattern Recognition · Computer Science 2025-01-16 Xinya Ji , Gaspard Zoss , Prashanth Chandran , Lingchen Yang , Xun Cao , Barbara Solenthaler , Derek Bradley

Generating and manipulating human facial images using high-level attributal controls are important and interesting problems. The models proposed in previous work can solve one of these two problems (generation or manipulation), but not both…

Computer Vision and Pattern Recognition · Computer Science 2017-04-10 Weidong Yin , Yanwei Fu , Leonid Sigal , Xiangyang Xue

In the past several decades, many attempts have been made to model synthetic realistic geometric data. The goal of such models is to generate plausible 3D geometries and textures. Perhaps the best known of its kind is the linear 3D…

Computational Geometry · Computer Science 2018-08-28 Ron Slossberg , Gil Shamai , Ron Kimmel

In this work, we introduce a novel high-fidelity 3D head reconstruction method from a single portrait image, regardless of perspective, expression, or accessories. Despite significant efforts in adapting 2D generative models for novel view…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Jianfu Zhang , Yujie Gao , Jiahui Zhan , Wentao Wang , Yiyi Zhang , Haohua Zhao , Liqing Zhang

In this paper, we introduce GaussianMotion, a novel human rendering model that generates fully animatable scenes aligned with textual descriptions using Gaussian Splatting. Although existing methods achieve reasonable text-to-3D generation…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Gyumin Shim , Sangmin Lee , Jaegul Choo

This work studies training generative adversarial networks under the federated learning setting. Generative adversarial networks (GANs) have achieved advancement in various real-world applications, such as image editing, style transfer,…

Machine Learning · Computer Science 2020-07-21 Chenyou Fan , Ping Liu

Generative models have made significant progress in the tasks of modeling complex data distributions such as natural images. The introduction of Generative Adversarial Networks (GANs) and auto-encoders lead to the possibility of training on…

Computer Vision and Pattern Recognition · Computer Science 2018-03-29 Tobias Hinz , Stefan Wermter

We introduce PortraitGen, a powerful portrait video editing method that achieves consistent and expressive stylization with multimodal prompts. Traditional portrait video editing methods often struggle with 3D and temporal consistency, and…

Computer Vision and Pattern Recognition · Computer Science 2024-09-23 Xuan Gao , Haiyao Xiao , Chenglai Zhong , Shimin Hu , Yudong Guo , Juyong Zhang

The last few years have witnessed the great success of non-linear generative models in synthesizing high-quality photorealistic face images. Many recent 3D facial texture reconstruction and pose manipulation from a single image approaches…

Computer Vision and Pattern Recognition · Computer Science 2022-03-28 Baris Gecer , Jiankang Deng , Stefanos Zafeiriou

Generative Adversarial Networks (GAN) have led to the generation of very realistic face images, which have been used in fake social media accounts and other disinformation matters that can generate profound impacts. Therefore, the…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Xin Wang , Hui Guo , Shu Hu , Ming-Ching Chang , Siwei Lyu

We have witnessed rapid progress on 3D-aware image synthesis, leveraging recent advances in generative visual models and neural rendering. Existing approaches however fall short in two ways: first, they may lack an underlying 3D…

Computer Vision and Pattern Recognition · Computer Science 2021-04-07 Eric R. Chan , Marco Monteiro , Petr Kellnhofer , Jiajun Wu , Gordon Wetzstein

Over recent years, diffusion models have facilitated significant advancements in video generation. Yet, the creation of face-related videos still confronts issues such as low facial fidelity, lack of frame consistency, limited editability…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Linze Li , Sunqi Fan , Hengjun Pu , Zhaodong Bing , Yao Tang , Tianzhu Ye , Tong Yang , Liangyu Chen , Jiajun Liang

Previous approaches to generate shapes in a 3D setting train a GAN on the latent space of an autoencoder (AE). Even though this produces convincing results, it has two major shortcomings. As the GAN is limited to reproduce the dataset the…

Computer Vision and Pattern Recognition · Computer Science 2021-07-23 Moritz Ibing , Isaak Lim , Leif Kobbelt

We introduce CharacterGAN, a generative model that can be trained on only a few samples (8 - 15) of a given character. Our model generates novel poses based on keypoint locations, which can be modified in real time while providing…

Computer Vision and Pattern Recognition · Computer Science 2022-01-13 Tobias Hinz , Matthew Fisher , Oliver Wang , Eli Shechtman , Stefan Wermter

Despite recent advances in face recognition using deep learning, severe accuracy drops are observed for large pose variations in unconstrained environments. Learning pose-invariant features is one solution, but needs expensively labeled…

Computer Vision and Pattern Recognition · Computer Science 2017-08-21 Xi Yin , Xiang Yu , Kihyuk Sohn , Xiaoming Liu , Manmohan Chandraker

This work introduces a novel system for the generation of images that contain multiple classes of objects. Recent work in Generative Adversarial Networks have produced high quality images, but many focus on generating images of a single…

Machine Learning · Computer Science 2019-11-11 Elijah D. Bolluyt , Cristina Comaniciu