English
Related papers

Related papers: AniPortraitGAN: Animatable 3D Portrait Generation …

200 papers

Portrait editing is a popular subject in photo manipulation. The Generative Adversarial Network (GAN) advances the generating of realistic faces and allows more face editing. In this paper, we argue about three issues in existing…

Computer Vision and Pattern Recognition · Computer Science 2019-05-27 Shuyang Gu , Jianmin Bao , Hao Yang , Dong Chen , Fang Wen , Lu Yuan

Generating high fidelity identity-preserving faces with different facial attributes has a wide range of applications. Although a number of generative models have been developed to tackle this problem, there is still much room for further…

Computer Vision and Pattern Recognition · Computer Science 2021-11-08 Dan Ma , Bin Liu , Zhao Kang , Jiayu Zhou , Jianke Zhu , Zenglin Xu

This paper is on face/head reenactment where the goal is to transfer the facial pose (3D head orientation and expression) of a target face to a source face. Previous methods focus on learning embedding networks for identity and pose…

Computer Vision and Pattern Recognition · Computer Science 2022-10-07 Stella Bounareli , Vasileios Argyriou , Georgios Tzimiropoulos

We present a novel approach for generating animatable 3D-aware art avatars from a single image, with controllable facial expressions, head poses, and shoulder movements. Unlike previous reenactment methods, our approach utilizes a…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Shaoxu Li

Talking head video generation aims to produce a synthetic human face video that contains the identity and pose information respectively from a given source image and a driving video.Existing works for this task heavily rely on 2D…

Computer Vision and Pattern Recognition · Computer Science 2022-03-16 Fa-Ting Hong , Longhao Zhang , Li Shen , Dan Xu

Natural images are projections of 3D objects on a 2D image plane. While state-of-the-art 2D generative models like GANs show unprecedented quality in modeling the natural image manifold, it is unclear whether they implicitly capture the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-15 Xingang Pan , Bo Dai , Ziwei Liu , Chen Change Loy , Ping Luo

We propose DiscoFaceGAN, an approach for face image generation of virtual people with disentangled, precisely-controllable latent representations for identity of non-existing people, expression, pose, and illumination. We embed 3D priors…

Computer Vision and Pattern Recognition · Computer Science 2020-09-07 Yu Deng , Jiaolong Yang , Dong Chen , Fang Wen , Xin Tong

While recent 3D-aware generative models have shown photo-realistic image synthesis with multi-view consistency, the synthesized image quality degrades depending on the camera pose (e.g., a face with a blurry and noisy boundary at a side…

Computer Vision and Pattern Recognition · Computer Science 2023-09-20 Kyungmin Jo , Wonjoon Jin , Jaegul Choo , Hyunjoon Lee , Sunghyun Cho

Nerf-based Generative models have shown impressive capacity in generating high-quality images with consistent 3D geometry. Despite successful synthesis of fake identity images randomly sampled from latent space, adopting these models for…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Yu Yin , Kamran Ghasedi , HsiangTao Wu , Jiaolong Yang , Xin Tong , Yun Fu

We present an algorithm that learns a coarse 3D representation of objects from unposed multi-view 2D mask supervision, then uses it to generate detailed mask and image texture. In contrast to existing voxel-based methods for unposed object…

Computer Vision and Pattern Recognition · Computer Science 2021-06-25 Youssef A. Mejjati , Isa Milefchik , Aaron Gokaslan , Oliver Wang , Kwang In Kim , James Tompkin

Generative Adversarial Networks (GANs) are currently the method of choice for generating visual data. Certain GAN architectures and training methods have demonstrated exceptional performance in generating realistic synthetic images (in…

Computer Vision and Pattern Recognition · Computer Science 2019-03-26 Shiyang Cheng , Michael Bronstein , Yuxiang Zhou , Irene Kotsia , Maja Pantic , Stefanos Zafeiriou

This paper aims to introduce 3D Gaussian for efficient, expressive, and editable digital avatar generation. This task faces two major challenges: (1) The unstructured nature of 3D Gaussian makes it incompatible with current generation…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Weitian Zhang , Yichao Yan , Yunhui Liu , Xingdong Sheng , Xiaokang Yang

In this study, we propose AniPortrait, a novel framework for generating high-quality animation driven by audio and a reference portrait image. Our methodology is divided into two stages. Initially, we extract 3D intermediate representations…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Huawei Wei , Zejun Yang , Zhisheng Wang

To detect bias in face recognition networks, it can be useful to probe a network under test using samples in which only specific attributes vary in some controlled way. However, capturing a sufficiently large dataset with specific control…

Computer Vision and Pattern Recognition · Computer Science 2020-12-11 Nataniel Ruiz , Barry-John Theobald , Anurag Ranjan , Ahmed Hussein Abdelaziz , Nicholas Apostoloff

Existing 3D-aware portrait synthesis methods can generate impressive high-quality images while preserving strong 3D consistency. However, most of them cannot support the fine-grained part-level control over synthesized images. Conversely,…

Computer Vision and Pattern Recognition · Computer Science 2024-01-09 Ruiqi Liu , Peng Zheng , Ye Wang , Rui Ma

This paper presents a generic face animator that is able to control the pose and expressions of a given face image. The animation is driven by human interpretable control signals consisting of head pose angles and the Action Unit (AU)…

Computer Vision and Pattern Recognition · Computer Science 2020-01-20 Soumya Tripathy , Juho Kannala , Esa Rahtu

In the recent years, there has been a significant improvement in the quality of samples produced by (deep) generative models such as variational auto-encoders and generative adversarial networks. However, the representation capabilities of…

Image and Video Processing · Electrical Eng. & Systems 2026-03-31 Shady Abu Hussein , Tom Tirer , Raja Giryes

Existing neural rendering-based text-to-3D-portrait generation methods typically make use of human geometry prior and diffusion models to obtain guidance. However, relying solely on geometry information introduces issues such as the Janus…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Yiqian Wu , Hao Xu , Xiangjun Tang , Xien Chen , Siyu Tang , Zhebin Zhang , Chen Li , Xiaogang Jin

Building 3D animatable head avatars from a single image is an important yet challenging problem. Existing methods generally collapse under large camera pose variations, compromising the realism of 3D avatars. In this work, we propose a new…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Shuling Zhao , Dan Xu

We present a new multi-modal face image generation method that converts a text prompt and a visual input, such as a semantic mask or scribble map, into a photo-realistic face image. To do this, we combine the strengths of Generative…

Computer Vision and Pattern Recognition · Computer Science 2024-05-08 Jihyun Kim , Changjae Oh , Hoseok Do , Soohyun Kim , Kwanghoon Sohn