English
Related papers

Related papers: Designing a 3D-Aware StyleNeRF Encoder for Face Ed…

200 papers

Generative adversarial networks (GANs) have been successfully applied to transfer visual attributes in many domains, including that of human face images. This success is partly attributable to the facts that human faces have similar shapes…

Computer Vision and Pattern Recognition · Computer Science 2020-10-13 Lei Luo , William Hsu , Shangxian Wang

Face reenactment methods attempt to restore and re-animate portrait videos as realistically as possible. Existing methods face a dilemma in quality versus controllability: 2D GAN-based methods achieve higher image quality but suffer in…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Lizhen Wang , Xiaochen Zhao , Jingxiang Sun , Yuxiang Zhang , Hongwen Zhang , Tao Yu , Yebin Liu

Despite the rapid advance of 3D-aware image synthesis, existing studies usually adopt a mixture of techniques and tricks, leaving it unclear how each part contributes to the final performance in terms of generality. Following the most…

Computer Vision and Pattern Recognition · Computer Science 2023-06-22 Qiuyu Wang , Zifan Shi , Kecheng Zheng , Yinghao Xu , Sida Peng , Yujun Shen

Understating and controlling generative models' latent space is a complex task. In this paper, we propose a novel method for learning to control any desired attribute in a pre-trained GAN's latent space, for the purpose of editing…

Computer Vision and Pattern Recognition · Computer Science 2021-11-18 Nir Diamant , Nitsan Sandor , Alex M Bronstein

Generative Neural Radiance Fields (NeRFs) have demonstrated remarkable proficiency in synthesizing multi-view images by learning the distribution of a set of unposed images. Despite the aptitude of existing generative NeRFs in generating…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Kanghyeok Ko , Minhyeok Lee

Recent advances in generative adversarial networks (GANs) have led to remarkable achievements in face image synthesis. While methods that use style-based GANs can generate strikingly photorealistic face images, it is often difficult to…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Safa C. Medin , Bernhard Egger , Anoop Cherian , Ye Wang , Joshua B. Tenenbaum , Xiaoming Liu , Tim K. Marks

Recent advances in face manipulation using StyleGAN have produced impressive results. However, StyleGAN is inherently limited to cropped aligned faces at a fixed image resolution it is pre-trained on. In this paper, we propose a simple and…

Computer Vision and Pattern Recognition · Computer Science 2023-07-24 Shuai Yang , Liming Jiang , Ziwei Liu , Chen Change Loy

Image inpainting seeks a semantically consistent way to recover the corrupted image in the light of its unmasked content. Previous approaches usually reuse the well-trained GAN as effective prior to generate realistic patches for missing…

Computer Vision and Pattern Recognition · Computer Science 2022-08-26 Yongsheng Yu , Libo Zhang , Heng Fan , Tiejian Luo

Recently, the power of unconditional image synthesis has significantly advanced through the use of Generative Adversarial Networks (GANs). The task of inverting an image into its corresponding latent code of the trained GAN is of utmost…

Computer Vision and Pattern Recognition · Computer Science 2021-08-25 Yuval Alaluf , Or Patashnik , Daniel Cohen-Or

We propose GazeNeRF, a 3D-aware method for the task of gaze redirection. Existing gaze redirection methods operate on 2D images and struggle to generate 3D consistent results. Instead, we build on the intuition that the face region and…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Alessandro Ruzzi , Xiangwei Shi , Xi Wang , Gengyan Li , Shalini De Mello , Hyung Jin Chang , Xucong Zhang , Otmar Hilliges

Impressive progress in generative models and implicit representations gave rise to methods that can generate 3D shapes of high quality. However, being able to locally control and edit shapes is another essential property that can unlock…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Konstantinos Tertikas , Despoina Paschalidou , Boxiao Pan , Jeong Joon Park , Mikaela Angelina Uy , Ioannis Emiris , Yannis Avrithis , Leonidas Guibas

Text-to-3D-aware face (T3D Face) generation and manipulation is an emerging research hot spot in machine learning, which still suffers from low efficiency and poor quality. In this paper, we propose an End-to-End Efficient and Effective…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Jinlu Zhang , Yiyi Zhou , Qiancheng Zheng , Xiaoxiong Du , Gen Luo , Jun Peng , Xiaoshuai Sun , Rongrong Ji

In this paper, we present FaceTuneGAN, a new 3D face model representation decomposing and encoding separately facial identity and facial expression. We propose a first adaptation of image-to-image translation networks, that have…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Nicolas Olivier , Kelian Baert , Fabien Danieau , Franck Multon , Quentin Avril

Numerous attempts have been made to the task of person-agnostic face swapping given its wide applications. While existing methods mostly rely on tedious network and loss designs, they still struggle in the information balancing between the…

Computer Vision and Pattern Recognition · Computer Science 2022-09-28 Zhiliang Xu , Hang Zhou , Zhibin Hong , Ziwei Liu , Jiaming Liu , Zhizhi Guo , Junyu Han , Jingtuo Liu , Errui Ding , Jingdong Wang

GAN-based image editing task aims at manipulating image attributes in the latent space of generative models. Most of the previous 2D and 3D-aware approaches mainly focus on editing attributes in images with ambiguous semantics or regions…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Zhijun Zhai , Zengmao Wang , Xiaoxiao Long , Kaixuan Zhou , Bo Du

3D-aware image generative modeling aims to generate 3D-consistent images with explicitly controllable camera poses. Recent works have shown promising results by training neural radiance field (NeRF) generators on unstructured 2D images, but…

Computer Vision and Pattern Recognition · Computer Science 2022-08-24 Yu Deng , Jiaolong Yang , Jianfeng Xiang , Xin Tong

Despite the significant success in image-to-image translation and latent representation based facial attribute editing and expression synthesis, the existing approaches still have limitations in the sharpness of details, distinct image…

Computer Vision and Pattern Recognition · Computer Science 2018-12-27 WenTing Chen , Xinpeng Xie , Xi Jia , Linlin Shen

3D facial avatar reconstruction has been a significant research topic in computer graphics and computer vision, where photo-realistic rendering and flexible controls over poses and expressions are necessary for many related applications.…

Computer Vision and Pattern Recognition · Computer Science 2023-07-10 Wangbo Yu , Yanbo Fan , Yong Zhang , Xuan Wang , Fei Yin , Yunpeng Bai , Yan-Pei Cao , Ying Shan , Yang Wu , Zhongqian Sun , Baoyuan Wu

We introduce the GANformer, a novel and efficient type of transformer, and explore it for the task of visual generative modeling. The network employs a bipartite structure that enables long-range interactions across the image, while…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Drew A. Hudson , C. Lawrence Zitnick

Since it is difficult to collect face images of the same subject over a long range of age span, most existing face aging methods resort to unpaired datasets to learn age mappings. However, the matching ambiguity between young and aged face…

Computer Vision and Pattern Recognition · Computer Science 2019-04-16 Yunfan Liu , Qi Li , Zhenan Sun