English
Related papers

Related papers: Designing a 3D-Aware StyleNeRF Encoder for Face Ed…

200 papers

We address the challenging problem of generating facial attributes using a single image in an unconstrained pose. In contrast to prior works that largely consider generation on 2D near-frontal images, we propose a GAN-based framework to…

Computer Vision and Pattern Recognition · Computer Science 2019-07-25 Feng-Ju Chang , Xiang Yu , Ram Nevatia , Manmohan Chandraker

NeRF's high-quality scene synthesis capability was quickly accepted by scholars in the years after it was proposed, and significant progress has been made in 3D scene representation and synthesis. However, the high computational cost limits…

Computer Vision and Pattern Recognition · Computer Science 2024-01-24 Shun Fang , Ming Cui , Xing Feng , Yanan Zhang

Real-world image manipulation has achieved fantastic progress in recent years. GAN inversion, which aims to map the real image to the latent code faithfully, is the first step in this pipeline. However, existing GAN inversion methods fail…

Computer Vision and Pattern Recognition · Computer Science 2023-05-19 Bangrui Jiang , Zhenhua Guo , Yujiu Yang

Although Generative Adversarial Networks (GANs) have made significant progress in face synthesis, there lacks enough understanding of what GANs have learned in the latent representation to map a random code to a photo-realistic image. In…

Computer Vision and Pattern Recognition · Computer Science 2020-10-30 Yujun Shen , Ceyuan Yang , Xiaoou Tang , Bolei Zhou

The recent advancements in image-text diffusion models have stimulated research interest in large-scale 3D generative models. Nevertheless, the limited availability of diverse 3D resources presents significant challenges to learning. In…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Chi Zhang , Yiwen Chen , Yijun Fu , Zhenglin Zhou , Gang YU , Billzb Wang , Bin Fu , Tao Chen , Guosheng Lin , Chunhua Shen

The style-based GAN (StyleGAN) architecture achieved state-of-the-art results for generating high-quality images, but it lacks explicit and precise control over camera poses. The recently proposed NeRF-based GANs made great progress towards…

Computer Vision and Pattern Recognition · Computer Science 2021-10-20 Peng Zhou , Lingxi Xie , Bingbing Ni , Qi Tian

Face swapping aims to generate swapped images that fuse the identity of source faces and the attributes of target faces. Most existing works address this challenging task through 3D modelling or generation using generative adversarial…

Computer Vision and Pattern Recognition · Computer Science 2023-04-06 Kaiwen Cui , Rongliang Wu , Fangneng Zhan , Shijian Lu

Recent research has demonstrated that the combination of pretrained diffusion models with neural radiance fields (NeRFs) has emerged as a promising approach for text-to-3D generation. Simply coupling NeRF with diffusion models will result…

Computer Vision and Pattern Recognition · Computer Science 2023-06-19 Lu Yu , Wei Xiang , Kang Han

While current face animation methods can manipulate expressions individually, they suffer from several limitations. The expressions manipulated by some motion-based facial reenactment models are crude. Other ideas modeled with facial action…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Tianxiang Ma , Bingchuan Li , Qian He , Jing Dong , Tieniu Tan

Generative models have shown great promise in synthesizing photorealistic 3D objects, but they require large amounts of training data. We introduce SinGRAF, a 3D-aware generative model that is trained with a few input images of a single…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Minjung Son , Jeong Joon Park , Leonidas Guibas , Gordon Wetzstein

Recent advances in convolutional neural networks have shown promising results in 3D shape completion. But due to GPU memory limitations, these methods can only produce low-resolution outputs. To inpaint 3D models with semantic plausibility…

Computer Vision and Pattern Recognition · Computer Science 2017-11-20 Weiyue Wang , Qiangui Huang , Suya You , Chao Yang , Ulrich Neumann

Recent work has shown that a variety of semantics emerge in the latent space of Generative Adversarial Networks (GANs) when being trained to synthesize images. However, it is difficult to use these learned semantics for real image editing.…

Computer Vision and Pattern Recognition · Computer Science 2020-07-17 Jiapeng Zhu , Yujun Shen , Deli Zhao , Bolei Zhou

Recent work has shown the ability to learn generative models for 3D shapes from only unstructured 2D images. However, training such models requires differentiating through the rasterization step of the rendering process, therefore past work…

Computer Vision and Pattern Recognition · Computer Science 2020-03-02 Sebastian Lunz , Yingzhen Li , Andrew Fitzgibbon , Nate Kushman

In this paper, we address the challenging problem of 3D toonification, which involves transferring the style of an artistic domain onto a target 3D face with stylized geometry and texture. Although fine-tuning a pre-trained 3D GAN on the…

Computer Vision and Pattern Recognition · Computer Science 2023-09-11 Junzhe Zhang , Yushi Lan , Shuai Yang , Fangzhou Hong , Quan Wang , Chai Kiat Yeo , Ziwei Liu , Chen Change Loy

Image inpainting is an old problem in computer vision that restores occluded regions and completes damaged images. In the case of facial image inpainting, most of the methods generate only one result for each masked image, even though there…

Computer Vision and Pattern Recognition · Computer Science 2023-01-23 Dongsik Yoon , Jeong-gi Kwak , Yuanming Li , David Han , Hanseok Ko

Style transfer describes the rendering of an image semantic content as different artistic styles. Recently, generative adversarial networks (GANs) have emerged as an effective approach in style transfer by adversarially training the…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Xinyuan Chen , Chang Xu , Xiaokang Yang , Li Song , Dacheng Tao

This paper proposes a novel approach to face swapping from the perspective of fine-grained facial editing, dubbed "editing for swapping" (E4S). The traditional face swapping methods rely on global feature extraction and fail to preserve the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Maomao Li , Ge Yuan , Cairong Wang , Zhian Liu , Yong Zhang , Yongwei Nie , Jue Wang , Dong Xu

Though GAN (Generative Adversarial Networks) based technique has greatly advanced the performance of image synthesis and face translation, only few works available in literature provide region based style encoding and translation. We…

Computer Vision and Pattern Recognition · Computer Science 2020-07-30 Wenshuang Liu , Wenting Chen , Linlin Shen

This work introduced a novel GAN architecture for unsupervised image translation on the task of face style transform. A spectral attention-based mechanism is embedded into the design along with spatial attention on the image contents. We…

Computer Vision and Pattern Recognition · Computer Science 2021-10-07 Qizhou Wang , Maksim Makarenko

We propose LatentSwap, a simple face swapping framework generating a face swap latent code of a given generator. Utilizing randomly sampled latent codes, our framework is light and does not require datasets besides employing the pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Changho Choi , Minho Kim , Junhyeok Lee , Hyoung-Kyu Song , Younggeun Kim , Seungryong Kim