English
Related papers

Related papers: ShapeEditer: a StyleGAN Encoder for Face Swapping

200 papers

This paper presents an innovative approach to achieve face cartoonisation while preserving the original identity and accommodating various poses. Unlike previous methods in this field that relied on conditional-GANs, which posed challenges…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Kushal Jain , Ankith Varun J , Anoop Namboodiri

Face swapping aims to generate swapped images that fuse the identity of source faces and the attributes of target faces. Most existing works address this challenging task through 3D modelling or generation using generative adversarial…

Computer Vision and Pattern Recognition · Computer Science 2023-04-06 Kaiwen Cui , Rongliang Wu , Fangneng Zhan , Shijian Lu

In this paper, we present FaceTuneGAN, a new 3D face model representation decomposing and encoding separately facial identity and facial expression. We propose a first adaptation of image-to-image translation networks, that have…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Nicolas Olivier , Kelian Baert , Fabien Danieau , Franck Multon , Quentin Avril

While recent research has progressively overcome the low-resolution constraint of one-shot face video re-enactment with the help of StyleGAN's high-fidelity portrait generation, these approaches rely on at least one of the following:…

Computer Vision and Pattern Recognition · Computer Science 2023-02-16 Trevine Oorloff , Yaser Yacoob

This paper proposes a novel approach to face swapping from the perspective of fine-grained facial editing, dubbed "editing for swapping" (E4S). The traditional face swapping methods rely on global feature extraction and fail to preserve the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Maomao Li , Ge Yuan , Cairong Wang , Zhian Liu , Yong Zhang , Yongwei Nie , Jue Wang , Dong Xu

Deep conditional generative models are excellent tools for creating high-quality images and editing their attributes. However, training modern generative models from scratch is very expensive and requires large computational resources. In…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Andrzej Bedychaj , Jacek Tabor , Marek Śmieja

Current face reenactment and swapping methods mainly rely on GAN frameworks, but recent focus has shifted to pre-trained diffusion models for their superior generation capabilities. However, training these models is resource-intensive, and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Yue Han , Junwei Zhu , Keke He , Xu Chen , Yanhao Ge , Wei Li , Xiangtai Li , Jiangning Zhang , Chengjie Wang , Yong Liu

In this work, we introduce a new approach for face stylization. Despite existing methods achieving impressive results in this task, there is still room for improvement in generating high-quality artistic faces with diverse styles and…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Mengtian Li , Yi Dong , Minxuan Lin , Haibin Huang , Pengfei Wan , Chongyang Ma

The task of manipulating real image attributes through StyleGAN inversion has been extensively researched. This process involves searching latent variables from a well-trained StyleGAN generator that can synthesize a real image, modifying…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Denis Bobkov , Vadim Titov , Aibek Alanov , Dmitry Vetrov

One-shot talking face generation aims at synthesizing a high-quality talking face video from an arbitrary portrait image, driven by a video or an audio segment. One challenging quality factor is the resolution of the output video: higher…

Computer Vision and Pattern Recognition · Computer Science 2022-03-18 Fei Yin , Yong Zhang , Xiaodong Cun , Mingdeng Cao , Yanbo Fan , Xuan Wang , Qingyan Bai , Baoyuan Wu , Jue Wang , Yujiu Yang

This paper studies the problem of StyleGAN inversion, which plays an essential role in enabling the pretrained StyleGAN to be used for real image editing tasks. The goal of StyleGAN inversion is to find the exact latent code of the given…

Computer Vision and Pattern Recognition · Computer Science 2022-05-11 Tianyi Wei , Dongdong Chen , Wenbo Zhou , Jing Liao , Weiming Zhang , Lu Yuan , Gang Hua , Nenghai Yu

Understating and controlling generative models' latent space is a complex task. In this paper, we propose a novel method for learning to control any desired attribute in a pre-trained GAN's latent space, for the purpose of editing…

Computer Vision and Pattern Recognition · Computer Science 2021-11-18 Nir Diamant , Nitsan Sandor , Alex M Bronstein

Face reenactment methods attempt to restore and re-animate portrait videos as realistically as possible. Existing methods face a dilemma in quality versus controllability: 2D GAN-based methods achieve higher image quality but suffer in…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Lizhen Wang , Xiaochen Zhao , Jingxiang Sun , Yuxiang Zhang , Hongwen Zhang , Tao Yu , Yebin Liu

GAN inversion has been exploited in many face manipulation tasks, but 2D GANs often fail to generate multi-view 3D consistent images. The encoders designed for 2D GANs are not able to provide sufficient 3D information for the inversion and…

Computer Vision and Pattern Recognition · Computer Science 2023-02-21 Songlin Yang , Wei Wang , Bo Peng , Jing Dong

Recent advances in face manipulation using StyleGAN have produced impressive results. However, StyleGAN is inherently limited to cropped aligned faces at a fixed image resolution it is pre-trained on. In this paper, we propose a simple and…

Computer Vision and Pattern Recognition · Computer Science 2023-07-24 Shuai Yang , Liming Jiang , Ziwei Liu , Chen Change Loy

In this paper, we present an integrated system for automatically generating and editing face images through face swapping, attribute-based editing, and random face parts synthesis. The proposed system is based on a deep neural network that…

Computer Vision and Pattern Recognition · Computer Science 2022-07-07 Ryota Natsume , Tatsuya Yatagawa , Shigeo Morishima

Text-to-image diffusion models have remarkably excelled in producing diverse, high-quality, and photo-realistic images. This advancement has spurred a growing interest in incorporating specific identities into generated content. Most…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Xiaoming Li , Xinyu Hou , Chen Change Loy

Arbitrary attribute editing generally can be tackled by incorporating encoder-decoder and generative adversarial networks. However, the bottleneck layer in encoder-decoder usually gives rise to blurry and low quality editing result. And…

Computer Vision and Pattern Recognition · Computer Science 2019-04-24 Ming Liu , Yukang Ding , Min Xia , Xiao Liu , Errui Ding , Wangmeng Zuo , Shilei Wen

Despite recent advances in semantic manipulation using StyleGAN, semantic editing of real faces remains challenging. The gap between the $W$ space and the $W$+ space demands an undesirable trade-off between reconstruction quality and…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Heyi Li , Jinlong Liu , Xinyu Zhang , Yunzhi Bai , Huayan Wang , Klaus Mueller

Our paper addresses the complex task of transferring a hairstyle from a reference image to an input photo for virtual hair try-on. This task is challenging due to the need to adapt to various photo poses, the sensitivity of hairstyles, and…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Maxim Nikolaev , Mikhail Kuznetsov , Dmitry Vetrov , Aibek Alanov