English
Related papers

Related papers: ShapeEditer: a StyleGAN Encoder for Face Swapping

200 papers

This paper describes a new technique for finding disentangled semantic directions in the latent space of StyleGAN. Our method identifies meaningful orthogonal subspaces that allow editing of one human face attribute, while minimizing…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Chen Naveh , Yacov Hel-Or

High-level manipulation of facial expressions in images --- such as changing a smile to a neutral expression --- is challenging because facial expression changes are highly non-linear, and vary depending on the appearance of the face. We…

Computer Vision and Pattern Recognition · Computer Science 2016-12-01 Raymond Yeh , Ziwei Liu , Dan B Goldman , Aseem Agarwala

Image inpainting is an old problem in computer vision that restores occluded regions and completes damaged images. In the case of facial image inpainting, most of the methods generate only one result for each masked image, even though there…

Computer Vision and Pattern Recognition · Computer Science 2023-01-23 Dongsik Yoon , Jeong-gi Kwak , Yuanming Li , David Han , Hanseok Ko

Encoder-decoder based architecture has been widely used in the generator of generative adversarial networks for facial manipulation. However, we observe that the current architecture fails to recover the input image color, rich facial…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Arbish Akram , Nazar Khan

Recent face generation methods have tried to synthesize faces based on the given contour condition, like a low-resolution image or sketch. However, the problem of identity ambiguity remains unsolved, which usually occurs when the contour is…

Computer Vision and Pattern Recognition · Computer Science 2022-08-03 Qingyan Bai , Weihao Xia , Fei Yin , Yujiu Yang

We present a novel paradigm for high-fidelity face swapping that faithfully preserves the desired subtle geometry and texture details. We rethink face swapping from the perspective of fine-grained face editing, \textit{i.e., ``editing for…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Zhian Liu , Maomao Li , Yong Zhang , Cairong Wang , Qi Zhang , Jue Wang , Yongwei Nie

The accelerated proliferation of visual content and the rapid development of machine vision technologies bring significant challenges in delivering visual data on a gigantic scale, which shall be effectively represented to satisfy both…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Qi Mao , Chongyu Wang , Meng Wang , Shiqi Wang , Ruijie Chen , Libiao Jin , Siwei Ma

Real-world image manipulation has achieved fantastic progress in recent years as a result of the exploration and utilization of GAN latent spaces. GAN inversion is the first step in this pipeline, which aims to map the real image to the…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Tan M. Dinh , Anh Tuan Tran , Rang Nguyen , Binh-Son Hua

We propose LatentSwap, a simple face swapping framework generating a face swap latent code of a given generator. Utilizing randomly sampled latent codes, our framework is light and does not require datasets besides employing the pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Changho Choi , Minho Kim , Junhyeok Lee , Hyoung-Kyu Song , Younggeun Kim , Seungryong Kim

Recent advances in the field of generative models and in particular generative adversarial networks (GANs) have lead to substantial progress for controlled image editing, especially compared with the pre-deep learning era. Despite their…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Gwilherm Lesné , Yann Gousseau , Saïd Ladjal , Alasdair Newson

Recently, a surge of face editing techniques have been proposed to employ the pretrained StyleGAN for semantic manipulation. To successfully edit a real image, one must first convert the input image into StyleGAN's latent variables.…

Computer Vision and Pattern Recognition · Computer Science 2022-04-28 Yin Yu , Ghasedi Kamran , Wu HsiangTao , Yang Jiaolong , Tong Xi , Fu Yun

Although significant progress has been made in synthesizing high-quality and visually realistic face images by unconditional Generative Adversarial Networks (GANs), there still lacks of control over the generation process in order to…

Computer Vision and Pattern Recognition · Computer Science 2020-12-23 Xianxu Hou , Xiaokang Zhang , Linlin Shen , Zhihui Lai , Jun Wan

We present NeRFEditor, an efficient learning framework for 3D scene editing, which takes a video captured over 360{\deg} as input and outputs a high-quality, identity-preserving stylized 3D scene. Our method supports diverse types of…

Computer Vision and Pattern Recognition · Computer Science 2022-12-09 Chunyi Sun , Yanbin Liu , Junlin Han , Stephen Gould

We make the distinction between (i) style transfer, in which a source image is manipulated to match the textures and colors of a target image, and (ii) essence transfer, in which one edits the source image to include high-level semantic…

Computer Vision and Pattern Recognition · Computer Science 2022-10-12 Hila Chefer , Sagie Benaim , Roni Paiss , Lior Wolf

Face swapping aims at injecting a source image's identity (i.e., facial features) into a target image, while strictly preserving the target's attributes, which are irrelevant to identity. However, we observed that previous approaches still…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Jaeseong Lee , Taewoo Kim , Sunghyun Park , Younggun Lee , Jaegul Choo

Face swapping has gained significant attention for its varied applications. Most previous face swapping approaches have relied on the seesaw game training scheme, also known as the target-oriented approach. However, this often leads to…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Jaeseong Lee , Junha Hyung , Sohyun Jeong , Jaegul Choo

Face attribute editing aims to generate faces with one or multiple desired face attributes manipulated while other details are preserved. Unlike prior works such as GAN inversion, which has an expensive reverse mapping process, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2021-02-24 Zhiliang Xu , Xiyu Yu , Zhibin Hong , Zhen Zhu , Junyu Han , Jingtuo Liu , Errui Ding , Xiang Bai

The latent code of the recent popular model StyleGAN has learned disentangled representations thanks to the multi-layer style-based generator. Embedding a given image back to the latent space of StyleGAN enables wide interesting semantic…

Computer Vision and Pattern Recognition · Computer Science 2020-07-06 Shanyan Guan , Ying Tai , Bingbing Ni , Feida Zhu , Feiyue Huang , Xiaokang Yang

We present an algorithm for re-rendering a person from a single image under arbitrary poses. Existing methods often have difficulties in hallucinating occluded contents photo-realistically while preserving the identity and fine details in…

Computer Vision and Pattern Recognition · Computer Science 2021-09-14 Badour AlBahar , Jingwan Lu , Jimei Yang , Zhixin Shu , Eli Shechtman , Jia-Bin Huang

Recent research has witnessed advances in facial image editing tasks including face swapping and face reenactment. However, these methods are confined to dealing with one specific task at a time. In addition, for video facial editing,…

Computer Vision and Pattern Recognition · Computer Science 2021-08-21 Meng Cao , Haozhi Huang , Hao Wang , Xuan Wang , Li Shen , Sheng Wang , Linchao Bao , Zhifeng Li , Jiebo Luo