English
Related papers

Related papers: ShapeEditer: a StyleGAN Encoder for Face Swapping

200 papers

Latent space exploration is a technique that discovers interpretable latent directions and manipulates latent codes to edit various attributes in images generated by generative adversarial networks (GANs). However, in previous work, spatial…

Computer Vision and Pattern Recognition · Computer Science 2022-08-29 Yuki Endo

In this work, we are dedicated to text-guided image generation and propose a novel framework, i.e., CLIP2GAN, by leveraging CLIP model and StyleGAN. The key idea of our CLIP2GAN is to bridge the output feature embedding space of CLIP and…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Yixuan Wang , Wengang Zhou , Jianmin Bao , Weilun Wang , Li Li , Houqiang Li

Face inpainting, the technique of restoring missing or damaged regions in facial images, is pivotal for applications like face recognition in occluded scenarios and image analysis with poor-quality captures. This process not only needs to…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Ahmad Hassanpour , Fatemeh Jamalbafrani , Bian Yang , Kiran Raja , Raymond Veldhuis , Julian Fierrez

Generative Adversarial Networks (GANs) with style-based generators (e.g. StyleGAN) successfully enable semantic control over image synthesis, and recent studies have also revealed that interpretable image translations could be obtained by…

Computer Vision and Pattern Recognition · Computer Science 2020-11-20 Yunfan Liu , Qi Li , Zhenan Sun , Tieniu Tan

State-of-the-art generative models (e.g. StyleGAN3 \cite{karras2021alias}) often generate photorealistic images based on vectors sampled from their latent space. However, the ability to control the output is limited. Here we present our…

Computer Vision and Pattern Recognition · Computer Science 2024-02-28 Róbert Belanec , Peter Lacko , Kristína Malinovská

Creating fine-retouched portrait images is tedious and time-consuming even for professional artists. There exist automatic retouching methods, but they either suffer from over-smoothing artifacts or lack generalization ability. To address…

Computer Vision and Pattern Recognition · Computer Science 2023-12-25 Wanchao Su , Can Wang , Chen Liu , Hangzhou Han , Hongbo Fu , Jing Liao

A style mapper applies some fixed style to its input images (so, for example, taking faces to cartoons). This paper describes a simple procedure -- JoJoGAN -- to learn a style mapper from a single example of the style. JoJoGAN uses a GAN…

Computer Vision and Pattern Recognition · Computer Science 2022-03-08 Min Jin Chong , David Forsyth

We propose an efficient algorithm to embed a given image into the latent space of StyleGAN. This embedding enables semantic image editing operations that can be applied to existing photographs. Taking the StyleGAN trained on the FFHQ…

Computer Vision and Pattern Recognition · Computer Science 2019-09-05 Rameen Abdal , Yipeng Qin , Peter Wonka

We introduce a highly robust GAN-based framework for digitizing a normalized 3D avatar of a person from a single unconstrained photo. While the input image can be of a smiling person or taken in extreme lighting conditions, our method can…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Huiwen Luo , Koki Nagano , Han-Wei Kung , Mclean Goldwhite , Qingguo Xu , Zejian Wang , Lingyu Wei , Liwen Hu , Hao Li

A master face is a face image that passes face-based identity authentication for a high percentage of the population. These faces can be used to impersonate, with a high probability of success, any user, without having access to any user…

Cryptography and Security · Computer Science 2022-11-29 Tomer Friedlander , Ron Shmelkin , Lior Wolf

There are five features to consider when using generative adversarial networks to apply makeup to photos of the human face. These features include (1) facial components, (2) interactive color adjustments, (3) makeup variations, (4)…

Computer Vision and Pattern Recognition · Computer Science 2020-09-25 Daichi Horita , Kiyoharu Aizawa

Facial image manipulation is a generation task where the output face is shifted towards an intended target direction in terms of facial attribute and styles. Recent works have achieved great success in various editing techniques such as…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Ricard Durall , Jireh Jam , Dominik Strassel , Moi Hoon Yap , Janis Keuper

Facial attribute editing aims to manipulate single or multiple attributes of a face image, i.e., to generate a new face with desired attributes while preserving other details. Recently, generative adversarial net (GAN) and encoder-decoder…

Computer Vision and Pattern Recognition · Computer Science 2018-07-26 Zhenliang He , Wangmeng Zuo , Meina Kan , Shiguang Shan , Xilin Chen

Semantic face editing of real world facial images is an important application of generative models. Recently, multiple works have explored possible techniques to generate such modifications using the latent structure of pre-trained GAN…

Computer Vision and Pattern Recognition · Computer Science 2021-09-01 Ravi Kiran Reddy , Kumar Shubham , Gopalakrishnan Venkatesh , Sriram Gandikota , Sarthak Khoche , Dinesh Babu Jayagopi , Gopalakrishnan Srinivasaraghavan

We propose a new approach for editing face images, which enables numerous exciting applications including face relighting, makeup transfer and face detail editing. Our face edits are based on a visual representation, which includes…

Computer Vision and Pattern Recognition · Computer Science 2016-12-05 Jiajun Lu , Kalyan Sunkavalli , Nathan Carr , Sunil Hadap , David Forsyth

We present a novel high-resolution face swapping method using the inherent prior knowledge of a pre-trained GAN model. Although previous research can leverage generative priors to produce high-resolution results, their quality can suffer…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Yangyang Xu , Bailin Deng , Junle Wang , Yanqing Jing , Jia Pan , Shengfeng He

Recent studies on face attribute editing by exemplars have achieved promising results due to the increasing power of deep convolutional networks and generative adversarial networks. These methods encode attribute-related information in…

Computer Vision and Pattern Recognition · Computer Science 2020-01-01 Jingtao Guo , Zhenzhen Qian , Zuowei Zhou , Yi Liu

To enable realistic shape (e.g. pose and expression) transfer, existing face reenactment methods rely on a set of target faces for learning subject-specific traits. However, in real-world scenario end-users often only have one target face…

Computer Vision and Pattern Recognition · Computer Science 2019-08-12 Yunxuan Zhang , Siwei Zhang , Yue He , Cheng Li , Chen Change Loy , Ziwei Liu

We present Face Swapping GAN (FSGAN) for face swapping and reenactment. Unlike previous work, we offer a subject agnostic swapping scheme that can be applied to pairs of faces without requiring training on those faces. We derive a novel…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Yuval Nirkin , Yosi Keller , Tal Hassner

The existing methods for audio-driven talking head video editing have the limitations of poor visual effects. This paper tries to tackle this problem through editing talking face images seamless with different emotions based on two modules:…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Jiacheng Su , Kunhong Liu , Liyan Chen , Junfeng Yao , Qingsong Liu , Dongdong Lv