English
Related papers

Related papers: StyleSwap: Style-Based Generator Empowers Robust F…

200 papers

There are five features to consider when using generative adversarial networks to apply makeup to photos of the human face. These features include (1) facial components, (2) interactive color adjustments, (3) makeup variations, (4)…

Computer Vision and Pattern Recognition · Computer Science 2020-09-25 Daichi Horita , Kiyoharu Aizawa

Face swapping technology used to create "Deepfakes" has advanced significantly over the past few years and now enables us to create realistic facial manipulations. Current deep learning algorithms to detect deepfakes have shown promising…

Computer Vision and Pattern Recognition · Computer Science 2022-12-07 Anubhav Jain , Nasir Memon , Julian Togelius

Face-swapping models have been drawing attention for their compelling generation quality, but their complex architectures and loss functions often require careful tuning for successful training. We propose a new face-swapping model called…

Computer Vision and Pattern Recognition · Computer Science 2022-05-06 Jiseob Kim , Jihoon Lee , Byoung-Tak Zhang

Interactive facial image manipulation attempts to edit single and multiple face attributes using a photo-realistic face and/or semantic mask as input. In the absence of the photo-realistic image (only sketch/mask available), previous…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Yan Yang , Md Zakir Hossain , Tom Gedeon , Shafin Rahman

In this work, we introduce a new approach for face stylization. Despite existing methods achieving impressive results in this task, there is still room for improvement in generating high-quality artistic faces with diverse styles and…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Mengtian Li , Yi Dong , Minxuan Lin , Haibin Huang , Pengfei Wan , Chongyang Ma

One of the main motivations for training high quality image generative models is their potential use as tools for image manipulation. Recently, generative adversarial networks (GANs) have been able to generate images of remarkable quality.…

Computer Vision and Pattern Recognition · Computer Science 2019-07-01 Aviv Gabbay , Yedid Hoshen

This paper proposes a novel approach to face swapping from the perspective of fine-grained facial editing, dubbed "editing for swapping" (E4S). The traditional face swapping methods rely on global feature extraction and fail to preserve the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Maomao Li , Ge Yuan , Cairong Wang , Zhian Liu , Yong Zhang , Yongwei Nie , Jue Wang , Dong Xu

GAN inversion aims at inverting given images into corresponding latent codes for Generative Adversarial Networks (GANs), especially StyleGAN where exists a disentangled latent space that allows attribute-based image manipulation at latent…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Chenyi Zhuang , Pan Gao , Aljosa Smolic

We propose Styleformer, which is a style-based generator for GAN architecture, but a convolution-free transformer-based generator. In our paper, we explain how a transformer can generate high-quality images, overcoming the disadvantage that…

Computer Vision and Pattern Recognition · Computer Science 2022-04-06 Jeeseung Park , Younggeun Kim

This paper presents a novel Region-Aware Face Swapping (RAFSwap) network to achieve identity-consistent harmonious high-resolution face generation in a local-global manner: \textbf{1)} Local Facial Region-Aware (FRA) branch augments local…

Computer Vision and Pattern Recognition · Computer Science 2022-03-21 Chao Xu , Jiangning Zhang , Miao Hua , Qian He , Zili Yi , Yong Liu

This technical report presents a diffusion model based framework for face swapping between two portrait images. The basic framework consists of three components, i.e., IP-Adapter, ControlNet, and Stable Diffusion's inpainting pipeline, for…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Feifei Wang

Existing GAN inversion methods fail to provide latent codes for reliable reconstruction and flexible editing simultaneously. This paper presents a transformer-based image inversion and editing model for pretrained StyleGAN which is not only…

Computer Vision and Pattern Recognition · Computer Science 2022-03-16 Xueqi Hu , Qiusheng Huang , Zhengyi Shi , Siyuan Li , Changxin Gao , Li Sun , Qingli Li

Despite the tantalizing success in a broad of vision tasks, transformers have not yet demonstrated on-par ability as ConvNets in high-resolution image generative modeling. In this paper, we seek to explore using pure transformers to build a…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Bowen Zhang , Shuyang Gu , Bo Zhang , Jianmin Bao , Dong Chen , Fang Wen , Yong Wang , Baining Guo

AI-driven image generation has improved significantly in recent years. Generative adversarial networks (GANs), like StyleGAN, are able to generate high-quality realistic data and have artistic control over the output, as well. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2022-04-19 Mohamed Shawky Sabae , Mohamed Ahmed Dardir , Remonda Talaat Eskarous , Mohamed Ramzy Ebbed

StyleGANs have shown impressive results on data generation and manipulation in recent years, thanks to its disentangled style latent space. A lot of efforts have been made in inverting a pretrained generator, where an encoder is trained ad…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Ligong Han , Sri Harsha Musunuri , Martin Renqiang Min , Ruijiang Gao , Yu Tian , Dimitris Metaxas

Despite recent advances in syncing lip movements with any audio waves, current methods still struggle to balance generation quality and the model's generalization ability. Previous studies either require long-term data for training or…

Computer Vision and Pattern Recognition · Computer Science 2023-05-10 Jiazhi Guan , Zhanwang Zhang , Hang Zhou , Tianshu Hu , Kaisiyuan Wang , Dongliang He , Haocheng Feng , Jingtuo Liu , Errui Ding , Ziwei Liu , Jingdong Wang

Facial image manipulation is a generation task where the output face is shifted towards an intended target direction in terms of facial attribute and styles. Recent works have achieved great success in various editing techniques such as…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Ricard Durall , Jireh Jam , Dominik Strassel , Moi Hoon Yap , Janis Keuper

We propose a method to transfer pose and expression between face images. Given a source and target face portrait, the model produces an output image in which the pose and expression of the source face image are transferred onto the target…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Petr Jahoda , Jan Cech

Recent advances in generative adversarial networks (GANs) have opened up the possibility of generating high-resolution photo-realistic images that were impossible to produce previously. The ability of GANs to sample from high-dimensional…

Computer Vision and Pattern Recognition · Computer Science 2021-10-11 Arthur Conmy , Subhadip Mukherjee , Carola-Bibiane Schönlieb

A master face is a face image that passes face-based identity authentication for a high percentage of the population. These faces can be used to impersonate, with a high probability of success, any user, without having access to any user…

Cryptography and Security · Computer Science 2022-11-29 Tomer Friedlander , Ron Shmelkin , Lior Wolf