English
Related papers

Related papers: JoJoGAN: One Shot Face Stylization

200 papers

Millions of images of human faces are captured every single day; but these photographs portray the likeness of an individual with a fixed pose, expression, and appearance. Portrait image animation enables the post-capture adjustment of…

Computer Vision and Pattern Recognition · Computer Science 2022-03-28 Connor Z. Lin , David B. Lindell , Eric R. Chan , Gordon Wetzstein

StyleGAN is arguably one of the most intriguing and well-studied generative models, demonstrating impressive performance in image generation, inversion, and manipulation. In this work, we explore the recent StyleGAN3 architecture, compare…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Yuval Alaluf , Or Patashnik , Zongze Wu , Asif Zamir , Eli Shechtman , Dani Lischinski , Daniel Cohen-Or

Image-based virtual try-on aims to fit an in-shop garment into a clothed person image. To achieve this, a key step is garment warping which spatially aligns the target garment with the corresponding body parts in the person image. Prior…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Sen He , Yi-Zhe Song , Tao Xiang

This paper addresses a challenging problem -- how to generate multi-view cloth images from only a single view input. To generate realistic-looking images with different views from the input, we propose a new image generation model termed…

Computer Vision and Pattern Recognition · Computer Science 2018-02-28 Bo Zhao , Xiao Wu , Zhi-Qi Cheng , Hao Liu , Zequn Jie , Jiashi Feng

We propose KeypointGAN, a new method for recognizing the pose of objects from a single image that for learning uses only unlabelled videos and a weak empirical prior on the object poses. Video frames differ primarily in the pose of the…

Computer Vision and Pattern Recognition · Computer Science 2020-12-24 Tomas Jakab , Ankush Gupta , Hakan Bilen , Andrea Vedaldi

Retrofitting is a technique used to move word vectors closer together or further apart in their space to reflect their relationships in a Knowledge Base (KB). However, retrofitting only works on concepts that are present in that KB.…

Computation and Language · Computer Science 2021-08-31 Pedro Colon-Hernandez , Yida Xin , Henry Lieberman , Catherine Havasi , Cynthia Breazeal , Peter Chin

While generative adversarial networks (GANs) can successfully produce high-quality images, they can be challenging to control. Simplifying GAN-based image generation is critical for their adoption in graphic design and artistic work. This…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Mahmoud Afifi , Marcus A. Brubaker , Michael S. Brown

Training GANs in low-data regimes remains a challenge, as overfitting often leads to memorization or training divergence. In this work, we introduce One-Shot GAN that can learn to generate samples from a training set as little as one image…

Computer Vision and Pattern Recognition · Computer Science 2021-05-13 Vadim Sushko , Juergen Gall , Anna Khoreva

Image synthesis via Generative Adversarial Networks (GANs) of three-dimensional (3D) medical images has great potential that can be extended to many medical applications, such as, image enhancement and disease progression modeling. However,…

Image and Video Processing · Electrical Eng. & Systems 2021-07-22 Sungmin Hong , Razvan Marinescu , Adrian V. Dalca , Anna K. Bonkhoff , Martin Bretzner , Natalia S. Rost , Polina Golland

Generative Adversarial Networks (GAN) have been widely investigated for image synthesis based on their powerful representation learning ability. In this work, we explore the StyleGAN and its application of synthetic food image generation.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Wenjin Fu , Yue Han , Jiangpeng He , Sriram Baireddy , Mridul Gupta , Fengqing Zhu

The ability of Generative Adversarial Networks to encode rich semantics within their latent space has been widely adopted for facial image editing. However, replicating their success with videos has proven challenging. Sets of high-quality…

Computer Vision and Pattern Recognition · Computer Science 2022-01-24 Rotem Tzaban , Ron Mokady , Rinon Gal , Amit H. Bermano , Daniel Cohen-Or

Existing GAN inversion methods fail to provide latent codes for reliable reconstruction and flexible editing simultaneously. This paper presents a transformer-based image inversion and editing model for pretrained StyleGAN which is not only…

Computer Vision and Pattern Recognition · Computer Science 2022-03-16 Xueqi Hu , Qiusheng Huang , Zhengyi Shi , Siyuan Li , Changxin Gao , Li Sun , Qingli Li

StyleGAN is known to produce high-fidelity images, while also offering unprecedented semantic editing. However, these fascinating abilities have been demonstrated only on a limited set of datasets, which are usually structurally aligned and…

Computer Vision and Pattern Recognition · Computer Science 2022-02-25 Ron Mokady , Michal Yarom , Omer Tov , Oran Lang , Daniel Cohen-Or , Tali Dekel , Michal Irani , Inbar Mosseri

Recently, some works have tried to combine diffusion and Generative Adversarial Networks (GANs) to alleviate the computational cost of the iterative denoising inference in Diffusion Models (DMs). However, existing works in this line suffer…

Computer Vision and Pattern Recognition · Computer Science 2025-02-26 Yihong Luo , Xiaolong Chen , Xinghua Qu , Tianyang Hu , Jing Tang

Facial image manipulation is a generation task where the output face is shifted towards an intended target direction in terms of facial attribute and styles. Recent works have achieved great success in various editing techniques such as…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Ricard Durall , Jireh Jam , Dominik Strassel , Moi Hoon Yap , Janis Keuper

Facial recognition systems have made significant strides thanks to data-heavy deep learning models, but these models rely on large privacy-sensitive datasets. Further, many of these datasets lack diversity in terms of ethnicity and…

Computer Vision and Pattern Recognition · Computer Science 2023-09-20 Anubhav Jain , Nasir Memon , Julian Togelius

We present a novel method to solve image analogy problems : it allows to learn the relation between paired images present in training data, and then generalize and generate images that correspond to the relation, but were never seen in the…

Machine Learning · Statistics 2017-09-15 Nikolay Jetchev , Urs Bergmann

Manipulating human facial images between two domains is an important and interesting problem. Most of the existing methods address this issue by applying two generators or one generator with extra conditional inputs. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2020-01-15 X G Tu , Y Luo , H S Zhang , W J Ai , Z Ma , M Xie

We consider the problem of face swapping in images, where an input identity is transformed into a target identity while preserving pose, facial expression, and lighting. To perform this mapping, we use convolutional neural networks trained…

Computer Vision and Pattern Recognition · Computer Science 2017-07-28 Iryna Korshunova , Wenzhe Shi , Joni Dambre , Lucas Theis

Despite the recent success of face image generation with GANs, conditional hair editing remains challenging due to the under-explored complexity of its geometry and appearance. In this paper, we present MichiGAN (Multi-Input-Conditioned…

Computer Vision and Pattern Recognition · Computer Science 2020-11-02 Zhentao Tan , Menglei Chai , Dongdong Chen , Jing Liao , Qi Chu , Lu Yuan , Sergey Tulyakov , Nenghai Yu