English
Related papers

Related papers: JoJoGAN: One Shot Face Stylization

200 papers

While recent research has progressively overcome the low-resolution constraint of one-shot face video re-enactment with the help of StyleGAN's high-fidelity portrait generation, these approaches rely on at least one of the following:…

Computer Vision and Pattern Recognition · Computer Science 2023-02-16 Trevine Oorloff , Yaser Yacoob

Generative Adversarial Networks (GANs) have made a dramatic leap in high-fidelity image synthesis and stylized face generation. Recently, a layer-swapping mechanism has been developed to improve the stylization performance. However, this…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Mingcong Liu , Qiang Li , Zekui Qin , Guoxin Zhang , Pengfei Wan , Wen Zheng

This paper studies the problem of StyleGAN inversion, which plays an essential role in enabling the pretrained StyleGAN to be used for real image editing tasks. The goal of StyleGAN inversion is to find the exact latent code of the given…

Computer Vision and Pattern Recognition · Computer Science 2022-05-11 Tianyi Wei , Dongdong Chen , Wenbo Zhou , Jing Liao , Weiming Zhang , Lu Yuan , Gang Hua , Nenghai Yu

Numerous attempts have been made to the task of person-agnostic face swapping given its wide applications. While existing methods mostly rely on tedious network and loss designs, they still struggle in the information balancing between the…

Computer Vision and Pattern Recognition · Computer Science 2022-09-28 Zhiliang Xu , Hang Zhou , Zhibin Hong , Ziwei Liu , Jiaming Liu , Zhizhi Guo , Junyu Han , Jingtuo Liu , Errui Ding , Jingdong Wang

The image synthesis technique is relatively well established which can generate facial images that are indistinguishable even by human beings. However, all of these approaches uses gradients to condition the output, resulting in the…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Feng Liu , HanYang Wang , Jiahao Zhang , Ziwang Fu , Aimin Zhou , Jiayin Qi , Zhibin Li

StyleGAN's disentangled style representation enables powerful image editing by manipulating the latent variables, but accurately mapping real-world images to their latent variables (GAN inversion) remains a challenge. Existing GAN inversion…

Computer Vision and Pattern Recognition · Computer Science 2023-04-28 Anand Bhattad , Viraj Shah , Derek Hoiem , D. A. Forsyth

Many recent works have been proposed for face image editing by leveraging the latent space of pretrained GANs. However, few attempts have been made to directly apply them to videos, because 1) they do not guarantee temporal consistency, 2)…

Computer Vision and Pattern Recognition · Computer Science 2022-06-28 Jiyang Yu , Jingen Liu , Jing Huang , Wei Zhang , Tao Mei

Recent inversion methods have shown that real images can be inverted into StyleGAN's latent space and numerous edits can be achieved on those images thanks to the semantically rich feature representations of well-trained GAN models.…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Ahmet Burak Yildirim , Hamza Pehlivan , Bahri Batuhan Bilecen , Aysegul Dundar

Deep generative models like StyleGAN hold the promise of semantic image editing: modifying images by their content, rather than their pixel values. Unfortunately, working with arbitrary images requires inverting the StyleGAN generator,…

Computer Vision and Pattern Recognition · Computer Science 2022-05-16 Yohan Poirier-Ginter , Alexandre Lessard , Ryan Smith , Jean-François Lalonde

In this paper, we propose a novel framework to translate a portrait photo-face into an anime appearance. Our aim is to synthesize anime-faces which are style-consistent with a given reference anime-face. However, unlike typical translation…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Bing Li , Yuanlue Zhu , Yitong Wang , Chia-Wen Lin , Bernard Ghanem , Linlin Shen

StyleGAN2 is a state-of-the-art network in generating realistic images. Besides, it was explicitly trained to have disentangled directions in latent space, which allows efficient image manipulation by varying latent factors. Editing…

Computer Vision and Pattern Recognition · Computer Science 2020-10-23 Yuri Viazovetskyi , Vladimir Ivashkin , Evgeny Kashin

There are many recent research efforts to fine-tune a pre-trained generator with a few target images to generate images of a novel domain. Unfortunately, these methods often suffer from overfitting or under-fitting when fine-tuned with a…

Computer Vision and Pattern Recognition · Computer Science 2023-01-31 Gihyun Kwon , Jong Chul Ye

Recent advances in face manipulation using StyleGAN have produced impressive results. However, StyleGAN is inherently limited to cropped aligned faces at a fixed image resolution it is pre-trained on. In this paper, we propose a simple and…

Computer Vision and Pattern Recognition · Computer Science 2023-07-24 Shuai Yang , Liming Jiang , Ziwei Liu , Chen Change Loy

We present a caricature generation framework based on shape and style manipulation using StyleGAN. Our framework, dubbed StyleCariGAN, automatically creates a realistic and detailed caricature from an input photo with optional controls on…

Computer Vision and Pattern Recognition · Computer Science 2021-07-12 Wonjong Jang , Gwangjin Ju , Yucheol Jung , Jiaolong Yang , Xin Tong , Seungyong Lee

The task of age transformation illustrates the change of an individual's appearance over time. Accurately modeling this complex transformation over an input facial image is extremely challenging as it requires making convincing, possibly…

Computer Vision and Pattern Recognition · Computer Science 2021-05-19 Yuval Alaluf , Or Patashnik , Daniel Cohen-Or

We present a novel face swapping method using the progressively growing structure of a pre-trained StyleGAN. Previous methods use different encoder decoder structures, embedding integration networks to produce high-quality results, but…

Computer Vision and Pattern Recognition · Computer Science 2023-10-20 Aravinda Reddy PN , K. Sreenivasa Rao , Raghavendra Ramachandra , Pabitra mitra

This paper tackles text-guided control of StyleGAN for editing garments in full-body human images. Existing StyleGAN-based methods suffer from handling the rich diversity of garments and body shapes and poses. We propose a framework for…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Takato Yoshikawa , Yuki Endo , Yoshihiro Kanamori

Recent research has witnessed advances in facial image editing tasks including face swapping and face reenactment. However, these methods are confined to dealing with one specific task at a time. In addition, for video facial editing,…

Computer Vision and Pattern Recognition · Computer Science 2021-08-21 Meng Cao , Haozhi Huang , Hao Wang , Xuan Wang , Li Shen , Sheng Wang , Linchao Bao , Zhifeng Li , Jiebo Luo

Generative Adversarial Networks (GANs) have achieved state-of-the-art performance for several image generation and manipulation tasks. Different works have improved the limited understanding of the latent space of GANs by embedding images…

Computer Vision and Pattern Recognition · Computer Science 2020-10-22 Christian Bartz , Joseph Bethge , Haojin Yang , Christoph Meinel

This paper describes a new model which generates images in novel poses e.g. by altering face expression and orientation, from just a few instances of a human subject. Unlike previous approaches which require large datasets of a specific…

Computer Vision and Pattern Recognition · Computer Science 2020-04-21 Andrei-Timotei Ardelean , Lucian Mircea Sasu