English
Related papers

Related papers: Third Time's the Charm? Image and Video Editing wi…

200 papers

The research topic of sketch-to-portrait generation has witnessed a boost of progress with deep learning techniques. The recently proposed StyleGAN architectures achieve state-of-the-art generation ability but the original StyleGAN is not…

Graphics · Computer Science 2022-06-01 Wanchao Su , Hui Ye , Shu-Yu Chen , Lin Gao , Hongbo Fu

In recent years, the use of Generative Adversarial Networks (GANs) has become very popular in generative image modeling. While style-based GAN architectures yield state-of-the-art results in high-fidelity image synthesis, computationally,…

Computer Vision and Pattern Recognition · Computer Science 2021-09-13 Sergei Belousov

The task of manipulating real image attributes through StyleGAN inversion has been extensively researched. This process involves searching latent variables from a well-trained StyleGAN generator that can synthesize a real image, modifying…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Denis Bobkov , Vadim Titov , Aibek Alanov , Dmitry Vetrov

Our goal with this survey is to provide an overview of the state of the art deep learning methods for face generation and editing using StyleGAN. The survey covers the evolution of StyleGAN, from PGGAN to StyleGAN3, and explores relevant…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Andrew Melnik , Maksim Miasayedzenkau , Dzianis Makarovets , Dzianis Pirshtuk , Eren Akbulut , Dennis Holzmann , Tarek Renusch , Gustav Reichert , Helge Ritter

GAN-based image restoration inverts the generative process to repair images corrupted by known degradations. Existing unsupervised methods must be carefully tuned for each task and degradation level. In this work, we make StyleGAN image…

Computer Vision and Pattern Recognition · Computer Science 2023-06-23 Yohan Poirier-Ginter , Jean-François Lalonde

We present an invert-and-edit framework to automatically transform facial weight of an input face image to look thinner or heavier by leveraging semantic facial attributes encoded in the latent space of Generative Adversarial Networks…

Computer Vision and Pattern Recognition · Computer Science 2020-11-06 V N S Rama Krishna Pinnimty , Matt Zhao , Palakorn Achananuparp , Ee-Peng Lim

Recent progress in NeRF-based GANs has introduced a number of approaches for high-resolution and high-fidelity generative modeling of human heads with a possibility for novel view rendering. At the same time, one must solve an inverse…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Ananta R. Bhattarai , Matthias Nießner , Artem Sevastopolsky

Generative Adversarial Networks (GANs) can synthesize realistic images, with the learned latent space shown to encode rich semantic information with various interpretable directions. However, due to the unstructured nature of the learned…

Computer Vision and Pattern Recognition · Computer Science 2023-10-11 Zikun Chen , Han Zhao , Parham Aarabi , Ruowei Jiang

In this work, we are dedicated to text-guided image generation and propose a novel framework, i.e., CLIP2GAN, by leveraging CLIP model and StyleGAN. The key idea of our CLIP2GAN is to bridge the output feature embedding space of CLIP and…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Yixuan Wang , Wengang Zhou , Jianmin Bao , Weilun Wang , Li Li , Houqiang Li

Modern 3D-GANs synthesize geometry and texture by training on large-scale datasets with a consistent structure. Training such models on stylized, artistic data, with often unknown, highly variable geometry, and camera information has not…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Rameen Abdal , Hsin-Ying Lee , Peihao Zhu , Menglei Chai , Aliaksandr Siarohin , Peter Wonka , Sergey Tulyakov

Inspired by the ability of StyleGAN to generate highly realistic images in a variety of domains, much recent work has focused on understanding how to use the latent spaces of StyleGAN to manipulate generated and real images. However,…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Or Patashnik , Zongze Wu , Eli Shechtman , Daniel Cohen-Or , Dani Lischinski

Generative Adversarial Networks (GAN) have been widely investigated for image synthesis based on their powerful representation learning ability. In this work, we explore the StyleGAN and its application of synthetic food image generation.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Wenjin Fu , Yue Han , Jiangpeng He , Sriram Baireddy , Mridul Gupta , Fengqing Zhu

Generative Adversarial Networks (GANs) have emerged as powerful tools for high-quality image generation and real image editing by manipulating their latent spaces. Recent advancements in GANs include 3D-aware models such as EG3D, which…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Bahri Batuhan Bilecen , Yigit Yalin , Ning Yu , Aysegul Dundar

Recent studies have shown that StyleGANs provide promising prior models for downstream tasks on image synthesis and editing. However, since the latent codes of StyleGANs are designed to control global styles, it is hard to achieve a…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Yichun Shi , Xiao Yang , Yangyue Wan , Xiaohui Shen

Generative Adversarial Networks (GANs) have achieved state-of-the-art performance for several image generation and manipulation tasks. Different works have improved the limited understanding of the latent space of GANs by embedding images…

Computer Vision and Pattern Recognition · Computer Science 2020-10-22 Christian Bartz , Joseph Bethge , Haojin Yang , Christoph Meinel

The disentanglement of StyleGAN latent space has paved the way for realistic and controllable image editing, but does StyleGAN know anything about temporal motion, as it was only trained on static images? To study the motion features in the…

Computer Vision and Pattern Recognition · Computer Science 2022-04-28 Qiucheng Wu , Yifan Jiang , Junru Wu , Kai Wang , Gong Zhang , Humphrey Shi , Zhangyang Wang , Shiyu Chang

The recent success of text-to-image synthesis has taken the world by storm and captured the general public's imagination. From a technical standpoint, it also marked a drastic change in the favored architecture to design generative image…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Minguk Kang , Jun-Yan Zhu , Richard Zhang , Jaesik Park , Eli Shechtman , Sylvain Paris , Taesung Park

GAN inversion aims to invert a given image back into the latent space of a pretrained GAN model, for the image to be faithfully reconstructed from the inverted code by the generator. As an emerging technique to bridge the real and fake…

Computer Vision and Pattern Recognition · Computer Science 2022-03-24 Weihao Xia , Yulun Zhang , Yujiu Yang , Jing-Hao Xue , Bolei Zhou , Ming-Hsuan Yang

Text-driven image manipulation is developed since the vision-language model (CLIP) has been proposed. Previous work has adopted CLIP to design a text-image consistency-based objective to address this issue. However, these methods require…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Wanfeng Zheng , Qiang Li , Xiaoyan Guo , Pengfei Wan , Zhongyuan Wang

Videos show continuous events, yet most $-$ if not all $-$ video synthesis frameworks treat them discretely in time. In this work, we think of videos of what they should be $-$ time-continuous signals, and extend the paradigm of neural…

Computer Vision and Pattern Recognition · Computer Science 2022-06-02 Ivan Skorokhodov , Sergey Tulyakov , Mohamed Elhoseiny