English
Related papers

Related papers: Third Time's the Charm? Image and Video Editing wi…

200 papers

Text-to-image synthesis has recently seen significant progress thanks to large pretrained language models, large-scale training data, and the introduction of scalable model families such as diffusion and autoregressive models. However, the…

Machine Learning · Computer Science 2023-01-24 Axel Sauer , Tero Karras , Samuli Laine , Andreas Geiger , Timo Aila

GAN inversion aims at inverting given images into corresponding latent codes for Generative Adversarial Networks (GANs), especially StyleGAN where exists a disentangled latent space that allows attribute-based image manipulation at latent…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Chenyi Zhuang , Pan Gao , Aljosa Smolic

In this paper, we perform an in-depth study of the properties and applications of aligned generative models. We refer to two models as aligned if they share the same architecture, and one of them (the child) is obtained from the other (the…

Computer Vision and Pattern Recognition · Computer Science 2022-05-06 Zongze Wu , Yotam Nitzan , Eli Shechtman , Dani Lischinski

Unconditional human image generation is an important task in vision and graphics, which enables various applications in the creative industry. Existing studies in this field mainly focus on "network engineering" such as designing new…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Jianglin Fu , Shikai Li , Yuming Jiang , Kwan-Yee Lin , Chen Qian , Chen Change Loy , Wayne Wu , Ziwei Liu

Generative Adversarial Networks (GANs) with style-based generators (e.g. StyleGAN) successfully enable semantic control over image synthesis, and recent studies have also revealed that interpretable image translations could be obtained by…

Computer Vision and Pattern Recognition · Computer Science 2020-11-20 Yunfan Liu , Qi Li , Zhenan Sun , Tieniu Tan

The inversion of real images into StyleGAN's latent space is a well-studied problem. Nevertheless, applying existing approaches to real-world scenarios remains an open challenge, due to an inherent trade-off between reconstruction and…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Yuval Alaluf , Omer Tov , Ron Mokady , Rinon Gal , Amit H. Bermano

StyleGAN is a state-of-art generative adversarial network architecture that generates random 2D high-quality synthetic facial data samples. In this paper, we recap the StyleGAN architecture and training methodology and present our…

Neural and Evolutionary Computing · Computer Science 2020-03-25 Viktor Varkarakis , Shabab Bazrafkan , Peter Corcoran

Pixel-level fine-grained image editing remains an open challenge. Previous works fail to achieve an ideal trade-off between control granularity and inference speed. They either fail to achieve pixel-level fine-grained control, or their…

Computer Vision and Pattern Recognition · Computer Science 2024-07-29 Pengxiang Cai , Zhiwei Liu , Guibo Zhu , Yunfang Niu , Jinqiao Wang

High quality facial image editing is a challenging problem in the movie post-production industry, requiring a high degree of control and identity preservation. Previous works that attempt to tackle this problem may suffer from the…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Xu Yao , Alasdair Newson , Yann Gousseau , Pierre Hellier

Generative adversarial networks (GANs) synthesize realistic images from random latent vectors. Although manipulating the latent vectors controls the synthesized outputs, editing real images with GANs suffers from i) time-consuming…

Computer Vision and Pattern Recognition · Computer Science 2021-06-24 Hyunsu Kim , Yunjey Choi , Junho Kim , Sungjoo Yoo , Youngjung Uh

Recently, the power of unconditional image synthesis has significantly advanced through the use of Generative Adversarial Networks (GANs). The task of inverting an image into its corresponding latent code of the trained GAN is of utmost…

Computer Vision and Pattern Recognition · Computer Science 2021-08-25 Yuval Alaluf , Or Patashnik , Daniel Cohen-Or

Over the years, 2D GANs have achieved great successes in photorealistic portrait generation. However, they lack 3D understanding in the generation process, thus they suffer from multi-view inconsistency problem. To alleviate the issue, many…

Computer Vision and Pattern Recognition · Computer Science 2022-07-27 Jeong-gi Kwak , Yuanming Li , Dongsik Yoon , Donghyeon Kim , David Han , Hanseok Ko

Recent advances in face manipulation using StyleGAN have produced impressive results. However, StyleGAN is inherently limited to cropped aligned faces at a fixed image resolution it is pre-trained on. In this paper, we propose a simple and…

Computer Vision and Pattern Recognition · Computer Science 2023-07-24 Shuai Yang , Liming Jiang , Ziwei Liu , Chen Change Loy

Real-world image manipulation has achieved fantastic progress in recent years as a result of the exploration and utilization of GAN latent spaces. GAN inversion is the first step in this pipeline, which aims to map the real image to the…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Tan M. Dinh , Anh Tuan Tran , Rang Nguyen , Binh-Son Hua

While recent research has progressively overcome the low-resolution constraint of one-shot face video re-enactment with the help of StyleGAN's high-fidelity portrait generation, these approaches rely on at least one of the following:…

Computer Vision and Pattern Recognition · Computer Science 2023-02-16 Trevine Oorloff , Yaser Yacoob

Generation of photo-realistic images, semantic editing and representation learning are a few of many potential applications of high resolution generative models. Recent progress in GANs have established them as an excellent choice for such…

Computer Vision and Pattern Recognition · Computer Science 2021-12-13 Partha Ghosh , Dominik Zietlow , Michael J. Black , Larry S. Davis , Xiaochen Hu

Image synthesis via Generative Adversarial Networks (GANs) of three-dimensional (3D) medical images has great potential that can be extended to many medical applications, such as, image enhancement and disease progression modeling. However,…

Image and Video Processing · Electrical Eng. & Systems 2021-07-22 Sungmin Hong , Razvan Marinescu , Adrian V. Dalca , Anna K. Bonkhoff , Martin Bretzner , Natalia S. Rost , Polina Golland

Image stylization aims at applying a reference style to arbitrary input images. A common scenario is one-shot stylization, where only one example is available for each reference style. Recent approaches for one-shot stylization such as…

Computer Vision and Pattern Recognition · Computer Science 2023-04-24 Viraj Shah , Ayush Sarkar , Sudharsan Krishnakumar Anitha , Svetlana Lazebnik

A promise of Generative Adversarial Networks (GANs) is to provide cheap photorealistic data for training and validating AI models in autonomous driving. Despite their huge success, their performance on complex images featuring multiple…

Computer Vision and Pattern Recognition · Computer Science 2023-05-17 George Eskandar , Youssef Farag , Tarun Yenamandra , Daniel Cremers , Karim Guirguis , Bin Yang

3D-controllable portrait synthesis has significantly advanced, thanks to breakthroughs in generative adversarial networks (GANs). However, it is still challenging to manipulate existing face images with precise 3D control. While…

Computer Vision and Pattern Recognition · Computer Science 2022-08-25 Yuchen Liu , Zhixin Shu , Yijun Li , Zhe Lin , Richard Zhang , S. Y. Kung