English
Related papers

Related papers: From Continuity to Editability: Inverting GANs wit…

200 papers

Generative Adversarial Networks (GANs) have recently achieved significant improvement on paired/unpaired image-to-image translation, such as photo$\rightarrow$ sketch and artist painting style transfer. However, existing models can only be…

Computer Vision and Pattern Recognition · Computer Science 2017-08-02 Xiaodan Liang , Hao Zhang , Eric P. Xing

Text-to-image synthesis has recently seen significant progress thanks to large pretrained language models, large-scale training data, and the introduction of scalable model families such as diffusion and autoregressive models. However, the…

Machine Learning · Computer Science 2023-01-24 Axel Sauer , Tero Karras , Samuli Laine , Andreas Geiger , Timo Aila

Generative Adversarial Networks (GANs) can synthesize realistic images, with the learned latent space shown to encode rich semantic information with various interpretable directions. However, due to the unstructured nature of the learned…

Computer Vision and Pattern Recognition · Computer Science 2023-10-11 Zikun Chen , Han Zhao , Parham Aarabi , Ruowei Jiang

This paper proposes a novel approach to performing image-to-image translation between unpaired domains. Rather than relying on a cycle constraint, our method takes advantage of collaboration between various GANs. This results in a…

Computer Vision and Pattern Recognition · Computer Science 2020-06-09 Ori Nizan , Ayellet Tal

StyleGAN is arguably one of the most intriguing and well-studied generative models, demonstrating impressive performance in image generation, inversion, and manipulation. In this work, we explore the recent StyleGAN3 architecture, compare…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Yuval Alaluf , Or Patashnik , Zongze Wu , Asif Zamir , Eli Shechtman , Dani Lischinski , Daniel Cohen-Or

We propose a novel ECGAN for the challenging semantic image synthesis task. Although considerable improvement has been achieved, the quality of synthesized images is far from satisfactory due to three largely unresolved challenges. 1) The…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Hao Tang , Xiaojuan Qi , Guolei Sun , Dan Xu , Nicu Sebe , Radu Timofte , Luc Van Gool

In image morphing, a sequence of plausible frames are synthesized and composited together to form a smooth transformation between given instances. Intermediates must remain faithful to the input, stand on their own as members of the set,…

Graphics · Computer Science 2020-05-05 Noa Fish , Richard Zhang , Lilach Perry , Daniel Cohen-Or , Eli Shechtman , Connelly Barnes

We introduce a new architecture called a conditional invertible neural network (cINN), and use it to address the task of diverse image-to-image translation for natural images. This is not easily possible with existing INN models due to some…

Computer Vision and Pattern Recognition · Computer Science 2021-05-06 Lynton Ardizzone , Jakob Kruse , Carsten Lüth , Niels Bracher , Carsten Rother , Ullrich Köthe

Researchers have recently begun exploring the use of StyleGAN-based models for real image editing. One particularly interesting application is using natural language descriptions to guide the editing process. Existing approaches for editing…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Ahmet Canberk Baykal , Abdul Basit Anees , Duygu Ceylan , Erkut Erdem , Aykut Erdem , Deniz Yuret

Existing GAN inversion methods work brilliantly in reconstructing high-quality (HQ) images while struggling with more common low-quality (LQ) inputs in practical application. To address this issue, we propose Unsupervised Domain Adaptation…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Siyu Xing , Chen Gong , Hewei Guo , Xiao-Yu Zhang , Xinwen Hou , Yu Liu

Unsupervised image-to-image translation is the task of translating an image from one domain to another in the absence of any paired training examples and tends to be more applicable to practical applications. Nevertheless, the extension of…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Yang Chen , Yingwei Pan , Ting Yao , Xinmei Tian , Tao Mei

Manipulating human facial images between two domains is an important and interesting problem. Most of the existing methods address this issue by applying two generators or one generator with extra conditional inputs. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2020-01-15 X G Tu , Y Luo , H S Zhang , W J Ai , Z Ma , M Xie

Recent advancements in large-scale text-to-image diffusion models have enabled many applications in image editing. However, none of these methods have been able to edit the layout of single existing images. To address this gap, we propose…

Computer Vision and Pattern Recognition · Computer Science 2023-06-23 Zhiyuan Zhang , Zhitong Huang , Jing Liao

Unpaired image-to-image translation is a class of vision problems whose goal is to find the mapping between different image domains using unpaired training data. Cycle-consistency loss is a widely used constraint for such problems. However,…

Computer Vision and Pattern Recognition · Computer Science 2021-01-19 Yihao Zhao , Ruihai Wu , Hao Dong

Recently image-to-image translation has attracted significant interests in the literature, starting from the successful use of the generative adversarial network (GAN), to the introduction of cyclic constraint, to extensions to multiple…

Computer Vision and Pattern Recognition · Computer Science 2020-01-16 Zengming Shen , S. Kevin Zhou , Yifan Chen , Bogdan Georgescu , Xuqi Liu , Thomas S. Huang

StyleGAN's disentangled style representation enables powerful image editing by manipulating the latent variables, but accurately mapping real-world images to their latent variables (GAN inversion) remains a challenge. Existing GAN inversion…

Computer Vision and Pattern Recognition · Computer Science 2023-04-28 Anand Bhattad , Viraj Shah , Derek Hoiem , D. A. Forsyth

Text-to-image synthesis aims to generate natural images conditioned on text descriptions. The main difficulty of this task lies in effectively fusing text information into the image synthesis process. Existing methods usually adaptively…

Computer Vision and Pattern Recognition · Computer Science 2022-04-25 Senmao Ye , Fei Liu , Minkui Tan

In this paper, we explore a new domain for video-to-video translation. Motivated by the availability of animation movies that are adopted from illustrated books for children, we aim to stylize these videos with the style of the original…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Samet Hicsonmez , Nermin Samet , Fidan Samet , Oguz Bakir , Emre Akbas , Pinar Duygulu

Generative Adversarial Networks (GANs) have been shown to be powerful and flexible priors when solving inverse problems. One challenge of using them is overcoming representation error, the fundamental limitation of the network in…

Machine Learning · Computer Science 2022-04-12 Sean Gunn , Jorio Cocola , Paul Hand

Unsupervised image transfer enables intra- and inter-modality image translation in applications where a large amount of paired training data is not abundant. To ensure a structure-preserving mapping from the input to the target domain,…

Computer Vision and Pattern Recognition · Computer Science 2022-09-05 Christoph Angermann , Markus Haltmeier , Ahsan Raza Siyal