English
Related papers

Related papers: Designing an Encoder for StyleGAN Image Manipulati…

200 papers

Image inpainting is an old problem in computer vision that restores occluded regions and completes damaged images. In the case of facial image inpainting, most of the methods generate only one result for each masked image, even though there…

Computer Vision and Pattern Recognition · Computer Science 2023-01-23 Dongsik Yoon , Jeong-gi Kwak , Yuanming Li , David Han , Hanseok Ko

3D-controllable portrait synthesis has significantly advanced, thanks to breakthroughs in generative adversarial networks (GANs). However, it is still challenging to manipulate existing face images with precise 3D control. While…

Computer Vision and Pattern Recognition · Computer Science 2022-08-25 Yuchen Liu , Zhixin Shu , Yijun Li , Zhe Lin , Richard Zhang , S. Y. Kung

Generative models have made significant progress in the tasks of modeling complex data distributions such as natural images. The introduction of Generative Adversarial Networks (GANs) and auto-encoders lead to the possibility of training on…

Computer Vision and Pattern Recognition · Computer Science 2018-03-29 Tobias Hinz , Stefan Wermter

Unpaired image-to-image translation using Generative Adversarial Networks (GAN) is successful in converting images among multiple domains. Moreover, recent studies have shown a way to diversify the outputs of the generator. However, since…

Computer Vision and Pattern Recognition · Computer Science 2021-07-15 Sho Inoue , Tad Gonsalves

The semantically disentangled latent subspace in GAN provides rich interpretable controls in image generation. This paper includes two contributions on semantic latent subspace analysis in the scenario of face generation using StyleGAN2.…

Computer Vision and Pattern Recognition · Computer Science 2022-01-25 Bo Li , Qiulin Wang , Jiquan Pei , Yu Yang , Xiangyang Ji

Generating human portraits is a hot topic in the image generation area, e.g. mask-to-face generation and text-to-face generation. However, these unimodal generation methods lack controllability in image generation. Controllability can be…

Computer Vision and Pattern Recognition · Computer Science 2024-09-18 Debin Meng , Christos Tzelepis , Ioannis Patras , Georgios Tzimiropoulos

Generative models make huge progress to the photorealistic image synthesis in recent years. To enable human to steer the image generation process and customize the output, many works explore the interpretable dimensions of the latent space…

Computer Vision and Pattern Recognition · Computer Science 2024-01-11 Jianyuan Wang , Lalit Bhagat , Ceyuan Yang , Yinghao Xu , Yujun Shen , Hongdong Li , Bolei Zhou

Generative Adversarial Networks (GANs) have achieved state-of-the-art performance for several image generation and manipulation tasks. Different works have improved the limited understanding of the latent space of GANs by embedding images…

Computer Vision and Pattern Recognition · Computer Science 2020-10-22 Christian Bartz , Joseph Bethge , Haojin Yang , Christoph Meinel

Generative Adversarial Networks (GANs) can synthesize abundant photo-realistic synthetic aperture radar (SAR) images. Some recent GANs (e.g., InfoGAN), are even able to edit specific properties of the synthesized images by introducing…

Computer Vision and Pattern Recognition · Computer Science 2022-05-27 Zhenpeng Feng , Milos Dakovic , Hongbing Ji , Mingzhe Zhu , Ljubisa Stankovic

We explore and analyze the latent style space of StyleGAN2, a state-of-the-art architecture for image generation, using models pretrained on several different datasets. We first show that StyleSpace, the space of channel-wise style…

Computer Vision and Pattern Recognition · Computer Science 2020-12-04 Zongze Wu , Dani Lischinski , Eli Shechtman

Text-to-image synthesis has recently seen significant progress thanks to large pretrained language models, large-scale training data, and the introduction of scalable model families such as diffusion and autoregressive models. However, the…

Machine Learning · Computer Science 2023-01-24 Axel Sauer , Tero Karras , Samuli Laine , Andreas Geiger , Timo Aila

The Swapping Autoencoder achieved state-of-the-art performance in deep image manipulation and image-to-image translation. We improve this work by introducing a simple yet effective auxiliary module based on gradient reversal layers. The…

Computer Vision and Pattern Recognition · Computer Science 2022-08-25 Shima Shahfar , Charalambos Poullis

Generative Adversarial Networks (GANs) can synthesize realistic images, with the learned latent space shown to encode rich semantic information with various interpretable directions. However, due to the unstructured nature of the learned…

Computer Vision and Pattern Recognition · Computer Science 2023-10-11 Zikun Chen , Han Zhao , Parham Aarabi , Ruowei Jiang

We propose Image2StyleGAN++, a flexible image editing framework with many applications. Our framework extends the recent Image2StyleGAN in three ways. First, we introduce noise optimization as a complement to the $W^+$ latent space…

Computer Vision and Pattern Recognition · Computer Science 2020-08-10 Rameen Abdal , Yipeng Qin , Peter Wonka

Text-to-image generation intends to automatically produce a photo-realistic image, conditioned on a textual description. It can be potentially employed in the field of art creation, data augmentation, photo-editing, etc. Although many…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Zhenxing Zhang , Lambert Schomaker

Generative adversarial networks (GANs) have proven to be surprisingly efficient for image editing by inverting and manipulating the latent code corresponding to an input real image. This editing property emerges from the disentangled nature…

Computer Vision and Pattern Recognition · Computer Science 2022-07-01 Mustafa Shukor , Xu Yao , Bharath Bushan Damodaran , Pierre Hellier

Deep generative models provide powerful tools for distributions over complicated manifolds, such as those of natural images. But many of these methods, including generative adversarial networks (GANs), can be difficult to train, in part…

Machine Learning · Statistics 2017-11-08 Akash Srivastava , Lazar Valkov , Chris Russell , Michael U. Gutmann , Charles Sutton

With the advantages of fast inference and human-friendly flexible manipulation, image-agnostic style manipulation via text guidance enables new applications that were not previously available. The state-of-the-art text-guided image-agnostic…

Computer Vision and Pattern Recognition · Computer Science 2023-02-28 Yoonjeon Kim , Hyunsu Kim , Junho Kim , Yunjey Choi , Eunho Yang

We propose in this paper a new paradigm for facial video compression. We leverage the generative capacity of GANs such as StyleGAN to represent and compress a video, including intra and inter compression. Each frame is inverted in the…

Image and Video Processing · Electrical Eng. & Systems 2022-07-14 Mustafa Shukor , Bharath Bhushan Damodaran , Xu Yao , Pierre Hellier

We propose Styleformer, which is a style-based generator for GAN architecture, but a convolution-free transformer-based generator. In our paper, we explain how a transformer can generate high-quality images, overcoming the disadvantage that…

Computer Vision and Pattern Recognition · Computer Science 2022-04-06 Jeeseung Park , Younggeun Kim