English
Related papers

Related papers: Rethinking Image Skip Connections in StyleGAN2

200 papers

In this work, we are dedicated to text-guided image generation and propose a novel framework, i.e., CLIP2GAN, by leveraging CLIP model and StyleGAN. The key idea of our CLIP2GAN is to bridge the output feature embedding space of CLIP and…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Yixuan Wang , Wengang Zhou , Jianmin Bao , Weilun Wang , Li Li , Houqiang Li

Generative Adversarial Networks (GAN) have been widely investigated for image synthesis based on their powerful representation learning ability. In this work, we explore the StyleGAN and its application of synthetic food image generation.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Wenjin Fu , Yue Han , Jiangpeng He , Sriram Baireddy , Mridul Gupta , Fengqing Zhu

Despite recent success in conditional image synthesis, prevalent input conditions such as semantics and edges are not clear enough to express `Linear (Ridges)' and `Planar (Scale)' representations. To address this problem, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2022-05-16 Gunhee Lee , Jonghwa Yim , Chanran Kim , Minjae Kim

Text-to-image synthesis has recently seen significant progress thanks to large pretrained language models, large-scale training data, and the introduction of scalable model families such as diffusion and autoregressive models. However, the…

Machine Learning · Computer Science 2023-01-24 Axel Sauer , Tero Karras , Samuli Laine , Andreas Geiger , Timo Aila

Image reconstruction and synthesis have witnessed remarkable progress thanks to the development of generative models. Nonetheless, gaps could still exist between the real and generated images, especially in the frequency domain. In this…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Liming Jiang , Bo Dai , Wayne Wu , Chen Change Loy

StyleGAN2 is a state-of-the-art network in generating realistic images. Besides, it was explicitly trained to have disentangled directions in latent space, which allows efficient image manipulation by varying latent factors. Editing…

Computer Vision and Pattern Recognition · Computer Science 2020-10-23 Yuri Viazovetskyi , Vladimir Ivashkin , Evgeny Kashin

Image synthesis via Generative Adversarial Networks (GANs) of three-dimensional (3D) medical images has great potential that can be extended to many medical applications, such as, image enhancement and disease progression modeling. However,…

Image and Video Processing · Electrical Eng. & Systems 2021-07-22 Sungmin Hong , Razvan Marinescu , Adrian V. Dalca , Anna K. Bonkhoff , Martin Bretzner , Natalia S. Rost , Polina Golland

Generative Adversarial Networks (GANs) have established themselves as a prevalent approach to image synthesis. Of these, StyleGAN offers a fascinating case study, owing to its remarkable visual quality and an ability to support a large…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Amit H. Bermano , Rinon Gal , Yuval Alaluf , Ron Mokady , Yotam Nitzan , Omer Tov , Or Patashnik , Daniel Cohen-Or

We propose an efficient algorithm to embed a given image into the latent space of StyleGAN. This embedding enables semantic image editing operations that can be applied to existing photographs. Taking the StyleGAN trained on the FFHQ…

Computer Vision and Pattern Recognition · Computer Science 2019-09-05 Rameen Abdal , Yipeng Qin , Peter Wonka

The style-based GAN architecture (StyleGAN) yields state-of-the-art results in data-driven unconditional generative image modeling. We expose and analyze several of its characteristic artifacts, and propose changes in both model…

Computer Vision and Pattern Recognition · Computer Science 2020-03-25 Tero Karras , Samuli Laine , Miika Aittala , Janne Hellsten , Jaakko Lehtinen , Timo Aila

In modern social networks, existing style transfer methods suffer from a serious content leakage issue, which hampers the ability to achieve serial and reversible stylization, thereby hindering the further propagation of stylized images in…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Xiujian Liang , Bingshan Liu , Qichao Ying , Zhenxing Qian , Xinpeng Zhang

Generative adversarial models (GANs) continue to produce advances in terms of the visual quality of still images, as well as the learning of temporal correlations. However, few works manage to combine these two interesting capabilities for…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Gereon Fox , Ayush Tewari , Mohamed Elgharib , Christian Theobalt

The state-of-the-art StyleGAN2 network supports powerful methods to create and edit art, including generating random images, finding images "like" some query, and modifying content or style. Further, recent advancements enable training with…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Vaibhav Vavilala , David Forsyth

Inspired by the ability of StyleGAN to generate highly realistic images in a variety of domains, much recent work has focused on understanding how to use the latent spaces of StyleGAN to manipulate generated and real images. However,…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Or Patashnik , Zongze Wu , Eli Shechtman , Daniel Cohen-Or , Dani Lischinski

In this paper, we present the result of adopting skip connections and dense layers, previously used in image classification tasks, in the Fisher GAN implementation. We have experimented with different numbers of layers and inserting these…

Computer Vision and Pattern Recognition · Computer Science 2018-11-13 Samarth Tripathi , Renbo Tu

In recent years, the use of Generative Adversarial Networks (GANs) has become very popular in generative image modeling. While style-based GAN architectures yield state-of-the-art results in high-fidelity image synthesis, computationally,…

Computer Vision and Pattern Recognition · Computer Science 2021-09-13 Sergei Belousov

We demonstrate the benefit of using an ultimate skip (US) connection for facial expression synthesis using generative adversarial networks (GAN). A direct connection transfers identity, facial, and color details from input to output while…

Computer Vision and Pattern Recognition · Computer Science 2023-06-13 Arbish Akram , Nazar Khan

We explore and analyze the latent style space of StyleGAN2, a state-of-the-art architecture for image generation, using models pretrained on several different datasets. We first show that StyleSpace, the space of channel-wise style…

Computer Vision and Pattern Recognition · Computer Science 2020-12-04 Zongze Wu , Dani Lischinski , Eli Shechtman

Photo-realistic re-rendering of a human from a single image with explicit control over body pose, shape and appearance enables a wide range of applications, such as human appearance transfer, virtual try-on, motion imitation, and novel view…

Computer Vision and Pattern Recognition · Computer Science 2021-02-23 Kripasindhu Sarkar , Vladislav Golyanik , Lingjie Liu , Christian Theobalt

Existing few-shot image generation approaches typically employ fusion-based strategies, either on the image or the feature level, to produce new images. However, previous approaches struggle to synthesize high-frequency signals with fine…

Computer Vision and Pattern Recognition · Computer Science 2022-08-10 Mengping Yang , Zhe Wang , Ziqiu Chi , Wenyi Feng
‹ Prev 1 2 3 10 Next ›