English
Related papers

Related papers: Unsupervised Panoptic Interpretation of Latent Spa…

200 papers

A promise of Generative Adversarial Networks (GANs) is to provide cheap photorealistic data for training and validating AI models in autonomous driving. Despite their huge success, their performance on complex images featuring multiple…

Computer Vision and Pattern Recognition · Computer Science 2023-05-17 George Eskandar , Youssef Farag , Tarun Yenamandra , Daniel Cremers , Karim Guirguis , Bin Yang

Developing inherently interpretable models for prediction has gained prominence in recent years. A subclass of these models, wherein the interpretable network relies on learning high-level concepts, are valued because of closeness of…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Jayneel Parekh , Quentin Bouniot , Pavlo Mozharovskyi , Alasdair Newson , Florence d'Alché-Buc

The semantically disentangled latent subspace in GAN provides rich interpretable controls in image generation. This paper includes two contributions on semantic latent subspace analysis in the scenario of face generation using StyleGAN2.…

Computer Vision and Pattern Recognition · Computer Science 2022-01-25 Bo Li , Qiulin Wang , Jiquan Pei , Yu Yang , Xiangyang Ji

Although Generative Adversarial Networks (GANs) have made significant progress in face synthesis, there lacks enough understanding of what GANs have learned in the latent representation to map a random code to a photo-realistic image. In…

Computer Vision and Pattern Recognition · Computer Science 2020-10-30 Yujun Shen , Ceyuan Yang , Xiaoou Tang , Bolei Zhou

We present a locality-aware method for interpreting the latent space of wavelet-based Generative Adversarial Networks (GANs), that can well capture the large spatial and spectral variability that is characteristic to satellite imagery. By…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Georgia Kourmouli , Nikos Kostagiolas , Yannis Panagakis , Mihalis A. Nicolaou

In recent years generative models of visual data have made a great progress, and now they are able to produce images of high quality and diversity. In this work we study representations learnt by a GAN generator. First, we show that these…

Computer Vision and Pattern Recognition · Computer Science 2020-06-19 Danil Galeev , Konstantin Sofiiuk , Danila Rukhovich , Mikhail Romanov , Olga Barinova , Anton Konushin

Several research groups have shown that Generative Adversarial Networks (GANs) can generate photo-realistic images in recent years. Using the GANs, a map is created between a latent code and a photo-realistic image. This process can also be…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Andrea Giardina , Soumya Subhra Paria , Adhikari Kaustubh

Many deep generative models are defined as a push-forward of a Gaussian measure by a continuous generator, such as Generative Adversarial Networks (GANs) or Variational Auto-Encoders (VAEs). This work explores the latent space of such deep…

Machine Learning · Computer Science 2023-05-16 Thibaut Issenhuth , Ugo Tanielian , Jérémie Mary , David Picard

The impressive success of style-based GANs (StyleGANs) in high-fidelity image synthesis has motivated research to understand the semantic properties of their latent spaces. In this paper, we approach this problem through a geometric…

Computer Vision and Pattern Recognition · Computer Science 2023-04-27 Jaewoong Choi , Geonho Hwang , Hyunsoo Cho , Myungjoo Kang

Generative adversarial networks (GANs) have been recently applied as a novel emulation technique for large scale structure simulations. Recent results show that GANs can be used as a fast, efficient and computationally cheap emulator for…

Cosmology and Nongalactic Astrophysics · Physics 2021-07-06 Andrius Tamosiunas , Hans A. Winther , Kazuya Koyama , David J. Bacon , Robert C. Nichol , Ben Mawdsley

A large body of recent work has identified transformations in the latent spaces of generative adversarial networks (GANs) that consistently and interpretably transform generated images. But existing techniques for identifying these…

Computer Vision and Pattern Recognition · Computer Science 2021-10-11 Sarah Schwettmann , Evan Hernandez , David Bau , Samuel Klein , Jacob Andreas , Antonio Torralba

As recent generative models can generate photo-realistic images, people seek to understand the mechanism behind the generation process. Interpretable generation process is beneficial to various image editing applications. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2020-12-01 Yu-Ding Lu , Hsin-Ying Lee , Hung-Yu Tseng , Ming-Hsuan Yang

In recent years, considerable advancements have been made in the area of Generative Adversarial Networks (GANs), particularly with the advent of style-based architectures that address many key shortcomings - both in terms of modeling…

Computer Vision and Pattern Recognition · Computer Science 2022-08-04 Nikos Kostagiolas , Mihalis A. Nicolaou , Yannis Panagakis

Generative Adversarial Networks (GANs) have recently achieved impressive results for many real-world applications, and many GAN variants have emerged with improvements in sample quality and training stability. However, they have not been…

Computer Vision and Pattern Recognition · Computer Science 2018-12-11 David Bau , Jun-Yan Zhu , Hendrik Strobelt , Bolei Zhou , Joshua B. Tenenbaum , William T. Freeman , Antonio Torralba

In this paper, we introduce Random Path Generative Adversarial Network (RPGAN) -- an alternative design of GANs that can serve as a tool for generative model analysis. While the latent space of a typical GAN consists of input vectors,…

Computer Vision and Pattern Recognition · Computer Science 2020-02-19 Andrey Voynov , Artem Babenko

Generative adversarial networks (GANs) can now generate photo-realistic images. However, how to best control the image content remains an open challenge. We introduce LatentKeypointGAN, a two-stage GAN internally conditioned on a set of…

Computer Vision and Pattern Recognition · Computer Science 2023-06-10 Xingzhe He , Bastian Wandt , Helge Rhodin

Deep generative models have shown immense potential in generating unseen data that has properties of real data. These models learn complex data-generating distributions starting from a smaller set of latent dimensions. However, generative…

Solar and Stellar Astrophysics · Physics 2026-02-23 Subhamoy Chatterjee , Andres Munoz-Jaramillo , Anna Malanushenko

As the success of Generative Adversarial Networks (GANs) on natural images quickly propels them into various real-life applications across different domains, it becomes more and more important to clearly understand their limitations.…

Machine Learning · Computer Science 2020-12-21 Mahyar Khayatkhoei , Ahmed Elgammal

Learning useful representations of complex data has been the subject of extensive research for many years. With the diffusion of Deep Neural Networks, Variational Autoencoders have gained lots of attention since they provide an explicit…

Machine Learning · Computer Science 2020-09-15 Marco Maggipinto , Matteo Terzi , Gian Antonio Susto

Vector quantization is common in deep models, yet its hard assignments block gradients and hinder end-to-end training. We propose DiVeQ, which treats quantization as adding an error vector that mimics the quantization distortion, keeping…

Machine Learning · Computer Science 2026-05-27 Mohammad Hassan Vali , Tom Bäckström , Arno Solin