English
Related papers

Related papers: Geometrically Enriched Latent Spaces

200 papers

Generative models with both discrete and continuous latent variables are highly motivated by the structure of many real-world data sets. They present, however, subtleties in training often manifesting in the discrete latent being under…

Machine Learning · Statistics 2018-06-13 Benoit Gaujac , Ilya Feige , David Barber

Deep generative models have demonstrated successful applications in learning non-linear data distributions through a number of latent variables and these models use a nonlinear function (generator) to map latent samples into the data space.…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Pourya Shamsolmoali , Masoumeh Zareapoor , Huiyu Zhou , Dacheng Tao , Xuelong Li

While GAN is a powerful model for generating images, its inability to infer a latent space directly limits its use in applications requiring an encoder. Our paper presents a simple architectural setup that combines the generative…

Machine Learning · Computer Science 2020-12-09 Yuri Feigin , Hedva Spitzer , Raja Giryes

Generative adversarial networks (GANs) have proven to be surprisingly efficient for image editing by inverting and manipulating the latent code corresponding to a natural image. This property emerges from the disentangled nature of the…

Computer Vision and Pattern Recognition · Computer Science 2021-07-12 Mustafa Shukor , Xu Yao , Bharath Bhushan Damodaran , Pierre Hellier

There has been a growing interest in statistical inference from data satisfying the so-called manifold hypothesis, assuming data points in the high-dimensional ambient space to lie in close vicinity of a submanifold of much lower dimension.…

Methodology · Statistics 2023-01-04 Rong Tang , Yun Yang

As recent generative models can generate photo-realistic images, people seek to understand the mechanism behind the generation process. Interpretable generation process is beneficial to various image editing applications. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2020-12-01 Yu-Ding Lu , Hsin-Ying Lee , Hung-Yu Tseng , Ming-Hsuan Yang

Recent advances in artificial intelligence have propelled the development of innovative computational materials modeling and design techniques. Generative deep learning models have been used for molecular representation, discovery, and…

Chemical Physics · Physics 2021-02-12 Navid Shervani-Tabar , Nicholas Zabaras

Generative adversarial networks (GANs), a class of distribution-learning methods based on a two-player game between a generator and a discriminator, can generally be formulated as a minmax problem based on the variational representation of…

Machine Learning · Computer Science 2022-06-20 Jeremiah Birrell , Markos A. Katsoulakis , Luc Rey-Bellet , Wei Zhu

Standard formulations of GANs, where a continuous function deforms a connected latent space, have been shown to be misspecified when fitting different classes of images. In particular, the generator will necessarily sample some low-quality…

Machine Learning · Computer Science 2021-10-20 Thibaut Issenhuth , Ugo Tanielian , David Picard , Jeremie Mary

The goal of a generative model is to capture the distribution underlying the data, typically through latent variables. After training, these variables are often used as a new representation, more effective than the original features in a…

Machine Learning · Computer Science 2015-04-29 Maruan Al-Shedivat , Emre Neftci , Gert Cauwenberghs

Recent deep generative models are able to provide photo-realistic images as well as visual or textual content embeddings useful to address various tasks of computer vision and natural language processing. Their usefulness is nevertheless…

Machine Learning · Computer Science 2020-01-29 Antoine Plumerault , Hervé Le Borgne , Céline Hudelot

We propose a novel approach to learning the generative neural fields represented by linear combinations of implicit basis networks. Our algorithm learns basis networks in the form of implicit neural representations and their coefficients in…

Machine Learning · Computer Science 2023-10-31 Tackgeun You , Mijeong Kim , Jungtaek Kim , Bohyung Han

This paper addresses the mode collapse for generative adversarial networks (GANs). We view modes as a geometric structure of data distribution in a metric space. Under this geometric lens, we embed subsamples of the dataset from an…

Machine Learning · Statistics 2019-06-12 Chang Xiao , Peilin Zhong , Changxi Zheng

Learning meaningful abstract models of Markov Decision Processes (MDPs) is crucial for improving generalization from limited data. In this work, we show how geometric priors can be imposed on the low-dimensional representation manifold of a…

Machine Learning · Computer Science 2026-05-20 Thomas Delliaux , Nguyen-Khanh Vu , Vincent François-Lavet , Elise van der Pol , Emmanuel Rachelson

Despite the success of diffusion models (DMs), we still lack a thorough understanding of their latent space. While image editing with GANs builds upon latent space, DMs rely on editing the conditions such as text prompts. We present an…

Computer Vision and Pattern Recognition · Computer Science 2023-02-27 Yong-Hyun Park , Mingi Kwon , Junghyo Jo , Youngjung Uh

Generative adversarial networks (GANs) have shown remarkable success in generation of unstructured data, such as, natural images. However, discovery and separation of modes in the generated space, essential for several tasks beyond naive…

Computer Vision and Pattern Recognition · Computer Science 2019-03-26 Deepak Mishra , Prathosh A. P. , Aravind Jayendran , Varun Srivastava , Santanu Chaudhury

Variational Autoencoder (VAE) and its variations are classic generative models by learning a low-dimensional latent representation to satisfy some prior distribution (e.g., Gaussian distribution). Their advantages over GAN are that they can…

Computer Vision and Pattern Recognition · Computer Science 2020-09-24 Cong Geng , Jia Wang , Li Chen , Zhiyong Gao

This work introduces a geometric framework and a novel network architecture for creating correspondences between samples of different conditions. Under this formalism, the latent space is a fiber bundle stratified into a base space encoding…

Machine Learning · Statistics 2020-12-29 Tariq Daouda , Reda Chhaibi , Prudencio Tossou , Alexandra-Chloé Villani

We develop Riemannian approaches to variational autoencoders (VAEs) for PDE-type ambient data with regularizing geometric latent dynamics, which we refer to as VAE-DLM, or VAEs with dynamical latent manifolds. We redevelop the VAE framework…

Machine Learning · Computer Science 2026-01-21 Andrew Gracyk

Variational autoencoders (VAEs) and generative adversarial networks (GANs) enjoy an intuitive connection to manifold learning: in training the decoder/generator is optimized to approximate a homeomorphism between the data distribution and…

Machine Learning · Computer Science 2020-08-28 Henry Li , Ofir Lindenbaum , Xiuyuan Cheng , Alexander Cloninger