English
Related papers

Related papers: Learning disconnected manifolds: a no GANs land

200 papers

In this paper, we improve Generative Adversarial Networks by incorporating a manifold learning step into the discriminator. We consider locality-constrained linear and subspace-based manifolds, and locality-constrained non-linear manifolds.…

Computer Vision and Pattern Recognition · Computer Science 2022-04-04 Yao Ni , Piotr Koniusz , Richard Hartley , Richard Nock

Most current computer vision datasets are composed of disconnected sets, such as images from different classes. We prove that distributions of this type of data cannot be represented with a continuous generative network without error. They…

Machine Learning · Computer Science 2020-06-26 Lorenzo Luzi , Randall Balestriero , Richard G. Baraniuk

Generative adversarial networks (GANs) can be interpreted as an adversarial game between two players, a discriminator D and a generator G, in which D learns to classify real from fake data and G learns to generate realistic data by…

Machine Learning · Computer Science 2018-09-10 Alexia Jolicoeur-Martineau

Variational autoencoders (VAEs) and generative adversarial networks (GANs) enjoy an intuitive connection to manifold learning: in training the decoder/generator is optimized to approximate a homeomorphism between the data distribution and…

Machine Learning · Computer Science 2020-08-28 Henry Li , Ofir Lindenbaum , Xiuyuan Cheng , Alexander Cloninger

Generative Adversarial Networks (GAN) have received wide attention in the machine learning field for their potential to learn high-dimensional, complex real data distribution. Specifically, they do not rely on any assumptions about the…

Machine Learning · Computer Science 2019-03-01 Yongjun Hong , Uiwon Hwang , Jaeyoon Yoo , Sungroh Yoon

Generative Adversarial Networks (GANs) are susceptible to bias, learned from either the unbalanced data, or through mode collapse. The networks focus on the core of the data distribution, leaving the tails - or the edges of the distribution…

Computer Vision and Pattern Recognition · Computer Science 2022-02-09 Yunzhe Liu , Rinon Gal , Amit H. Bermano , Baoquan Chen , Daniel Cohen-Or

Generative Adversarial Networks (GANs), as a framework for estimating generative models via an adversarial process, have attracted huge attention and have proven to be powerful in a variety of tasks. However, training GANs is well known for…

Machine Learning · Computer Science 2017-11-09 Zi-Yi Dou

This paper raises an implicit manifold learning perspective in Generative Adversarial Networks (GANs), by studying how the support of the learned distribution, modelled as a submanifold $\mathcal{M}_{\theta}$, perfectly match with…

Machine Learning · Statistics 2017-11-01 Kry Yik Chau Lui , Yanshuai Cao , Maxime Gazeau , Kelvin Shuangjian Zhang

Despite the success of Generative Adversarial Networks (GANs), their training suffers from several well-known problems, including mode collapse and difficulties learning a disconnected set of manifolds. In this paper, we break down the…

Machine Learning · Computer Science 2021-06-21 Mohammadreza Armandpour , Ali Sadeghian , Chunyuan Li , Mingyuan Zhou

In the years since Goodfellow et al. introduced Generative Adversarial Networks (GANs), there has been an explosion in the breadth and quality of generative model applications. Despite this work, GANs still have a long way to go before they…

Machine Learning · Computer Science 2020-04-14 Conor Lazarou

The Bayesian inference approach is widely used to tackle inverse problems due to its versatile and natural ability to handle ill-posedness. However, it often faces challenges when dealing with situations involving continuous fields or…

Numerical Analysis · Mathematics 2023-08-28 Xinchao Jiang , Xin Wang , Ziming Wen , Hu Wang

A new generative adversarial network is developed for joint distribution matching. Distinct from most existing approaches, that only learn conditional distributions, the proposed model aims to learn a joint distribution of multiple random…

Machine Learning · Computer Science 2018-06-11 Yunchen Pu , Shuyang Dai , Zhe Gan , Weiyao Wang , Guoyin Wang , Yizhe Zhang , Ricardo Henao , Lawrence Carin

Generative adversarial network (GAN) has been shown to be useful in various applications, such as image recognition, text processing and scientific computing, due its strong ability to learn complex data distributions. In this study, a…

Geophysics · Physics 2021-09-14 Tianhao He , Dongxiao Zhang

Generative Adversarial Networks (GANs) are a well-known technique that is trained on samples (e.g. pictures of fruits) and which after training is able to generate realistic new samples. Conditional GANs (CGANs) additionally provide label…

Computer Vision and Pattern Recognition · Computer Science 2020-05-28 Maximilian Bachl , Daniel C. Ferreira

Generative Adversarial Networks (GANs) are modern methods to learn the underlying distribution of a data set. GANs have been widely used in sample synthesis, de-noising, domain transfer, etc. GANs, however, are designed in a model-free…

Machine Learning · Computer Science 2021-03-01 Mucong Ding , Constantinos Daskalakis , Soheil Feizi

Unsupervised domain mapping has attracted substantial attention in recent years due to the success of models based on the cycle-consistency assumption. These models map between two domains by fooling a probabilistic discriminator, thereby…

Machine Learning · Computer Science 2019-01-25 Matthew Amodio , Smita Krishnaswamy

As an entirely-new paradigm to design the communication systems, deep learning (DL), an approach that the machine learns the desired wireless function, has received much attention recently. In order to fully realize the benefit of DL-aided…

Information Theory · Computer Science 2024-05-14 Jinhong Kim , Yongjun Ahn , Byonghyo Shim

Despite the success of Generative Adversarial Networks (GANs), mode collapse remains a serious issue during GAN training. To date, little work has focused on understanding and quantifying which modes have been dropped by a model. In this…

Computer Vision and Pattern Recognition · Computer Science 2019-10-28 David Bau , Jun-Yan Zhu , Jonas Wulff , William Peebles , Hendrik Strobelt , Bolei Zhou , Antonio Torralba

Do GANS (Generative Adversarial Nets) actually learn the target distribution? The foundational paper of (Goodfellow et al 2014) suggested they do, if they were given sufficiently large deep nets, sample size, and computation time. A recent…

Machine Learning · Computer Science 2017-07-04 Sanjeev Arora , Yi Zhang

We propose a framework of generative adversarial networks with multiple discriminators, which collaborate to represent a real dataset more effectively. Our approach facilitates learning a generator consistent with the underlying data…

Machine Learning · Computer Science 2024-04-04 Jinyoung Choi , Bohyung Han