English
Related papers

Related papers: "Best-of-Many-Samples" Distribution Matching

200 papers

Training deep generative models with maximum likelihood remains a challenge. The typical workaround is to use variational inference (VI) and maximize a lower bound to the log marginal likelihood of the data. Variational auto-encoders (VAEs)…

Machine Learning · Statistics 2019-08-13 Adji B. Dieng , John Paisley

Generative Adversarial Networks (GANs) have become a very popular tool for implicitly learning high-dimensional probability distributions. Several improvements have been made to the original GAN formulation to address some of its…

Computer Vision and Pattern Recognition · Computer Science 2019-11-11 Parimala Kancharla , Sumohana S. Channappayya

Generative adversarial networks (GANs) are one of the most powerful generative models, but always require a large and balanced dataset to train. Traditional GANs are not applicable to generate minority-class images in a highly imbalanced…

Computer Vision and Pattern Recognition · Computer Science 2021-07-12 Gaofeng Huang , Amir H. Jafari

Generative Adversarial Network (GAN) is a current focal point of research. The body of knowledge is fragmented, leading to a trial-error method while selecting an appropriate GAN for a given scenario. We provide a comprehensive summary of…

Machine Learning · Computer Science 2021-05-18 Tanya Motwani , Manojkumar Parmar

Generative adversarial networks (GANs) are a powerful approach to unsupervised learning. They have achieved state-of-the-art performance in the image domain. However, GANs are limited in two ways. They often learn distributions with low…

Machine Learning · Statistics 2019-10-11 Adji B. Dieng , Francisco J. R. Ruiz , David M. Blei , Michalis K. Titsias

We introduce Kernel Density Discrimination GAN (KDD GAN), a novel method for generative adversarial learning. KDD GAN formulates the training as a likelihood ratio optimization problem where the data distributions are written explicitly via…

Machine Learning · Computer Science 2021-07-14 Abdelhak Lemkhenter , Adam Bielski , Alp Eren Sari , Paolo Favaro

Generative models have attracted significant interest due to their ability to handle uncertainty by learning the inherent data distributions. However, two prominent generative models, namely Generative Adversarial Networks (GANs) and…

Machine Learning · Computer Science 2023-04-25 Yu Wang , Zhiwei Liu , Liangwei Yang , Philip S. Yu

Sampling-based motion planning under task constraints is challenging because the null-measure constraint manifold in the configuration space makes rejection sampling extremely inefficient, if not impossible. This paper presents a…

Robotics · Computer Science 2022-04-15 Cihan Acar , Keng Peng Tee

Ensemble smoothers are among the most successful and efficient techniques currently available for history matching. However, because these methods rely on Gaussian assumptions, their performance is severely degraded when the prior geology…

Generating realistic sequences is a central task in many machine learning applications. There has been considerable recent progress on building deep generative models for sequence generation tasks. However, the issue of mode-collapsing…

Machine Learning · Computer Science 2021-04-29 Mahmoud Hossam , Trung Le , Michael Papasimeon , Viet Huynh , Dinh Phung

Generative adversarial networks (GANs) have been a popular deep generative model for real-world applications. Despite many recent efforts on GANs that have been contributed, mode collapse and instability of GANs are still open problems…

Computer Vision and Pattern Recognition · Computer Science 2021-03-24 Shiming Chen , Wenjie Wang , Beihao Xia , Xinge You , Zehong Cao , Weiping Ding

The variational autoencoder (VAE) is a well-studied, deep, latent-variable model (DLVM) that efficiently optimizes the variational lower bound of the log marginal data likelihood and has a strong theoretical foundation. However, the VAE's…

Machine Learning · Computer Science 2024-10-08 Surojit Saha , Sarang Joshi , Ross Whitaker

Variational Auto-encoders (VAEs) are deep generative latent variable models consisting of two components: a generative model that captures a data distribution p(x) by transforming a distribution p(z) over latent space, and an inference…

Machine Learning · Computer Science 2022-08-25 Yaniv Yacoby , Weiwei Pan , Finale Doshi-Velez

Generating realistic time series data is important for many engineering and scientific applications. Existing work tackles this problem using generative adversarial networks (GANs). However, GANs are unstable during training, and they can…

Machine Learning · Computer Science 2024-05-14 Ilan Naiman , N. Benjamin Erichson , Pu Ren , Michael W. Mahoney , Omri Azencot

The field of deep generative modeling is dominated by generative adversarial networks (GANs). However, the training of GANs often lacks stability, fails to converge, and suffers from model collapse. It takes an assortment of tricks to solve…

Machine Learning · Computer Science 2019-10-18 Oliver Zhang , Ruei-Sung Lin , Yuchuan Gou

The training of Generative Adversarial Networks is a difficult task mainly due to the nature of the networks. One such issue is when the generator and discriminator start oscillating, rather than converging to a fixed point. Another case…

Machine Learning · Statistics 2018-02-08 Alexey Chaplygin , Joshua Chacksfield

When trained on multimodal image datasets, normal Generative Adversarial Networks (GANs) are usually outperformed by class-conditional GANs and ensemble GANs, but conditional GANs is restricted to labeled datasets and ensemble GANs lack…

Computer Vision and Pattern Recognition · Computer Science 2019-01-29 Haifeng Shi , Guanyu Cai , Yuqin Wang , Shaohua Shang , Lianghua He

We propose to incorporate adversarial dropout in generative multi-adversarial networks, by omitting or dropping out, the feedback of each discriminator in the framework with some probability at the end of each batch. Our approach forces the…

Machine Learning · Computer Science 2020-01-22 Gonçalo Mordido , Haojin Yang , Christoph Meinel

Training robust supervised deep learning models for many geospatial applications of computer vision is difficult due to dearth of class-balanced and diverse training data. Conversely, obtaining enough training data for many applications is…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 Xuerong Xiao , Swetava Ganguli , Vipul Pandey

In population synthesis applications, when considering populations with many attributes, a fundamental problem is the estimation of rare combinations of feature attributes. Unsurprisingly, it is notably more difficult to reliably…

Machine Learning · Statistics 2019-09-18 Sergio Garrido , Stanislav S. Borysov , Francisco C. Pereira , Jeppe Rich