English
Related papers

Related papers: Non-Asymptotic Error Bounds for Bidirectional GANs

200 papers

We study quantum neural networks where the generated function is the expectation value of the sum of single-qubit observables across all qubits. In [Girardi \emph{et al.}, arXiv:2402.08726], it is proven that the probability distributions…

Despite the successes in capturing continuous distributions, the application of generative adversarial networks (GANs) to discrete settings, like natural language tasks, is rather restricted. The fundamental reason is the difficulty of…

Artificial Intelligence · Computer Science 2017-02-28 Tong Che , Yanran Li , Ruixiang Zhang , R Devon Hjelm , Wenjie Li , Yangqiu Song , Yoshua Bengio

We introduce Kernel Density Discrimination GAN (KDD GAN), a novel method for generative adversarial learning. KDD GAN formulates the training as a likelihood ratio optimization problem where the data distributions are written explicitly via…

Machine Learning · Computer Science 2021-07-14 Abdelhak Lemkhenter , Adam Bielski , Alp Eren Sari , Paolo Favaro

Minimising upper bounds on the population risk or the generalisation gap has been widely used in structural risk minimisation (SRM) -- this is in particular at the core of PAC-Bayesian learning. Despite its successes and unfailing surge of…

Machine Learning · Statistics 2023-10-30 Paul Viallard , Maxime Haddouche , Umut Şimşekli , Benjamin Guedj

Diffusion models are one of the most important families of deep generative models. In this note, we derive a quantitative upper bound on the Wasserstein distance between the data-generating distribution and the distribution learned by a…

Machine Learning · Computer Science 2024-09-17 Sokhna Diarra Mbacke , Omar Rivasplata

Generative Adversarial Networks (GANs) have shown remarkable results in modeling complex distributions, but their evaluation remains an unsettled issue. Evaluations are essential for: (i) relative assessment of different models and (ii)…

Arguably the most fundamental question in the theory of generative adversarial networks (GANs) is to understand to what extent GANs can actually learn the underlying distribution. Theoretical and empirical evidence suggests local optimality…

Machine Learning · Computer Science 2022-01-19 Sitan Chen , Jerry Li , Yuanzhi Li , Raghu Meka

Generative adversarial networks (GANs) have received a tremendous amount of attention in the past few years, and have inspired applications addressing a wide range of problems. Despite its great potential, GANs are difficult to train.…

Machine Learning · Computer Science 2017-05-09 Zhimin Chen , Yuguang Tong

Traditional deep neural networks (NNs) have significantly contributed to the state-of-the-art performance in the task of classification under various application domains. However, NNs have not considered inherent uncertainty in data…

Machine Learning · Computer Science 2021-05-05 Yibo Hu , Yuzhe Ou , Xujiang Zhao , Jin-Hee Cho , Feng Chen

We propose a general method to carry out a valid Bayesian analysis of a finite-dimensional `targeted' parameter in the presence of a finite-dimensional nuisance parameter. We apply our methods to causal inference based on estimating…

Methodology · Statistics 2026-02-03 Magid Sabbagh , David A. Stephens

We propose the BinaryGAN, a novel generative adversarial network (GAN) that uses binary neurons at the output layer of the generator. We employ the sigmoid-adjusted straight-through estimators to estimate the gradients for the binary…

Machine Learning · Computer Science 2018-10-12 Hao-Wen Dong , Yi-Hsuan Yang

In this paper, we propose a novel loss function for training Generative Adversarial Networks (GANs) aiming towards deeper theoretical understanding as well as improved stability and performance for the underlying optimization problem. The…

Machine Learning · Computer Science 2021-08-25 Yannis Pantazis , Dipjyoti Paul , Michail Fasoulakis , Yannis Stylianou , Markos Katsoulakis

We provide upper bounds of the expected Wasserstein distance between a probability measure and its empirical version, generalizing recent results for finite dimensional Euclidean spaces and bounded functional spaces. Such a generalization…

Statistics Theory · Mathematics 2020-01-29 Jing Lei

Generative Adversarial Networks (GANs) is a powerful family of models that learn an underlying distribution to generate synthetic data. Many existing studies of GANs focus on improving the realness of the generated image data for visual…

Machine Learning · Computer Science 2021-11-04 Si-An Chen , Chun-Liang Li , Hsuan-Tien Lin

Expectation Propagation is a very popular algorithm for variational inference, but comes with few theoretical guarantees. In this article, we prove that the approximation errors made by EP can be bounded. Our bounds have an asymptotic…

Computation · Statistics 2016-01-12 Guillaume P Dehaene , Simon Barthelmé

The combinatorial search space presents a significant challenge to learning causality from data. Recently, the problem has been formulated into a continuous optimization framework with an acyclicity constraint, allowing for the exploration…

Machine Learning · Computer Science 2022-04-04 Hristo Petkov , Colin Hanley , Feng Dong

Generative adversarial networks (GANs) are often billed as "universal distribution learners", but precisely what distributions they can represent and learn is still an open question. Heavy-tailed distributions are prevalent in many…

Machine Learning · Computer Science 2021-01-25 Todd Huster , Jeremy E. J. Cohen , Zinan Lin , Kevin Chan , Charles Kamhoua , Nandi Leslie , Cho-Yu Jason Chiang , Vyas Sekar

Human motion prediction model has applications in various fields of computer vision. Without taking into account the inherent stochasticity in the prediction of future pose dynamics, such methods often converges to a deterministic undesired…

Computer Vision and Pattern Recognition · Computer Science 2018-12-07 Jogendra Nath Kundu , Maharshi Gor , R. Venkatesh Babu

Generative Adversarial Networks (GAN) are a powerful methodology and can be used for unsupervised anomaly detection, where current techniques have limitations such as the accurate detection of anomalies near the tail of a distribution. GANs…

Machine Learning · Computer Science 2022-02-03 Nikolaos Dionelis , Mehrdad Yaghoobi , Sotirios A. Tsaftaris

We develop a framework for generalized variational inference in infinite-dimensional function spaces and use it to construct a method termed Gaussian Wasserstein inference (GWI). GWI leverages the Wasserstein distance between Gaussian…

Machine Learning · Statistics 2022-10-18 Veit D. Wild , Robert Hu , Dino Sejdinovic
‹ Prev 1 4 5 6 7 8 10 Next ›