中文
相关论文

相关论文: PAC-Bayesian Generalization Bounds for Adversarial…

200 篇论文

Neural samplers such as variational autoencoders (VAEs) or generative adversarial networks (GANs) approximate distributions by transforming samples from a simple random source---the latent space---to samples from a more complex distribution…

The study of quantum generative models is well-motivated, not only because of its importance in quantum machine learning and quantum chemistry but also because of the perspective of its implementation on near-term quantum machines. Inspired…

量子物理 · 物理学 2019-11-04 Shouvanik Chakrabarti , Yiming Huang , Tongyang Li , Soheil Feizi , Xiaodi Wu

We train a generator by maximum likelihood and we also train the same generator architecture by Wasserstein GAN. We then compare the generated samples, exact log-probability densities and approximate Wasserstein distances. We show that an…

机器学习 · 计算机科学 2017-05-16 Ivo Danihelka , Balaji Lakshminarayanan , Benigno Uria , Daan Wierstra , Peter Dayan

Generative adversarial networks (GANs) and normalizing flows are both approaches to density estimation that use deep neural networks to transform samples from an uninformative prior distribution to an approximation of the data distribution.…

机器学习 · 计算机科学 2021-12-15 Tianci Liu , Jeffrey Regier

We provide upper bounds of the expected Wasserstein distance between a probability measure and its empirical version, generalizing recent results for finite dimensional Euclidean spaces and bounded functional spaces. Such a generalization…

统计理论 · 数学 2020-01-29 Jing Lei

Generative Adversarial Networks (GANs) are powerful generative models, but suffer from training instability. The recently proposed Wasserstein GAN (WGAN) makes progress toward stable training of GANs, but sometimes can still generate only…

机器学习 · 计算机科学 2017-12-27 Ishaan Gulrajani , Faruk Ahmed , Martin Arjovsky , Vincent Dumoulin , Aaron Courville

In this paper, we aim to understand the generalization properties of generative adversarial networks (GANs) from a new perspective of privacy protection. Theoretically, we prove that a differentially private learning algorithm used for…

机器学习 · 计算机科学 2019-09-26 Bingzhe Wu , Shiwan Zhao , ChaoChao Chen , Haoyang Xu , Li Wang , Xiaolu Zhang , Guangyu Sun , Jun Zhou

We establish non-asymptotic bounds on the finite-sample behavior of generalized first-order iterative algorithms -- including gradient-based optimization methods and approximate message passing (AMP) -- with Gaussian data matrices and…

机器学习 · 统计学 2025-08-15 Galen Reeves

In the recent years Generative Adversarial Networks (GANs) have demonstrated significant progress in generating authentic looking data. In this work we introduce our simple method to exploit the advancements in well established image-based…

机器学习 · 计算机科学 2019-10-31 Eoin Brophy , Zhengwei Wang , Tomas E. Ward

Generative models and in particular Generative Adversarial Networks (GANs) have become very popular and powerful data generation tool. In recent years, major progress has been made in extending this concept into the quantum realm. However,…

量子物理 · 物理学 2023-09-19 Wiktor Jurasz , Christian B. Mendl

Most Kalman filters for non-linear systems, such as the unscented Kalman filter, are based on Gaussian approximations. We use Poincar\'e inequalities to bound the Wasserstein distance between the true joint distribution of the prediction…

统计理论 · 数学 2026-05-28 Toni Karvonen , Simo Särkkä

Let $(X_n)_{n=0}^\infty$ denote a Markov chain on a Polish space that has a stationary distribution $\varpi$. This article concerns upper bounds on the Wasserstein distance between the distribution of $X_n$ and $\varpi$. In particular, an…

概率论 · 数学 2021-02-16 Qian Qin , James P. Hobert

Generative Adversarial Networks (GANs) have shown great promise in modeling high dimensional data. The learning objective of GANs usually minimizes some measure discrepancy, \textit{e.g.}, $f$-divergence~($f$-GANs) or Integral Probability…

机器学习 · 计算机科学 2020-04-07 Yuxuan Song , Qiwei Ye , Minkai Xu , Tie-Yan Liu

In this work, we propose a PAC-Bayes bound for the generalization risk of the Gibbs classifier in the multi-class classification framework. The novelty of our work is the critical use of the confusion matrix of a classifier as an error…

机器学习 · 统计学 2013-10-23 Emilie Morvant , Sokol Koço , Liva Ralaivola

Distributional causal inference requires estimating not only average treatment effects but also interventional outcome distributions, including quantiles, tail risks, and policy-dependent uncertainty. As a method for distributional causal…

统计理论 · 数学 2026-05-12 Shu Tamano , Masaaki Imaizumi

Generalized Wasserstein distances allow to quantitatively compare two continuous or atomic mass distributions with equal or different total mass. In this paper, we propose four numerical methods for the approximation of three different…

偏微分方程分析 · 数学 2025-10-21 Maya Briani , Emiliano Cristiani , Giovanni Franzina , Francesca L. Ignoto

Generative adversarial networks (GANs) are unsupervised learning methods for training a generator distribution to produce samples that approximate those drawn from a target distribution. Many such methods can be formulated as minimization…

机器学习 · 统计学 2025-05-13 Jeremiah Birrell

PAC-Bayes is a popular and efficient framework for obtaining generalization guarantees in situations involving uncountable hypothesis spaces. Unfortunately, in its classical formulation, it only provides guarantees on the expected risk of a…

机器学习 · 计算机科学 2025-10-30 Benjamin Leblanc , Pascal Germain

In machine learning, Domain Adaptation (DA) arises when the distribution gen- erating the test (target) data differs from the one generating the learning (source) data. It is well known that DA is an hard task even under strong assumptions,…

机器学习 · 统计学 2012-12-12 Pascal Germain , Amaury Habrard , François Laviolette , Emilie Morvant

We present a general approach, based on exponential inequalities, to derive bounds on the generalization error of randomized learning algorithms. Using this approach, we provide bounds on the average generalization error as well as bounds…

机器学习 · 计算机科学 2023-03-10 Fredrik Hellström , Giuseppe Durisi