English
Related papers

Related papers: Tighter expected generalization error bounds via W…

200 papers

We provide some non asymptotic bounds, with explicit constants, that measure the rate of convergence, in expected Wasserstein distance, of the empirical measure associated to an i.i.d. $N$-sample of a given probability distribution on…

Probability · Mathematics 2023-03-15 Nicolas Fournier

Generative Adversarial Networks are a popular method for learning distributions from data by modeling the target distribution as a function of a known distribution. The function, often referred to as the generator, is optimized to minimize…

Machine Learning · Computer Science 2021-11-03 Daria Reshetova , Yikun Bai , Xiugang Wu , Ayfer Ozgur

We introduce a random coding technique for transmission over discrete memoryless channels, reminiscent of the basic construction attaining the Gilbert-Varshamov bound for codes in Hamming spaces. The code construction is based on drawing…

Information Theory · Computer Science 2019-03-15 Anelia Somekh-Baruch , Jonathan Scarlett , Albert Guillén i Fàbregas

In this paper, we establish sharp upper and lower bounds on the convergence rate of the empirical measures of point processes under the Wasserstein distance. To this end, we first introduce a new metric on the space of counting measures…

Statistics Theory · Mathematics 2026-04-28 Dongzhou Huang , Tianyi Jiang , Haonan Wang

Discrete diffusion models have emerged as a powerful paradigm for generative modeling on sequence data; however, the information-theoretic principles governing their reverse processes remain significantly less understood than those of their…

Machine Learning · Computer Science 2026-02-10 Alberto Foresti , Mustapha Bounoua , Giulio Franzese , Luca Ambrogioni , Pietro Michiardi

Sliced Wasserstein distances preserve properties of classic Wasserstein distances while being more scalable for computation and estimation in high dimensions. The goal of this work is to quantify this scalability from three key aspects: (i)…

Machine Learning · Statistics 2022-10-18 Sloan Nietert , Ritwik Sadhu , Ziv Goldfeld , Kengo Kato

Randomised signature has been proposed as a flexible and easily implementable alternative to the well-established path signature. In this article, we employ randomised signature to introduce a generative model for financial time series data…

Machine Learning · Computer Science 2024-09-09 Francesca Biagini , Lukas Gonon , Niklas Walter

The question of optimally approximating an arbitrary probability measure in the Wasserstein distance by a discrete one with uniform weights is considered. Estimates are obtained for the optimal approximation distance, with an explicit rate…

Probability · Mathematics 2026-04-14 Benjamin Seeger

Data-driven methods for the solution of inverse problems have become widely popular in recent years thanks to the rise of machine learning techniques. A popular approach concerns the training of a generative model on additional data to…

Machine Learning · Statistics 2026-03-12 Bamdad Hosseini , Ziqi Huang

We establish new lower bounds for the normal approximation in the Wasserstein distance of random variables that are functionals of a Poisson measure. Our results generalize previous findings by Nourdin and Peccati (2012, 2015) and Bierm\'e,…

Probability · Mathematics 2015-05-13 Ehsan Azmoodeh , Giovanni Peccati

Ferromagnetic exponential random graph models (ERGMs) are random graph models under which the presence of certain small structures (such as triangles) is encouraged; they can be constructed by tilting an Erd\H{o}s--R\'enyi model by the…

Probability · Mathematics 2026-01-21 Vilas Winstein

In this paper, we provide sufficient conditions for the existence of the invariant distribution and for subgeometric rates of convergence in Wasserstein distance for general state-space Markov chains which are (possibly) not irreducible.…

Probability · Mathematics 2015-07-15 Alain Durmus , Gersende Fort , Eric Moulines

We provide a general steady-state diffusion approximation result which bounds the Wasserstein distance between the reversible measure $\mu$ of a diffusion process and the measure $\nu$ of an approximating Markov chain. Our result is…

Probability · Mathematics 2022-03-15 Thomas Bonis

Let $\pi\in \Pi(\mu,\nu)$ be a coupling between two probability measures $\mu$ and $\nu$ on a Polish space. In this article we propose and study a class of nonparametric measures of association between $\mu$ and $\nu$, which we call…

Statistics Theory · Mathematics 2021-11-05 Johannes Wiesel

Recent progress has been made in establishing normal approximation bounds in terms of the Wasserstein-$p$ distance for i.i.d. and locally dependent random variables. However, for $p > 1$, no such results have been demonstrated for dependent…

Probability · Mathematics 2025-02-25 Tianle Liu , Morgane Austern

Flow Matching, a promising approach in generative modeling, has recently gained popularity. Relying on ordinary differential equations, it offers a simple and flexible alternative to diffusion models, which are currently the…

Machine Learning · Statistics 2026-03-13 Lea Kunkel

The quantum Wasserstein distance (W-distance) is a fundamental metric for quantifying the distinguishability of quantum operations, with critical applications in quantum error correction. However, computing the W-distance remains…

Quantum Physics · Physics 2025-11-18 Changchun Feng , Xinyu Qiu , Laifa Tao , Lin Chen

We propose using the Wasserstein loss for training in inverse problems. In particular, we consider a learned primal-dual reconstruction scheme for ill-posed inverse problems using the Wasserstein distance as loss function in the learning.…

Computer Vision and Pattern Recognition · Computer Science 2017-10-31 Jonas Adler , Axel Ringh , Ozan Öktem , Johan Karlsson

We present a PAC-Bayes-style generalization bound which enables the replacement of the KL-divergence with a variety of Integral Probability Metrics (IPM). We provide instances of this bound with the IPM being the total variation metric and…

Machine Learning · Statistics 2023-01-02 Ron Amit , Baruch Epstein , Shay Moran , Ron Meir

We establish a margin based data dependent generalization error bound for a general family of deep neural networks in terms of the depth and width, as well as the Jacobian of the networks. Through introducing a new characterization of the…

Machine Learning · Computer Science 2019-07-05 Xingguo Li , Junwei Lu , Zhaoran Wang , Jarvis Haupt , Tuo Zhao
‹ Prev 1 8 9 10 Next ›