English
Related papers

Related papers: Stein's method for max-stable random vectors

200 papers

Generating samples given a specific label requires estimating conditional distributions. We derive a tractable upper bound of the Wasserstein distance between conditional distributions to lay the theoretical groundwork to learn conditional…

Machine Learning · Statistics 2023-08-29 Young-geun Kim , Kyungbok Lee , Youngwon Choi , Joong-Ho Won , Myunghee Cho Paik

In this paper, we address the classification of instances each characterized not by a singular point, but by a distribution on a vector space. We employ the Wasserstein metric to measure distances between distributions, which are then used…

Machine Learning · Statistics 2024-05-27 Jia Li , Lin Lin

We use a new method via $p$-Wasserstein bounds to prove Cram\'er-type moderate deviations in (multivariate) normal approximations. In the classical setting that $W$ is a standardized sum of $n$ independent and identically distributed…

Probability · Mathematics 2022-05-27 Xiao Fang , Yuta Koike

The Stein Variational Gradient Descent (SVGD) algorithm is a deterministic particle method for sampling. However, a mean-field analysis reveals that the gradient flow corresponding to the SVGD algorithm (i.e., the Stein Variational Gradient…

Machine Learning · Statistics 2024-05-10 Ye He , Krishnakumar Balasubramanian , Bharath K. Sriperumbudur , Jianfeng Lu

Let $\boldsymbol{\xi}=(\xi_1,\ldots,\xi_m)$ be a negatively associated mean zero random vector with components that obey the bound $|\xi_i| \le B, i=1,\ldots,m$, and whose sum $W = \sum_{i=1}^m \xi_i$ has variance 1, the bound \[…

Probability · Mathematics 2018-09-11 Nathakhun Wiroonsri

Score-based generative models are shown to achieve remarkable empirical performances in various applications such as image generation and audio synthesis. However, a theoretical understanding of score-based diffusion models is still…

Machine Learning · Computer Science 2022-12-14 Dohyun Kwon , Ying Fan , Kangwook Lee

We consider the following second-order stochastic differential equation on $\mathbb{R}^{2d}$: \begin{equation*} dX_t^m=Y_t^mdt, \quad mdY_t^m=b(X_t^m)dt+\sigma(X_t^m)dB_t-Y^m_tdt, \end{equation*} where $X^m_t$ and $Y^m_t$ represent the…

Probability · Mathematics 2026-02-03 Shiyu Liu , Wei Liu , Lihu Xu

Stein's method has been widely used to achieve distributional approximations for probability distributions defined in Euclidean spaces. Recently, techniques to extend Stein's method to manifold-valued random variables with distributions…

Statistics Theory · Mathematics 2022-09-20 Xiaoda Qu , Baba C. Vemuri

Wasserstein distributionally robust optimization offers a framework for model fitting in machine learning under potential shifts in the data distribution. We study a regularized variant of this problem in which entropic smoothing produces a…

Optimization and Control · Mathematics 2026-05-28 Tam Le

Providing theoretical guarantees for parameter estimation in exponential random graph models is a largely open problem. While maximum likelihood estimation has theoretical guarantees in principle, verifying the assumptions for these…

Statistics Theory · Mathematics 2026-03-26 Adrian Fischer , Gesine Reinert , Wenkai Xu

In this article we propose a general framework for normal approximation using Stein's method. We introduce the new concept of Stein couplings and we show that it lies at the heart of popular approaches such as the local approach,…

Probability · Mathematics 2010-10-27 Louis H. Y. Chen , Adrian Röllin

Let $(X_n)_{n=0}^\infty$ denote a Markov chain on a Polish space that has a stationary distribution $\varpi$. This article concerns upper bounds on the Wasserstein distance between the distribution of $X_n$ and $\varpi$. In particular, an…

Probability · Mathematics 2021-02-16 Qian Qin , James P. Hobert

Bayesian inference problems require sampling or approximating high-dimensional probability distributions. The focus of this paper is on the recently introduced Stein variational gradient descent methodology, a class of algorithms that rely…

Machine Learning · Statistics 2023-02-14 A. Duncan , N. Nuesken , L. Szpruch

To quantify the dependence between two random vectors of possibly different dimensions, we propose to rely on the properties of the 2-Wasserstein distance. We first propose two coefficients that are based on the Wasserstein distance between…

Statistics Theory · Mathematics 2021-10-19 Gilles Mordant , Johan Segers

We study the discrepancy between the distribution of a vector-valued functional of i.i.d. random elements and that of a Gaussian vector. Our main contribution is an explicit bound on the convex distance between the two distributions,…

Probability · Mathematics 2022-03-25 Mikołaj J. Kasprzak , Giovanni Peccati

Motivated by the statistical and computational challenges of computing Wasserstein distances in high-dimensional contexts, machine learning researchers have defined modified Wasserstein distances based on computing distances between…

Probability · Mathematics 2022-06-02 Jiaqi Xi , Jonathan Niles-Weed

Ranking distributions according to a stochastic order has wide applications in diverse areas. Although stochastic dominance has received much attention, convex order, particularly in general dimensions, has yet to be investigated from a…

Methodology · Statistics 2025-01-15 Jakwang Kim , Young-Heon Kim , Yuanlong Ruan , Andrew Warren

Stein operators allow to characterise probability distributions via differential operators. Based on these characterisations, we develop a new method of point estimation for marginal parameters of strictly stationary and ergodic processes,…

Statistics Theory · Mathematics 2024-12-05 Bruno Ebner , Adrian Fischer , Robert E. Gaunt , Babette Picker , Yvik Swan

The goal of scenario reduction is to approximate a given discrete distribution with another discrete distribution that has fewer atoms. We distinguish continuous scenario reduction, where the new atoms may be chosen freely, and discrete…

Optimization and Control · Mathematics 2017-01-17 Napat Rujeerapaiboon , Kilian Schindler , Daniel Kuhn , Wolfram Wiesemann

Friedman's chi-square test is a non-parametric statistical test for $r\geq2$ treatments across $n\ge1$ trials to assess the null hypothesis that there is no treatment effect. We use Stein's method with an exchangeable pair coupling to…

Statistics Theory · Mathematics 2022-07-01 Robert E. Gaunt , Gesine Reinert