English
Related papers

Related papers: Strong posterior contraction rates via Wasserstein…

200 papers

High dimensional statistics deals with the challenge of extracting structured information from complex model settings. Compared with the growing number of frequentist methodologies, there are rather few theoretically optimal Bayes methods…

Statistics Theory · Mathematics 2018-08-21 Chao Gao , Aad W. van der Vaart , Harrison H. Zhou

Flexible Bayesian models are typically constructed using limits of large parametric models with a multitude of parameters that are often uninterpretable. In this article, we offer a novel alternative by constructing an exponentially tilted…

Methodology · Statistics 2023-03-20 Abhisek Chakraborty , Anirban Bhattacharya , Debdeep Pati

We analyze the posterior contraction rates of parameters in Bayesian models via the Langevin diffusion process, in particular by controlling moments of the stochastic process and taking limits. Analogous to the non-asymptotic analysis of…

Statistics Theory · Mathematics 2022-08-18 Wenlong Mou , Nhat Ho , Martin J. Wainwright , Peter Bartlett , Michael I. Jordan

In this paper we discuss distributional robustness in the context of stochastic model predictive control (SMPC) for linear time-invariant systems. We derive a simple approximation of the MPC problem under an additive zero-mean i.i.d. noise…

Optimization and Control · Mathematics 2023-03-07 Christoph Mark , Steven Liu

The problem of efficiently generating random samples from high-dimensional and non-log-concave posterior measures arising from nonlinear regression problems is considered. Extending investigations from arXiv:2009.05298, local and global…

Statistics Theory · Mathematics 2023-04-18 Jan Bohr , Richard Nickl

We introduce a novel and scalable Bayesian framework for multivariate-density-density regression (DDR), designed to model relationships between multivariate distributions. Our approach addresses the critical issue of distributions residing…

Methodology · Statistics 2025-09-24 Khai Nguyen , Yang Ni , Peter Mueller

Recent works have shown an interest in investigating the frequentist asymptotic properties of Bayesian procedures for high-dimensional linear models under sparsity constraints. However, there exists a gap in the literature regarding…

Statistics Theory · Mathematics 2025-09-23 Marion Naveau , Maud Delattre , Laure Sansonnet

Penalized regression methods, such as $L_1$ regularization, are routinely used in high-dimensional applications, and there is a rich literature on optimality properties under sparsity assumptions. In the Bayesian paradigm, sparsity is…

Statistics Theory · Mathematics 2014-01-22 Anirban Bhattacharya , Debdeep Pati , Natesh S. Pillai , David B. Dunson

Many scientific systems, such as cellular populations or economic cohorts, are naturally described by probability distributions that evolve over time. Predicting how such a system would have evolved under different forces or initial…

Machine Learning · Statistics 2026-03-26 Tristan Luca Saidi , Gonzalo Mena , Larry Wasserman , Florian Gunsilius

The study of the closest point(s) on a statistical model from a given distribution in the probability simplex with respect to a fixed Wasserstein metric gives rise to a polyhedral norm distance optimization problem. There are two components…

Algebraic Geometry · Mathematics 2025-01-20 Greg DePaul , Serkan Hoşten , Nilava Metya , Ikenna Nometa

We consider nonparametric Bayesian estimation of a probability density $p$ based on a random sample of size $n$ from this density using a hierarchical prior. The prior consists, for instance, of prior weights on the regularity of the…

Statistics Theory · Mathematics 2009-09-29 Subhashis Ghosal , Jüri Lember , Aad van der Vaart

In this article, we investigate the problem of estimating a spatially inhomogeneous function and its derivatives in the white noise model using Besov-Laplace priors. We show that smoothness-matching priors attains minimax optimal posterior…

Statistics Theory · Mathematics 2024-11-12 Emanuele Dolera , Stefano Favaro , Matteo Giordano

In this paper we propose tight upper and lower bounds for the Wasserstein distance between any two {{univariate continuous distributions}} with probability densities $p_1$ and $p_2$ having nested supports. These explicit bounds are…

Probability · Mathematics 2015-10-21 Christophe Ley , Gesine Reinert , Yvik Swan

Penalized regression methods, such as $L_1$ regularization, are routinely used in high-dimensional applications, and there is a rich literature on optimality properties under sparsity assumptions. In the Bayesian paradigm, sparsity is…

Statistics Theory · Mathematics 2012-12-27 Anirban Bhattacharya , Debdeep Pati , Natesh S. Pillai , David B. Dunson

The notion of entropy-regularized optimal transport, also known as Sinkhorn divergence, has recently gained popularity in machine learning and statistics, as it makes feasible the use of smoothed optimal transportation distances for data…

Statistics Theory · Mathematics 2019-11-05 Jérémie Bigot , Elsa Cazelles , Nicolas Papadakis

The Wasserstein distance is a distance between two probability distributions and has recently gained increasing popularity in statistics and machine learning, owing to its attractive properties. One important approach to extending this…

Methodology · Statistics 2022-02-14 Ryo Okano , Masaaki Imaizumi

Ranking distributions according to a stochastic order has wide applications in diverse areas. Although stochastic dominance has received much attention, convex order, particularly in general dimensions, has yet to be investigated from a…

Methodology · Statistics 2025-01-15 Jakwang Kim , Young-Heon Kim , Yuanlong Ruan , Andrew Warren

A growing number of generative statistical models do not permit the numerical evaluation of their likelihood functions. Approximate Bayesian computation (ABC) has become a popular approach to overcome this issue, in which one simulates…

Methodology · Statistics 2019-05-10 Espen Bernton , Pierre E. Jacob , Mathieu Gerber , Christian P. Robert

We study the multivariate deconvolution problem of recovering the distribution of a signal from independent and identically distributed observations additively contaminated with random errors (noise) from a known distribution. For errors…

Statistics Theory · Mathematics 2023-09-28 Judith Rousseau , Catia Scricciolo

In recent years, Bayesian inference in large-scale inverse problems found in science, engineering and machine learning has gained significant attention. This paper examines the robustness of the Bayesian approach by analyzing the stability…

Machine Learning · Statistics 2023-03-06 Alfredo Garbuno-Inigo , Tapio Helin , Franca Hoffmann , Bamdad Hosseini