English
Related papers

Related papers: Adaptive posterior convergence rates in non-linear…

200 papers

We study nonparametric Bayesian inference with location mixtures of the Laplace density and a Dirichlet process prior on the mixing distribution. We derive a contraction rate of the corresponding posterior distribution, both for the mixing…

Statistics Theory · Mathematics 2016-03-10 Fengnan Gao , Aad van der Vaart

Density regression provides a flexible strategy for modeling the distribution of a response variable $Y$ given predictors $\mathbf{X}=(X_1,\ldots,X_p)$ by letting that the conditional density of $Y$ given $\mathbf{X}$ as a completely…

Statistics Theory · Mathematics 2016-01-07 Weining Shen , Subhashis Ghosal

We analyze the posterior contraction rates of parameters in Bayesian models via the Langevin diffusion process, in particular by controlling moments of the stochastic process and taking limits. Analogous to the non-asymptotic analysis of…

Statistics Theory · Mathematics 2022-08-18 Wenlong Mou , Nhat Ho , Martin J. Wainwright , Peter Bartlett , Michael I. Jordan

We study posterior contraction behaviors for parameters of interest in the context of Bayesian mixture modeling, where the number of mixing components is unknown while the model itself may or may not be correctly specified. Two…

Statistics Theory · Mathematics 2019-01-17 Aritra Guha , Nhat Ho , XuanLong Nguyen

Approximate Bayesian inference on the basis of summary statistics is well-suited to complex problems for which the likelihood is either mathematically or computationally intractable. However the methods that use rejection suffer from the…

Computation · Statistics 2010-05-04 M. G. B. Blum , O. Francois

Mixture models are widely used in modeling heterogeneous data populations. A standard approach of mixture modeling assumes that the mixture component takes a parametric kernel form. In many applications, making parametric assumptions on the…

Methodology · Statistics 2026-03-06 Yilei Zhang , Yun Wei , Aritra Guha , XuanLong Nguyen

This paper introduces a new approach to the study of rates of convergence for posterior distributions. It is a natural extension of a recent approach to the study of Bayesian consistency. In particular, we improve on current rates of…

Statistics Theory · Mathematics 2007-08-22 Stephen G. Walker , Antonio Lijoi , Igor Prünster

Given a sample from a discretely observed multidimensional compound Poisson process, we study the problem of nonparametric estimation of its jump size density $r_0$ and intensity $\lambda_0$. We take a nonparametric Bayesian approach to the…

Statistics Theory · Mathematics 2015-06-08 Shota Gugushvili , Frank van der Meulen , Peter Spreij

Although discrete mixture modeling has formed the backbone of the literature on Bayesian density estimation, there are some well known disadvantages. We propose an alternative class of priors based on random nonlinear functions of a uniform…

Statistics Theory · Mathematics 2015-03-19 Suprateek Kundu , David B. Dunson

We provide posterior contraction rates for constrained deep Gaussian processes in non-parametric density estimation and classication. The constraints are in the form of bounds on the values and on the derivatives of the Gaussian processes…

Statistics Theory · Mathematics 2021-12-15 François Bachoc , Agnès Lagnoux

We study the rate of Bayesian consistency for hierarchical priors consisting of prior weights on a model index set and a prior on a density model for each choice of model index. Ghosal, Lember and Van der Vaart [2] have obtained general…

Statistics Theory · Mathematics 2008-09-23 Yang Xing

We consider heteroscedastic nonparametric regression models, when both the mean function and variance function are unknown and to be estimated with nonparametric approaches. We derive convergence rates of posterior distributions for this…

Statistics Theory · Mathematics 2010-10-07 Yuao Hu

Mixtures of regression are a powerful class of models for regression learning with respect to a highly uncertain and heterogeneous response variable of interest. In addition to being a rich predictive model for the response given some…

Statistics Theory · Mathematics 2024-01-30 Dat Do , Linh Do , XuanLong Nguyen

We study the rates of convergence of the posterior distribution for Bayesian density estimation with Dirichlet mixtures of normal distributions as the prior. The true density is assumed to be twice continuously differentiable. The bandwidth…

Statistics Theory · Mathematics 2009-09-29 Subhashis Ghosal , Aad van der Vaart

We study the rate of convergence of posterior distributions in density estimation problems for log-densities in periodic Sobolev classes characterized by a smoothness parameter p. The posterior expected density provides a nonparametric…

Statistics Theory · Mathematics 2009-09-29 Catia Scricciolo

We investigate the problem of deriving adaptive posterior rates of contraction on $\mathbb{L}^{\infty}$ balls in density estimation. Although it is known that log-density priors can achieve optimal rates when the true density is…

Statistics Theory · Mathematics 2021-07-02 Zacharie Naulet

Besov priors are nonparametric priors that can model spatially inhomogeneous functions. They are routinely used in inverse problems and imaging, where they exhibit attractive sparsity-promoting and edge-preserving features. A recent line of…

Statistics Theory · Mathematics 2023-09-11 Matteo Giordano

Density estimation represents one of the most successful applications of Bayesian nonparametrics. In particular, Dirichlet process mixtures of normals are the gold standard for density estimation and their asymptotic properties have been…

Statistics Theory · Mathematics 2015-07-02 Antonio Canale , Pierpaolo De Blasi

We derive rates of contraction of posterior distributions on nonparametric or semiparametric models based on Gaussian processes. The rate of contraction is shown to depend on the position of the true parameter relative to the reproducing…

Statistics Theory · Mathematics 2008-12-18 A. W. van der Vaart , J. H. van Zanten

We study full Bayesian procedures for high-dimensional linear regression. We adopt data-dependent empirical priors introduced in [1]. In their paper, these priors have nice posterior contraction properties and are easy to compute. Our paper…

Statistics Theory · Mathematics 2022-02-14 Xiao Fang , Malay Ghosh