English
Related papers

Related papers: Posterior convergence rates in non-linear latent v…

200 papers

We develop a framework to study posterior contraction rates in sparse high dimensional generalized linear models (GLM). We introduce a new family of GLMs, denoted by clipped GLM, which subsumes many standard GLMs and makes minor…

Statistics Theory · Mathematics 2021-03-16 Biraj Subhra Guha , Debdeep Pati

Mixtures of regression are a powerful class of models for regression learning with respect to a highly uncertain and heterogeneous response variable of interest. In addition to being a rich predictive model for the response given some…

Statistics Theory · Mathematics 2024-01-30 Dat Do , Linh Do , XuanLong Nguyen

We study the rate of convergence of posterior distributions in density estimation problems for log-densities in periodic Sobolev classes characterized by a smoothness parameter p. The posterior expected density provides a nonparametric…

Statistics Theory · Mathematics 2009-09-29 Catia Scricciolo

In recent years, shrinkage priors have received much attention in high-dimensional data analysis from a Bayesian perspective. Compared with widely used spike-and-slab priors, shrinkage priors have better computational efficiency. But the…

Statistics Theory · Mathematics 2020-01-16 Ruoyang Zhang , Malay Ghosh

Due to their conjugate posteriors, Gaussian process priors are attractive for estimating the drift of stochastic differential equations with continuous time observations. However, their performance strongly depends on the choice of the…

Statistics Theory · Mathematics 2020-02-04 Jan van Waaij

In this paper, we consider the well known problem of estimating a density function under qualitative assumptions. More precisely, we estimate monotone non increasing densities in a Bayesian setting and derive concentration rate for the…

Statistics Theory · Mathematics 2015-02-20 Jean-Bernard Salomond

In this paper we provide general conditions to check on the model and the prior to derive posterior concentration rates for data-dependent priors (or empirical Bayes approaches). We aim at providing conditions that are close to the…

Statistics Theory · Mathematics 2014-06-18 Sophie Donnet , Vincent Rivoirard , Judith Rousseau , Catia Scricciolo

In the setting of nonparametric multivariate regression with unknown error variance, we study asymptotic properties of a Bayesian method for estimating a regression function f and its mixed partial derivatives. We use a random series of…

Statistics Theory · Mathematics 2016-04-13 William Weimin Yoo , Subhashis Ghosal

We propose a new \textit{quadratic programming-based} method of approximating a nonstandard density using a multivariate Gaussian density. Such nonstandard densities usually arise while developing posterior samplers for unobserved…

Econometrics · Economics 2023-02-14 Abhishek K. Umrawal , Joshua C. C. Chan

We provide general conditions to derive posterior concentration rates for Aalen counting processes. The conditions are designed to resemble those proposed in the literature for the problem of density estimation, for instance in Ghosal et…

Methodology · Statistics 2014-07-24 Sophie Donnet , Vincent Rivoirard , Judith Rousseau , Catia Scricciolo

The paper considers nonparametric kernel density/regression estimation from a stochastic optimization point of view. The estimation problem is represented through a family of stochastic optimization problems. Recursive constrained…

Statistics Theory · Mathematics 2024-09-05 Vladimir Norkin , Vladimir Kirilyuk

We study convergence rates of variational posterior distributions for nonparametric and high-dimensional inference. We formulate general conditions on prior, likelihood, and variational class that characterize the convergence rates. Under…

Statistics Theory · Mathematics 2019-06-18 Fengshuo Zhang , Chao Gao

Frequentist-style large-sample properties of Bayesian posterior distributions, such as consistency and convergence rates, are important considerations in nonparametric problems. In this paper we give an analysis of Bayesian asymptotics…

Statistics Theory · Mathematics 2012-10-02 Ryan Martin , Liang Hong

We consider a nonparametric regression model $Y=r(X)+\varepsilon$ with a random covariate $X$ that is independent of the error $\varepsilon$. Then the density of the response $Y$ is a convolution of the densities of $\varepsilon$ and…

Statistics Theory · Mathematics 2013-12-18 Anton Schick , Wolfgang Wefelmeyer

We study frequentist asymptotic properties of Bayesian procedures for high-dimensional Gaussian sparse regression when unknown nuisance parameters are involved. Nuisance parameters can be finite-, high-, or infinite-dimensional. A mixture…

Statistics Theory · Mathematics 2021-02-18 Seonghyun Jeong , Subhashis Ghosal

The classical condition on the existence of uniformly exponentially consistent tests for testing the true density against the complement of its arbitrary neighborhood has been widely adopted in study of asymptotics of Bayesian nonparametric…

Statistics Theory · Mathematics 2008-12-01 Yang Xing

We investigate the asymptotic behavior of posterior distributions of regression coefficients in high-dimensional linear models as the number of dimensions grows with the number of observations. We show that the posterior distribution…

Methodology · Statistics 2018-03-06 Artin Armagan , David B. Dunson , Jaeyong Lee , Waheed U. Bajwa , Nate Strawn

We introduce a novel framework for uncertainty quantification in clustering that combines martingale posterior distributions with density-based clustering. Unlike classical model-based approaches, which define clusters at the latent level…

Machine Learning · Statistics 2026-04-20 Nicola Bariletto , Stephen G. Walker

We review recent advances in modal regression studies using kernel density estimation. Modal regression is an alternative approach for investigating relationship between a response variable and its covariates. Specifically, modal regression…

Methodology · Statistics 2017-12-08 Yen-Chi Chen

Estimating the mixing density of a latent mixture model is an important task in signal processing. Nonparametric maximum likelihood estimation is one popular approach to this problem. If the latent variable distribution is assumed to be…

Methodology · Statistics 2024-03-01 Shijie Wang , Minsuk Shin , Ray Bai