English
Related papers

Related papers: Bernstein - von Mises Theorem for growing paramete…

200 papers

Learning suitable latent representations for observed, high-dimensional data is an important research topic underlying many recent advances in machine learning. While traditionally the Gaussian normal distribution has been the go-to latent…

Machine Learning · Statistics 2019-10-08 Tim R. Davidson , Jakub M. Tomczak , Efstratios Gavves

This is a review of asymptotic and non-asymptotic behaviour of Bayesian methods under model specification. In particular we focus on consistency, i.e. convergence of the posterior distribution to the point mass at the best parametric…

Statistics Theory · Mathematics 2023-11-21 Natalia Bochkina

Our interest is whether two binomial parameters differ, which parameter is larger, and by how much. This apparently simple problem was addressed by Fisher in the 1930's, and has been the subject of many review papers since then. Yet there…

Methodology · Statistics 2021-04-20 Michael P. Fay , Sally A. Hunsberger

The major goal of this paper is to study the second order frequentist properties of the marginal posterior distribution of the parametric component in semiparametric Bayesian models, in particular, a second order semiparametric…

Statistics Theory · Mathematics 2015-03-17 Yun Yang , Guang Cheng , David B. Dunson

The inferential model (IM) framework offers an alternative to the classical probabilistic (e.g., Bayesian and fiducial) uncertainty quantification in statistical inference. A key distinction is that classical uncertainty quantification…

Statistics Theory · Mathematics 2025-07-15 Ryan Martin , Jonathan P. Williams

This paper revisits the classical inference results for profile quasi maximum likelihood estimators (profile MLE) in the semiparametric estimation problem. We mainly focus on two prominent theorems: the Wilks phenomenon and Fisher expansion…

Statistics Theory · Mathematics 2014-06-18 Andreas Andresen , Vladimir Spokoiny

We demonstrate that a prior influence on the posterior distribution of covariance matrix vanishes as sample size grows. The assumptions on a prior are explicit and mild. The results are valid for a finite sample and admit the dimension $p$…

Statistics Theory · Mathematics 2019-06-28 Igor Silin

I prove a semiparametric Bernstein-von Mises theorem for a partially linear regression model with independent priors for the low-dimensional parameter of interest and the infinite-dimensional nuisance parameters. My result avoids a…

Statistics Theory · Mathematics 2025-04-08 Christopher D. Walker

We consider the efficient inference of finite dimensional parameters arising in the context of inverse problems. Our setup is the observation of a transformation of an unknown infinite dimensional signal $f$ corrupted by statistical noise,…

Statistics Theory · Mathematics 2026-02-03 Adel Magra , Aad van der Vaart

Semiparametric mixture models are parametric models with latent variables. They are defined kernel, $p_\theta(x | z)$, where z is the unknown latent variable, and $\theta$ is the parameter of interest. We assume that the latent variables…

Statistics Theory · Mathematics 2024-12-03 Stefan Franssen , Jeanne Nguyen , Aad van der Vaart

This paper aims to examine the characteristics of the posterior distribution of covariance/precision matrices in a "large $p$, large $n$" scenario, where $p$ represents the number of variables and $n$ is the sample size. Our analysis…

Statistics Theory · Mathematics 2026-02-02 Partha Sarkar , Kshitij Khare , Malay Ghosh , Matt P. Wand

We establish a general semiparametric Bernstein-von Mises theorem for Bayesian nonparametric priors based on continuous observations in a periodic reversible multidimensional diffusion model. We consider a wide range of functionals…

Statistics Theory · Mathematics 2025-05-23 Matteo Giordano , Kolyan Ray

An established and growing literature on generalized fiducial inference and related fiducial ideas points to the adoption of fiducial inference as a mainstream perspective among modern statisticians. Like Bayesian posteriors, generalized…

Statistics Theory · Mathematics 2026-03-03 J. E. Borgert , Jan Hannig

We consider a sparse linear regression model with unknown symmetric error under the high-dimensional setting. The true error distribution is assumed to belong to the locally $\beta$-H\"{o}lder class with an exponentially decreasing tail,…

Statistics Theory · Mathematics 2020-09-01 Kyoungjae Lee , Minwoo Chae , Lizhen Lin

Ordinary differential equations (ODEs) are used to model dynamic systems appearing in engineering, physics, biomedical sciences and many other fields. These equations contain unknown parameters, say $\bm\theta$ of physical significance…

Statistics Theory · Mathematics 2014-11-05 Prithwish Bhaumik , Subhashis Ghosal

Estimation of the population size $n$ from $k$ i.i.d.\ binomial observations with unknown success probability $p$ is relevant to a multitude of applications and has a long history. Without additional prior information this is a notoriously…

We establish a general Bernstein--von Mises theorem for approximately linear semiparametric functionals of fractional posterior distributions based on nonparametric priors. This is illustrated in a number of nonparametric settings and for…

Statistics Theory · Mathematics 2025-08-12 Alice L'Huillier , Luke Travis , Ismaël Castillo , Kolyan Ray

We consider an infinite-dimensional Gaussian regression model, equipped with a high-dimensional Gaussian prior. We address the frequentist validity of posterior credible sets for a vector of linear functionals. We specify conditions for a…

Statistics Theory · Mathematics 2024-11-12 Gustav Rømer

A fully Bayesian approach is proposed for ultrahigh-dimensional nonparametric additive models in which the number of additive components may be larger than the sample size, though ideally the true model is believed to include only a small…

Methodology · Statistics 2013-09-24 Zuofeng Shang , Ping Li

This note attempts to revisit the classical results on Laplace approximation in a modern non-asymptotic and dimension free form. Such an extension is motivated by applications to high dimensional statistical and optimization problems. The…

Statistics Theory · Mathematics 2022-12-13 Vladimir Spokoiny