English
Related papers

Related papers: Bernstein von-Mises Theorem for g-prior and nonloc…

200 papers

In this work we discuss a novel model prior probability for variable selection in linear regression. The idea is to determine the prior mass in an objective sense, by considering the worth of each of the possible regression models, given…

Methodology · Statistics 2015-12-29 Cristiano Villa , Jeong Eun Lee

We introduce a novel Bayesian estimator for the class proportion in an unlabeled dataset, based on the targeted learning framework. Our procedure requires the specification of a prior (and outputs a posterior) only for the target of…

Methodology · Statistics 2019-11-26 Iván Díaz , Oleksander Savenkov , Hooman Kamel

In the setting of nonparametric multivariate regression with unknown error variance, we study asymptotic properties of a Bayesian method for estimating a regression function f and its mixed partial derivatives. We use a random series of…

Statistics Theory · Mathematics 2016-04-13 William Weimin Yoo , Subhashis Ghosal

Bayesian online learning provides a coherent framework for sequential inference. However, its theoretical understanding remains limited, particularly in the one-pass setting. Existing theoretical guarantees typically require the mini-batch…

Statistics Theory · Mathematics 2026-05-01 Jeyong Lee , Junhyeok Choi , Dongguen Kim , Minwoo Chae

We propose a scalable variational Bayes method for statistical inference for a single or low-dimensional subset of the coordinates of a high-dimensional parameter in sparse linear regression. Our approach relies on assigning a mean-field…

Machine Learning · Statistics 2025-08-12 Ismaël Castillo , Alice L'Huillier , Kolyan Ray , Luke Travis

In Bayesian hypothesis testing and model selection, prior distributions must be chosen carefully. For example, setting arbitrarily large prior scales for location parameters, which is common practice in estimation problems, can lead to…

Statistics Theory · Mathematics 2019-11-25 Víctor Peña , James O. Berger

We study nonparametric Bayesian statistical inference for the parameters governing a pure jump process of the form $$Y_t = \sum_{k=1}^{N(t)} Z_k,~~~ t \ge 0,$$ where $N(t)$ is a standard Poisson process of intensity $\lambda$, and $Z_k$ are…

Statistics Theory · Mathematics 2019-10-02 Richard Nickl , Jakob Söhl

In statistical inference, uncertainty is unknown and all models are wrong. That is to say, a person who makes a statistical model and a prior distribution is simultaneously aware that both are fictional candidates. To study such cases,…

Machine Learning · Computer Science 2023-02-13 Sumio Watanabe

In this note we consider the stability of posterior measures occuring in Bayesian inference w.r.t. perturbations of the prior measure and the log-likelihood function. This extends the well-posedness analysis of Bayesian inverse problems. In…

Statistics Theory · Mathematics 2020-06-24 Björn Sprungk

Bayesian inversion is central to the quantification of uncertainty within problems arising from numerous applications in science and engineering. To formulate the approach, four ingredients are required: a forward model mapping the unknown…

Machine Learning · Statistics 2025-05-15 O. Deniz Akyildiz , Mark Girolami , Andrew M. Stuart , Arnaud Vadeboncoeur

The use of improper priors in the context of Bayesian hierarchical linear mixed models has been studied under the assumption of normality of the random effects. We study the propriety of the posterior under more flexible distributional…

Statistics Theory · Mathematics 2014-09-24 F. J. Rubio

Variable selection over a potentially large set of covariates in a linear model is quite popular. In the Bayesian context, common prior choices can lead to a posterior expectation of the regression coefficients that is a sparse (or nearly…

Methodology · Statistics 2025-12-02 Debamita Kundu , Riten Mitra , Jeremy T. Gaskins

The inferential model (IM) framework offers an alternative to the classical probabilistic (e.g., Bayesian and fiducial) uncertainty quantification in statistical inference. A key distinction is that classical uncertainty quantification…

Statistics Theory · Mathematics 2025-07-15 Ryan Martin , Jonathan P. Williams

We study nonparametric Bayesian models for reversible multi-dimensional diffusions with periodic drift. For continuous observation paths, reversibility is exploited to prove a general posterior contraction rate theorem for the drift…

Statistics Theory · Mathematics 2024-08-02 Matteo Giordano , Kolyan Ray

In this paper we prove an estimate for the total variation distance, in the framework of the Breuer-Major theorem, using the Malliavin-Stein method, assuming the underlying function $g$ to be once weakly differentiable with $g$ and $g'$…

Probability · Mathematics 2019-07-12 Ivan Nourdin , David Nualart , Giovanni Peccati

We study high-dimensional Bayesian linear regression with product priors. Using the nascent theory of non-linear large deviations (Chatterjee and Dembo,2016), we derive sufficient conditions for the leading-order correctness of the naive…

Statistics Theory · Mathematics 2021-04-27 Sumit Mukherjee , Subhabrata Sen

The linear regression models are widely used statistical techniques in numerous practical applications. The standard regression model requires several assumptions about the regres- sors and the error term. The regression parameters are…

Methodology · Statistics 2016-10-23 P. Vellaisamy

A Bayesian hierarchical model for total variation regularisation is presented in this paper. All the parameters of an inverse problem, including the "regularisation parameter", are estimated simultaneously from the data in the model. The…

Numerical Analysis · Mathematics 2014-12-16 Marko Järvenpää , Robert Piché

We propose a family of variational approximations to Bayesian posterior distributions, called $\alpha$-VB, with provable statistical guarantees. The standard variational approximation is a special case of $\alpha$-VB with $\alpha=1$. When…

Statistics Theory · Mathematics 2018-02-09 Yun Yang , Debdeep Pati , Anirban Bhattacharya

Bayesian field theory denotes a nonparametric Bayesian approach for learning functions from observational data. Based on the principles of Bayesian statistics, a particular Bayesian field theory is defined by combining two models: a…

Data Analysis, Statistics and Probability · Physics 2007-05-23 J. C. Lemm