English
Related papers

Related papers: Bayesian Analysis of Simple Random Densities

200 papers

We propose a new empirical Bayes approach for inference in the $p \gg n$ normal linear model. The novelty is the use of data in the prior in two ways, for centering and regularization. Under suitable sparsity assumptions, we establish a…

Statistics Theory · Mathematics 2018-12-06 Ryan Martin , Raymond Mess , Stephen G. Walker

In solving Bayesian inverse problems, it is often desirable to use a common density parameterization to denote the prior and posterior. Typically we seek a density from the same family as the prior which closely approximates the true…

Numerical Analysis · Mathematics 2022-03-29 Xiao-Mei Yang , Zhi-Liang Deng

Using the linear Gaussian latent variable model as a starting point we relax some of the constraints it imposes by deriving a nonparametric latent feature Gaussian variable model. This model introduces additional discrete latent variables…

Machine Learning · Statistics 2019-05-28 Adam Farooq , Yordan P. Raykov , Luc Evers , Max A. Little

Linear mixed-effects models are a central analytical tool for modeling hierarchical and longitudinal data, as they allow simultaneous representation of fixed and random sources of variation. In practice, inference for such models is most…

Methodology · Statistics 2026-02-12 Hilde Vinje , Lars Erik Gangsei

We provide a general solution to a fundamental open problem in Bayesian inference, namely poor uncertainty quantification, from a frequency standpoint, of Bayesian methods in misspecified models. While existing solutions are based on…

Methodology · Statistics 2023-02-14 David T. Frazier , Robert Kohn , Christopher Drovandi , David Gunawan

This paper considers the problem of computing Bayesian estimates of both states and model parameters for nonlinear state-space models. Generally, this problem does not have a tractable solution and approximations must be utilised. In this…

Machine Learning · Statistics 2020-12-15 Jarrad Courts , Johannes Hendriks , Adrian Wills , Thomas Schön , Brett Ninness

Bernstein-von Mises theorems for nonparametric Bayes priors in the Gaussian white noise model are proved. It is demonstrated how such results justify Bayes methods as efficient frequentist inference procedures in a variety of concrete…

Statistics Theory · Mathematics 2013-11-01 Ismaël Castillo , Richard Nickl

We consider heteroscedastic nonparametric regression models, when both the mean function and variance function are unknown and to be estimated with nonparametric approaches. We derive convergence rates of posterior distributions for this…

Statistics Theory · Mathematics 2010-10-07 Yuao Hu

In this paper we present decomposable priors, a family of priors over structure and parameters of tree belief nets for which Bayesian learning with complete observations is tractable, in the sense that the posterior is also decomposable and…

Machine Learning · Computer Science 2013-01-18 Marina Meila , Tommi S. Jaakkola

A novel approximate Bayesian filter based on backward stochastic differential equations is introduced. It uses a nonlinear Feynman--Kac representation of the filtering problem and the approximation of an unnormalized filtering density using…

Numerical Analysis · Mathematics 2026-04-21 Kasper Bågmark , Adam Andersson , Stig Larsson

We study the sample complexity of Bayesian recovery for solving inverse problems with general prior, forward operator and noise distributions. We consider posterior sampling according to an approximate prior $\mathcal{P}$, and establish…

Machine Learning · Computer Science 2025-12-02 Ben Adcock , Nick Huang

We consider nonparametric Bayesian estimation inference using a rescaled smooth Gaussian field as a prior for a multidimensional function. The rescaling is achieved using a Gamma variable and the procedure can be viewed as choosing an…

Statistics Theory · Mathematics 2009-08-26 A. W. van der Vaart , J. H. van Zanten

Bayesian shrinkage methods have generated a lot of recent interest as tools for high-dimensional regression and model selection. These methods naturally facilitate tractable uncertainty quantification and incorporation of prior information.…

Computation · Statistics 2017-04-17 Bala Rajaratnam , Doug Sparks , Kshitij Khare , Liyuan Zhang

Approximate Bayesian Computation (ABC) is typically used when the likelihood is either unavailable or intractable but where data can be simulated under different parameter settings using a forward model. Despite the recent interest in ABC,…

Methodology · Statistics 2019-12-24 Rafael Izbicki , Ann B. Lee , Taylor Pospisil

A Bayesian approach to the classification problem is proposed in which random partitions play a central role. It is argued that the partitioning approach has the capacity to take advantage of a variety of large-scale spatial structures, if…

Statistics Theory · Mathematics 2007-06-13 Marc A. Coram

We evaluate priors by the second order asymptotic behavior of the corresponding estimators.Under certain regularity conditions, the risk differences between efficient estimators of parameters taking values in a domain D, an open connected…

Statistics Theory · Mathematics 2010-03-08 J. A. Hartigan

We propose a novel Bayesian model selection technique on linear mixed-effects models to compare multiple treatments with a control. A fully Bayesian approach is implemented to estimate the marginal inclusion probabilities that provide a…

Applications · Statistics 2015-09-28 Lei Gong , James M. Flegal , Stephen R. Spindler , Patricia L. Mote

We consider the problem of boundary detection for areal data, focusing on situations where for each areal unit multiple observations are available. We propose a Bayesian nonparametric mixture model for the area-specific population…

Methodology · Statistics 2026-05-18 Matteo Gianella , Mario Beraha , Alessandra Guglielmi

Optimality results for two outstanding Bayesian estimation problems are given in this paper: the estimation of the sampling distribution for the squared total variation function and the estimation of the density for the $L^1$-squared loss…

Statistics Theory · Mathematics 2021-10-28 A. G. Nogales

This paper presents an efficient Bayesian framework for solving nonlinear, high-dimensional model calibration problems. It is based on a Variational Bayesian formulation that aims at approximating the exact posterior by means of solving an…

Applications · Statistics 2015-11-02 Isabell M. Franck , P. S. Koutsourelakis