English
Related papers

Related papers: Adaptive Bayesian estimation using a Gaussian rand…

200 papers

Gaussian process is a theoretically appealing model for nonparametric analysis, but its computational cumbersomeness hinders its use in large scale and the existing reduced-rank solutions are usually heuristic. In this work, we propose a…

Machine Learning · Statistics 2015-11-25 Leo L. Duan , Xia Wang , Rhonda D. Szczesniak

We present asymptotic results for the regression-adjusted version of approximate Bayesian computation introduced by Beaumont(2002). We show that for an appropriate choice of the bandwidth, regression adjustment will lead to a posterior…

Statistics Theory · Mathematics 2017-11-29 Wentao Li , Paul Fearnhead

It is not always clear how to adjust for control data in causal inference, balancing the goals of reducing bias and variance. We show how, in a setting with repeated experiments, Bayesian hierarchical modeling yields an adaptive procedure…

Methodology · Statistics 2025-01-23 Andrew Gelman , Matthijs Vákár

In this article, we study the binary classification problem with supervised data, in the case where the covariate-to-probability-of-success map is possibly spatially inhomogeneous. We devise nonparametric Bayesian procedures with…

Statistics Theory · Mathematics 2025-09-10 Matteo Giordano

We study the performance of nonparametric Bayes procedures for one-dimensional diffusions with periodic drift. We improve existing convergence rate results for Gaussian process (GP) priors with fixed hyper parameters. Moreover, we exhibit…

Statistics Theory · Mathematics 2017-06-15 Jan van Waaij , Harry van Zanten

Nonparametric Bayesian models are used routinely as flexible and powerful models of complex data. Many times, a statistician may have additional informative beliefs about data distribution of interest, e.g., its mean or subset components,…

Methodology · Statistics 2022-11-08 Bingjing Tang , Vinayak Rao

We study the rate of Bayesian consistency for hierarchical priors consisting of prior weights on a model index set and a prior on a density model for each choice of model index. Ghosal, Lember and Van der Vaart [2] have obtained general…

Statistics Theory · Mathematics 2008-09-23 Yang Xing

Inverse problems, i.e., estimating parameters of physical models from experimental data, are ubiquitous in science and engineering. The Bayesian formulation is the gold standard because it alleviates ill-posedness issues and quantifies…

Machine Learning · Statistics 2024-05-28 Sharmila Karumuri , Ilias Bilionis

We propose a new Bayesian strategy for adaptation to smoothness in nonparametric models based on heavy tailed series priors. We illustrate it in a variety of settings, showing in particular that the corresponding Bayesian posterior…

Statistics Theory · Mathematics 2024-05-30 Sergios Agapiou , Ismaël Castillo

Bayesian imaging inverse problems in astrophysics and cosmology remain challenging, particularly in low-data regimes, due to complex forward operators and the frequent lack of well-motivated priors for non-Gaussian signals. In this paper,…

Instrumentation and Methods for Astrophysics · Physics 2026-02-06 Sébastien Pierre , Erwan Allys , Pablo Richard , Roman Soletskyi , Alexandros Tsouros

For $\mathcal{O}$ a bounded domain in $\mathbb{R}^d$ and a given smooth function $g:\mathcal{O}\to\mathbb{R}$, we consider the statistical nonlinear inverse problem of recovering the conductivity $f>0$ in the divergence form equation $$…

Statistics Theory · Mathematics 2020-03-09 Matteo Giordano , Richard Nickl

We consider priors for several nonparametric Bayesian models which use finite random series with a random number of terms. The prior is constructed through distributions on the number of basis functions and the associated coefficients. We…

Statistics Theory · Mathematics 2015-02-10 Weining Shen , Subhashis Ghosal

We study full Bayesian procedures for high-dimensional linear regression under sparsity constraints. The prior is a mixture of point masses at zero and continuous distributions. Under compatibility conditions on the design matrix, the…

Statistics Theory · Mathematics 2015-10-15 Ismaël Castillo , Johannes Schmidt-Hieber , Aad van der Vaart

Variational Bayesian Inference is a popular methodology for approximating posterior distributions over Bayesian neural network weights. Recent work developing this class of methods has explored ever richer parameterizations of the…

While Bayesian inference provides a principled framework for reasoning under uncertainty, its widespread adoption is limited by the intractability of exact posterior computation, necessitating the use of approximate inference. However,…

Machine Learning · Statistics 2026-05-19 George Whittle , Juliusz Ziomek , Jacob Rawling , Maike A. Osborne

This paper presents an efficient Bayesian framework for solving nonlinear, high-dimensional model calibration problems. It is based on a Variational Bayesian formulation that aims at approximating the exact posterior by means of solving an…

Applications · Statistics 2015-11-02 Isabell M. Franck , P. S. Koutsourelakis

Statistical inference with nonresponse is quite challenging, especially when the response mechanism is nonignorable. In this case, the validity of statistical inference depends on untestable correct specification of the response model. To…

Methodology · Statistics 2021-01-15 Shonosuke Sugasawa , Kosuke Morikawa , Keisuke Takahata

Bayesian hierarchical models can provide efficient algorithms for finding sparse solutions to ill-posed inverse problems. The models typically comprise a conditionally Gaussian prior model for the unknown which is augmented by a generalized…

Numerical Analysis · Mathematics 2025-01-09 Jonathan Lindbloom , Jan Glaubitz , Anne Gelb

We introduce a methodology for nonlinear inverse problems using a variational Bayesian approach where the unknown quantity is a spatial field. A structured Bayesian Gaussian process latent variable model is used both to construct a…

Machine Learning · Statistics 2019-02-20 Steven Atkinson , Nicholas Zabaras

Recently nonparametric functional model with functional responses has been proposed within the functional reproducing kernel Hilbert spaces (fRKHS) framework. Motivated by its superior performance and also its limitations, we propose a…

Methodology · Statistics 2010-08-11 Heng Lian