English
Related papers

Related papers: On Posterior Concentration in Misspecified Models

200 papers

We present a new approach to semiparametric inference using corrected posterior distributions. The method allows us to leverage the adaptivity, regularization and predictive power of nonparametric Bayesian procedures to estimate…

Methodology · Statistics 2023-06-21 Andrew Yiu , Edwin Fong , Chris Holmes , Judith Rousseau

In Simulation-based Inference, the goal is to solve the inverse problem when the likelihood is only known implicitly. Neural Posterior Estimation commonly fits a normalized density estimator as a surrogate model for the posterior. This…

Machine Learning · Statistics 2023-10-04 Benjamin Kurt Miller , Marco Federici , Christoph Weniger , Patrick Forré

We study the asymptotic behaviour of the posterior distribution in a broad class of statistical models where the "true" solution occurs on the boundary of the parameter space. We show that in this case Bayesian inference is consistent, and…

Statistics Theory · Mathematics 2014-10-02 Natalia A. Bochkina , Peter J. Green

This paper addresses the problem of summarizing the posterior distributions that typically arise, in a Bayesian framework, when dealing with signal decomposition problems with unknown number of components. Such posterior distributions are…

Computation · Statistics 2011-11-29 Alireza Roodaki , Julien Bect , Gilles Fleury

Bayesian nonparametric statistics is an area of considerable research interest. While recently there has been an extensive concentration in developing Bayesian nonparametric procedures for model checking, the use of the Dirichlet process,…

Statistics Theory · Mathematics 2019-03-15 Luai Al-Labadi , Viskakh Patel , Kasra Vakiloroayaei , Clement Wan

We study the problem of closeness testing for continuous distributions and its implications for causal discovery. Specifically, we analyze the sample complexity of distinguishing whether two multidimensional continuous distributions are…

Machine Learning · Computer Science 2025-03-11 Fateme Jamshidi , Sina Akbari , Negar Kiyavash

Variational Bayes (VB) is a scalable alternative to Markov chain Monte Carlo (MCMC) for Bayesian posterior inference. Though popular, VB comes with few theoretical guarantees, most of which focus on well-specified models. However, models…

Machine Learning · Statistics 2020-08-13 Yixin Wang , David M. Blei

We consider the problem of predictive density estimation under Kullback-Leibler loss in a high-dimensional Gaussian model with exact sparsity constraints on the location parameters. We study the first order asymptotic minimax risk of Bayes…

Statistics Theory · Mathematics 2019-05-24 Ujan Gangopadhyay , Gourab Mukherjee

This paper considers a Bayesian approach for inclusion detection in nonlinear inverse problems using two known and popular push-forward prior distributions: the star-shaped and level set prior distributions. We analyze the convergence of…

Statistics Theory · Mathematics 2023-08-29 Babak Maboudi Afkham , Kim Knudsen , Aksel Kaastrup Rasmussen , Tanja Tarvainen

Bayesian predictive inference propagates parameter uncertainty to quantities of interest through the posterior-predictive distribution. In practice, this is typically performed using a two-stage procedure: first approximating the posterior…

Machine Learning · Statistics 2026-05-06 Nan Feng , Xun Huan

We propose a method to fuse posterior distributions learned from heterogeneous datasets. Our algorithm relies on a mean field assumption for both the fused model and the individual dataset posteriors and proceeds using a simple…

Machine Learning · Computer Science 2020-07-14 Sebastian Claici , Mikhail Yurochkin , Soumya Ghosh , Justin Solomon

We analyze the behavior of approximate Bayesian computation (ABC) when the model generating the simulated data differs from the actual data generating process; i.e., when the data simulator in ABC is misspecified. We demonstrate both…

Statistics Theory · Mathematics 2020-12-17 David T. Frazier , Christian P. Robert , Judith Rousseau

Although Bayesian inference is an immensely popular paradigm among a large segment of scientists including statisticians, most applications consider objective priors and need critical investigations (Efron, 2013, Science). While it has…

Statistics Theory · Mathematics 2020-09-11 Abhik Ghosh , Tuhin Majumder , Ayanendranath Basu

We propose a general method to carry out a valid Bayesian analysis of a finite-dimensional `targeted' parameter in the presence of a finite-dimensional nuisance parameter. We apply our methods to causal inference based on estimating…

Methodology · Statistics 2026-02-03 Magid Sabbagh , David A. Stephens

Consider semiparametric models that display local asymptotic exponentiality (Ibragimov and Has'minskii (1981)), an asymptotic property of the likelihood associated with discontinuities of densities. Our interest goes to estimation of the…

Statistics Theory · Mathematics 2013-12-19 Bas Kleijn , Bartek Knapik

The Bayesian predictive density has complex representation and does not belong to any finite-dimensional statistical model except for in limited situations. In this paper, we introduce its simple approximate representation employing its…

Statistics Theory · Mathematics 2020-10-30 Michiko Okudo , Fumiyasu Komaki

Posterior contractions rates (PCRs) strengthen the notion of Bayesian consistency, quantifying the speed at which the posterior distribution concentrates on arbitrarily small neighborhoods of the true model, with probability tending to 1 or…

Statistics Theory · Mathematics 2022-01-31 Federico Camerlenghi , Emanuele Dolera , Stefano Favaro , Edoardo Mainini

Posterior distributions arising in ill-posed Bayesian inverse problems are often both analytically intractable and highly sensitive to parameters of the chosen prior family. We aim to understand the sensitivity of intractable posterior…

Methodology · Statistics 2026-04-20 Yucong Liu , Zilai Si , Alexander Strang

In this paper, we investigate the asymptotic properties of nonparametric Bayesian mixtures of Betas for estimating a smooth density on $[0,1]$. We consider a parametrization of Beta distributions in terms of mean and scale parameters and…

Statistics Theory · Mathematics 2010-01-12 Judith Rousseau

Recent advances in deep learning have brought to the fore models that can make multiple computational steps in the service of completing a task; these are capable of describ- ing long-term dependencies in sequential data. Novel recurrent…

Machine Learning · Computer Science 2018-09-06 Kyriakos Tolias , Sotirios Chatzis
‹ Prev 1 3 4 5 6 7 10 Next ›