English
Related papers

Related papers: General Robust Bayes Pseudo-Posterior: Exponential…

200 papers

In this paper, we study the learning rate of generalized Bayes estimators in a general setting where the hypothesis class can be uncountable and have an irregular shape, the loss function can have heavy tails, and the optimal hypothesis may…

Statistics Theory · Mathematics 2021-11-22 Lam Si Tung Ho , Binh T. Nguyen , Vu Dinh , Duy Nguyen

The Bayesian lasso is well-known as a Bayesian alternative for Lasso. Although the advantage of the Bayesian lasso is capable of full probabilistic uncertain quantification for parameters, the corresponding posterior distribution can be…

Methodology · Statistics 2022-07-06 Jun Kawakami , Shintaro Hashimoto

Bayesian simulation-based inference (SBI) methods are used in statistical models where simulation is feasible but the likelihood is intractable. Standard SBI methods can perform poorly in cases of model misspecification, and there has been…

Methodology · Statistics 2025-04-15 Wang Yuyan , Michael Evans , David J. Nott

Principal component regression uses principal components as regressors. It is particularly useful in prediction settings with high-dimensional covariates. The existing literature treating of Bayesian approaches is relatively sparse. We…

Methodology · Statistics 2020-01-28 Philippe Gagnon , Mylène Bédard , Alain Desgagné

We propose a new empirical Bayes approach for inference in the $p \gg n$ normal linear model. The novelty is the use of data in the prior in two ways, for centering and regularization. Under suitable sparsity assumptions, we establish a…

Statistics Theory · Mathematics 2018-12-06 Ryan Martin , Raymond Mess , Stephen G. Walker

Bayesian inference usually requires running potentially costly inference procedures separately for every new observation. In contrast, the idea of amortized Bayesian inference is to initially invest computational cost in training an…

Machine Learning · Computer Science 2023-05-25 Manuel Glöckler , Michael Deistler , Jakob H. Macke

Whole robustness is a nice property to have for statistical models. It implies that the impact of outliers gradually vanishes as they approach plus or minus infinity. So far, the Bayesian literature provides results that ensure whole…

Methodology · Statistics 2018-08-14 Alain Desgagné , Philippe Gagnon

The proposed approach extends the confidence posterior distribution to the semi-parametric empirical Bayes setting. Whereas the Bayesian posterior is defined in terms of a prior distribution conditional on the observed data, the confidence…

Methodology · Statistics 2012-05-02 David R. Bickel

Bayesian inference requires specification of a single, precise prior distribution, whereas frequentist inference only accommodates a vacuous prior. Since virtually every real-world application falls somewhere in between these two extremes,…

Methodology · Statistics 2023-09-26 Ryan Martin

We study the stability of posterior predictive inferences to the specification of the likelihood model and perturbations of the data generating process. In modern big data analyses, useful broad structural judgements may be elicited from…

Methodology · Statistics 2024-04-30 Jack Jewson , Jim Q. Smith , Chris Holmes

Models with dimension more than the available sample size are now commonly used in various applications. A sensible inference is possible using a lower-dimensional structure. In regression problems with a large number of predictors, the…

Statistics Theory · Mathematics 2025-11-25 Sayantan Banerjee , Ismaël Castillo , Subhashis Ghosal

There has been significant progress in Bayesian inference based on sparsity-inducing (e.g., spike-and-slab and horseshoe-type) priors for high-dimensional regression models. The resulting posteriors, however, in general do not possess…

Econometrics · Economics 2025-12-11 Qihui Chen , Zheng Fang , Ruixuan Liu

When prior information is lacking, the go-to strategy for probabilistic inference is to combine a "default prior" and the likelihood via Bayes's theorem. Objective Bayes, (generalized) fiducial inference, etc. fall under this umbrella. This…

Methodology · Statistics 2026-01-05 Ryan Martin

Robust Bayesian inference is the calculation of posterior probability bounds given perturbations in a probabilistic model. This paper focuses on perturbations that can be expressed locally in Bayesian networks through convex sets of…

Artificial Intelligence · Computer Science 2013-02-08 Fabio Gagliardi Cozman

The Bayesian approach provides powerful methods for variable selection. The ability to incorporate sparsity through prior beliefs and account for parameter uncertainty allows Bayesian variable selection to consistently identify which of the…

Methodology · Statistics 2026-03-05 Beniamino Hadj-Amar , Jack Jewson

One of the main approaches used to construct prior distributions for objective Bayes methods is the concept of random imaginary observations. Under this setup, the expected-posterior prior (EPP) offers several advantages, among which it has…

Methodology · Statistics 2020-10-09 Dimitris Fouskakis , Ioannis Ntzoufras

We propose a general solution to the problem of robust Bayesian inference in complex settings where outliers may be present. In practice, the automation of robust Bayesian analyses is important in the many applications involving large and…

Methodology · Statistics 2022-04-15 Jeremie Houssineau , David J. Nott

Generalized linear models (GLMs) are routinely used for modeling relationships between a response variable and a set of covariates. The simple form of a GLM comes with easy interpretability, but also leads to concerns about model…

Methodology · Statistics 2023-11-10 Davide Agnoletto , Tommaso Rigon , David B. Dunson

We present a new approach to semiparametric inference using corrected posterior distributions. The method allows us to leverage the adaptivity, regularization and predictive power of nonparametric Bayesian procedures to estimate…

Methodology · Statistics 2023-06-21 Andrew Yiu , Edwin Fong , Chris Holmes , Judith Rousseau

This paper is concerned with Bayesian inferential methods for data from controlled branching processes that account for model robustness through the use of disparities. Under regularity conditions, we establish that estimators built on…

Methodology · Statistics 2018-02-19 M. González , C. Minuesa , I. del Puerto , A. N. Vidyashankar