English
Related papers

Related papers: Empirical Bayes posterior concentration in sparse …

200 papers

We introduce a novel Bayesian approach for both covariate selection and sparse precision matrix estimation in the context of high-dimensional Gaussian graphical models involving multiple responses. Our approach provides a sparse estimation…

Methodology · Statistics 2024-09-25 Anwesha Chakravarti , Naveen N. Narishetty , Feng Liang

Constraints are a natural choice for prior information in Bayesian inference. In various applications, the parameters of interest lie on the boundary of the constraint set. In this paper, we use a method that implicitly defines a…

Statistics Theory · Mathematics 2022-09-27 Jasper Marijn Everink , Yiqiu Dong , Martin Skovgaard Andersen

We study objective Bayesian inference for linear regression models with residual errors distributed according to the class of two-piece scale mixtures of normal distributions. These models allow for capturing departures from the usual…

Applications · Statistics 2016-05-09 F. J. Rubio , K. Yu

We introduce a general framework that extends Bayesian inference by allowing the researcher to explicitly encode confidence in each source of uncertainty within the model. This mechanism provides a new handle for model design and…

Methodology · Statistics 2026-05-06 Rafael Mouallem Rosa , Julyan Arbel , Hien Duy Nguyen

Inference after model selection has been an active research topic in the past few years, with numerous works offering different approaches to addressing the perils of the reuse of data. In particular, major progress has been made recently…

Methodology · Statistics 2020-06-02 Snigdha Panigrahi , Jonathan Taylor , Asaf Weinstein

This paper presents an efficient Bayesian framework for solving nonlinear, high-dimensional model calibration problems. It is based on a Variational Bayesian formulation that aims at approximating the exact posterior by means of solving an…

Applications · Statistics 2015-11-02 Isabell M. Franck , P. S. Koutsourelakis

The fairness of a deep neural network is strongly affected by dataset bias and spurious correlations, both of which are usually present in modern feature-rich and complex visual datasets. Due to the difficulty and variability of the task,…

Computer Vision and Pattern Recognition · Computer Science 2024-02-28 Rebecca S Stone , Nishant Ravikumar , Andrew J Bulpitt , David C Hogg

In this paper we develop a novel approach for estimating large and sparse dynamic factor models using variational inference, also allowing for missing data. Inspired by Bayesian variable selection, we apply slab-and-spike priors onto the…

Methodology · Statistics 2022-10-14 Erik Spånberg

We study empirical Bayes estimation in high-dimensional linear regression. To facilitate computationally efficient estimation of the underlying prior, we adopt a variational empirical Bayes approach, introduced originally in Carbonetto and…

Statistics Theory · Mathematics 2023-10-27 Sumit Mukherjee , Bodhisattva Sen , Subhabrata Sen

We reconsider a nonparametric density model based on Gaussian processes. By augmenting the model with latent P\'olya--Gamma random variables and a latent marked Poisson process we obtain a new likelihood which is conjugate to the model's…

Machine Learning · Statistics 2018-05-30 Christian Donner , Manfred Opper

In the sparse normal means model, coverage of adaptive Bayesian posterior credible sets associated to spike and slab prior distributions is considered. The key sparsity hyperparameter is calibrated via marginal maximum likelihood empirical…

Statistics Theory · Mathematics 2019-02-05 Ismael Castillo , Botond Szabo

Ising models originated in statistical physics and are widely used in modeling spatial data and computer vision problems. However, statistical inference of this model remains challenging due to intractable nature of the normalizing constant…

Methodology · Statistics 2021-09-06 Minwoo Kim , Shrijita Bhattacharya , Tapabrata Maiti

Data dispersed across multiple files are commonly integrated through probabilistic linkage methods, where even minimal error rates in record matching can significantly contaminate subsequent statistical analyses. In regression problems, we…

Statistics Theory · Mathematics 2024-09-18 Abhisek Chakraborty , Saptati Datta

We investigate an empirical Bayesian nonparametric approach to a family of linear inverse problems with Gaussian prior and Gaussian noise. We consider a class of Gaussian prior probability measures with covariance operator indexed by a…

Statistics Theory · Mathematics 2021-02-23 Junxiong Jia , Jigen Peng , Jinghuai Gao

This paper explores the multiple testing problem for sparse high-dimensional data with binary outcomes. We propose novel empirical Bayes multiple testing procedures based on a spike-and-slab posterior and then evaluate their performance in…

Statistics Theory · Mathematics 2025-06-16 Yu-Chien Bo Ning

In all areas of human knowledge, datasets are increasing in both size and complexity, creating the need for richer statistical models. This trend is also true for economic data, where high-dimensional and nonlinear/nonparametric inference…

Econometrics · Economics 2021-12-23 Dimitris Korobilis , Kenichi Shimizu

Sparse Bayesian factor models are routinely implemented for parsimonious dependence modeling and dimensionality reduction in high-dimensional applications. We provide theoretical understanding of such Bayesian procedures in terms of…

Statistics Theory · Mathematics 2014-06-03 Debdeep Pati , Anirban Bhattacharya , Natesh S. Pillai , David Dunson

We propose a new approach to Bayesian prediction that caters for models with a large number of parameters and is robust to model misspecification. Given a class of high-dimensional (but parametric) predictive models, this new approach…

Methodology · Statistics 2022-05-13 David T. Frazier , Ruben Loaiza-Maya , Gael M. Martin , Bonsoo Koo

A new methodology for model determination in decomposable graphical Gaussian models is developed. The Bayesian paradigm is used and, for each given graph, a hyper inverse Wishart prior distribution on the covariance matrix is considered.…

Computation · Statistics 2015-03-13 Sophie Donnet , Jean-Michel Marin

We propose Bayesian methods for Gaussian graphical models that lead to sparse and adaptively shrunk estimators of the precision (inverse covariance) matrix. Our methods are based on lasso-type regularization priors leading to parsimonious…

Methodology · Statistics 2013-10-07 Rajesh Talluri , Veerabhadran Baladandayuthapani , Bani K. Mallick