English
Related papers

Related papers: The Group R2D2 Shrinkage Prior for Sparse Linear M…

200 papers

We consider the problem of learning the structure of a high dimensional precision matrix under sparsity assumptions. We propose to use a shrinkage prior, called the DL-graphical prior based on the Dirichlet-Laplace prior used for the…

Statistics Theory · Mathematics 2019-08-08 Sayantan Banerjee

Variable selection over a potentially large set of covariates in a linear model is quite popular. In the Bayesian context, common prior choices can lead to a posterior expectation of the regression coefficients that is a sparse (or nearly…

Methodology · Statistics 2025-12-02 Debamita Kundu , Riten Mitra , Jeremy T. Gaskins

We propose a flexible class of models based on scale mixture of uniform distributions to construct shrinkage priors for covariance matrix estimation. This new class of priors enjoys a number of advantages over the traditional scale mixture…

Methodology · Statistics 2011-10-07 Hao Wang , Natesh S. Pillai

In Bayesian analysis, the selection of a prior distribution is typically done by considering each parameter in the model. While this can be convenient, in many scenarios it may be desirable to place a prior on a summary measure of the model…

Methodology · Statistics 2024-01-17 Eric Yanchenko , Howard D. Bondell , Brian J. Reich

Variable selection has received widespread attention over the last decade as we routinely encounter high-throughput datasets in complex biological and environment research. Most Bayesian variable selection methods are restricted to mixture…

Methodology · Statistics 2015-03-24 Hanning Li , Debdeep Pati

In Bayesian regression models with categorical predictors, constraints are needed to ensure identifiability when using all $K$ levels of a factor. The sum-to-zero constraint is particularly useful as it allows coefficients to represent…

Methodology · Statistics 2025-04-15 Zhi Ling , Shozen Dan

Projected priors were originally introduced to accommodate parameter constraints, but have recently regained popularity due to their ability to assign probability mass to low-dimensional parameter sets, such as the spaces of sparse vectors,…

Methodology · Statistics 2026-05-15 Leo L Duan , Sunghyun Cho , Mingzhang Yin

Heavy-tailed continuous shrinkage priors, such as the horseshoe prior, are widely used for sparse estimation problems. However, there is limited work extending these priors to predictors with grouping structures. Of particular interest in…

Methodology · Statistics 2023-03-09 Jonathan Boss , Jyotishka Datta , Xin Wang , Sung Kyun Park , Jian Kang , Bhramar Mukherjee

Spatially dependent data arises in many applications, and Gaussian processes are a popular modelling choice for these scenarios. While Bayesian analyses of these problems have proven to be successful, selecting prior distributions for these…

Methodology · Statistics 2023-07-14 Eric Yanchenko , Howard D. Bondell , Brian J. Reich

When analyzing data from multiple sources, it is often convenient to strike a careful balance between two goals: capturing the heterogeneity of the samples and sharing information across them. We introduce a novel framework to model a…

Methodology · Statistics 2026-03-02 Laura D'Angelo , Bernardo Nipoti , Andrea Ongaro

Dirichlet process mixtures are particularly sensitive to the value of the precision parameter controlling the behavior of the latent partition. Randomization of the precision through a prior distribution is a common solution, which leads to…

Methodology · Statistics 2024-09-04 Alessandro Zito , Tommaso Rigon , David B. Dunson

Global-local shrinkage hierarchies are an important innovation in Bayesian estimation. We propose the use of log-scale distributions as a novel basis for generating familes of prior distributions for local shrinkage hyperparameters. By…

Statistics Theory · Mathematics 2020-01-31 Daniel F. Schmidt , Enes Makalic

This paper extends the idea of decoupling shrinkage and sparsity for continuous priors to Bayesian Quantile Regression (BQR). The procedure follows two steps: In the first step, we shrink the quantile regression posterior through state of…

Econometrics · Economics 2021-07-20 David Kohns , Tibor Szendrei

Robust Bayesian methods for high-dimensional regression problems under diverse sparse regimes are studied. Traditional shrinkage priors are primarily designed to detect a handful of signals from tens of thousands of predictors in the…

Statistics Theory · Mathematics 2024-10-25 Se Yoon Lee , Peng Zhao , Debdeep Pati , Bani K. Mallick

We propose a novel class of dynamic shrinkage processes for Bayesian time series and regression analysis. Building upon a global-local framework of prior construction, in which continuous scale mixtures of Gaussian distributions are…

Methodology · Statistics 2019-07-02 Daniel R. Kowal , David S. Matteson , David Ruppert

The information bottleneck framework provides a systematic approach to learning representations that compress nuisance information in the input and extract semantically meaningful information about predictions. However, the choice of a…

This article introduces two absolutely continuous global-local shrinkage priors to enable stochastic variable selection in the context of high-dimensional matrix exponential spatial specifications. Existing approaches as a means to dealing…

Econometrics · Economics 2019-02-06 Michael Pfarrhofer , Philipp Piribauer

We propose a Machine Learning approach for optimal macroeconomic density forecasting in a high-dimensional setting where the underlying model exhibits a known group structure. Our approach is general enough to encompass specific forecasting…

Econometrics · Economics 2024-11-18 Matteo Mogliani , Anna Simoni

The Bayesian approach to inference stands out for naturally allowing borrowing information across heterogeneous populations, with different samples possibly sharing the same distribution. A popular Bayesian nonparametric model for…

Methodology · Statistics 2022-01-25 Antonio Lijoi , Igor Prünster , Giovanni Rebaudo

Selecting a subset of variables for linear models remains an active area of research. This paper reviews many of the recent contributions to the Bayesian model selection and shrinkage prior literature. A posterior variable selection summary…

Methodology · Statistics 2014-08-05 P. Richard Hahn , Carlos M. Carvalho