English

The Group R2D2 Shrinkage Prior for Sparse Linear Models with Grouped Covariates

Methodology 2025-12-16 v3

Abstract

Shrinkage priors are a popular Bayesian paradigm to handle sparsity in high-dimensional regression. Still limited, however, is a flexible class of shrinkage priors to handle grouped sparsity, where covariates exhibit some natural grouping structure. This paper proposes a novel extension of the R2R^2-induced Dirichlet Decomposition (R2D2) prior to accommodate grouped variable selection in linear regression models. The proposed method, called the Group R2D2 prior, employs a Dirichlet prior distribution on the coefficient of determination for each group, allowing for a flexible and adaptive shrinkage that operates at both group and individual variable levels. This approach improves the original R2D2 prior to handle grouped predictors, providing a balance between within-group dependence and group-level sparsity. We present several theoretical properties of this proposed prior distribution while also developing a Markov Chain Monte Carlo algorithm. Through simulation studies and real-data analysis, we demonstrate that our method outperforms traditional shrinkage priors in terms of both estimation accuracy, inference and prediction.

Keywords

Cite

@article{arxiv.2412.15293,
  title  = {The Group R2D2 Shrinkage Prior for Sparse Linear Models with Grouped Covariates},
  author = {Eric Yanchenko and Kaoru Irie and Shonosuke Sugasawa},
  journal= {arXiv preprint arXiv:2412.15293},
  year   = {2025}
}
R2 v1 2026-06-28T20:42:56.247Z