English
Related papers

Related papers: Singularities in Bayesian Inference: Crucial or Ov…

200 papers

The horseshoe prior has proven to be a noteworthy alternative for sparse Bayesian estimation, but as shown in this paper, the results can be sensitive to the prior choice for the global shrinkage hyperparameter. We argue that the previous…

Methodology · Statistics 2017-12-18 Juho Piironen , Aki Vehtari

Many statistical problems include model parameters that are defined as the solutions to optimization sub-problems. These include classical approaches such as profile likelihood as well as modern applications involving flow networks or…

Methodology · Statistics 2025-03-17 Cheng Zeng , Yaozhi Yang , Jason Xu , Leo L Duan

We introduce a new class of distributions named log-adjusted shrinkage priors for the analysis of sparse signals, which extends the three parameter beta priors by multiplying an additional log-term to their densities. The proposed prior has…

Methodology · Statistics 2020-01-28 Yasuyuki Hamura , Kaoru Irie , Shonosuke Sugasawa

Predictive inference in the sparse Gaussian sequence model has received considerably less attention than its non-sparse, finite-sample counterpart. Existing work has largely been confined to discrete mixture priors. In this paper, we study…

Statistics Theory · Mathematics 2026-04-21 Percy S. Zhai , Veronika Ročková

We consider a high-dimensional sparse normal means model where the goal is to estimate the mean vector assuming the proportion of non-zero means is unknown. We model the mean vector by a one-group global-local shrinkage prior belonging to a…

Statistics Theory · Mathematics 2025-09-19 Sayantan Paul , Arijit Chakrabarti

This paper proposes a class of asymmetric priors to perform Bayesian wavelet shrinkage in the standard nonparametric regression model with Gaussian error. The priors are composed by mixtures of a point mass function at zero and one of the…

Methodology · Statistics 2024-10-03 Alex Rodrigo dos Santos Sousa

We study high-dimensional Bayesian linear regression with a general beta prime distribution for the scale parameter. Under the assumption of sparsity, we show that appropriate selection of the hyperparameters in the beta prime prior leads…

Methodology · Statistics 2019-07-19 Ray Bai , Malay Ghosh

Optimization is widely used in statistics, and often efficiently delivers point estimates on useful spaces involving structural constraints or combinatorial structure. To quantify uncertainty, Gibbs posterior exponentiates the negative loss…

Methodology · Statistics 2025-07-23 Cheng Zeng , Eleni Dilma , Jason Xu , Leo L Duan

In this paper, the use of the Generalized Beta Mixture (GBM) and Horseshoe distributions as priors in the Bayesian Compressive Sensing framework is proposed. The distributions are considered in a two-layer hierarchical model, making the…

Information Theory · Computer Science 2014-11-11 Zahra Sabetsarvestani , Hamidreza Amindavar

We investigate shrinkage priors for constructing Bayesian predictive distributions. It is shown that there exist shrinkage predictive distributions asymptotically dominating Bayesian predictive distributions based on the Jeffreys prior or…

Statistics Theory · Mathematics 2007-06-13 Fumiyasu Komaki

We investigate the asymptotic behavior of posterior distributions of regression coefficients in high-dimensional linear models as the number of dimensions grows with the number of observations. We show that the posterior distribution…

Methodology · Statistics 2018-03-06 Artin Armagan , David B. Dunson , Jaeyong Lee , Waheed U. Bajwa , Nate Strawn

We consider Markov chain Monte Carlo (MCMC) algorithms for Bayesian high-dimensional regression with continuous shrinkage priors. A common challenge with these algorithms is the choice of the number of iterations to perform. This is…

Methodology · Statistics 2021-07-13 Niloy Biswas , Anirban Bhattacharya , Pierre E. Jacob , James E. Johndrow

This paper introduces a novel Bayesian approach for variable selection in high-dimensional and potentially sparse regression settings. Our method replaces the indicator variables in the traditional spike and slab prior with continuous,…

Methodology · Statistics 2025-02-07 Linduni M. Rodrigo , Robert Kohn , Hadi M. Afshar , Sally Cripps

Shrinkage prior are becoming more and more popular in Bayesian modeling for high dimensional sparse problems due to its computational efficiency. Recent works show that a polynomially decaying prior leads to satisfactory posterior…

Statistics Theory · Mathematics 2020-04-14 Qifan Song

Global-local shrinkage prior has been recognized as useful class of priors which can strongly shrink small signals towards prior means while keeping large signals unshrunk. Although such priors have been extensively discussed under Gaussian…

Methodology · Statistics 2020-08-18 Yasuyuki Hamura , Kaoru Irie , Shonosuke Sugasawa

Two-component mixture priors provide a traditional way to induce sparsity in high-dimensional Bayes models. However, several aspects of such a prior, including computational complexities in high-dimensions, interpretation of exact zeros and…

Statistics Theory · Mathematics 2016-05-19 Anirban Bhattacharya , David B. Dunson , Debdeep Pati , Natesh S. Pillai

The first Bayesian results for the sparse normal means problem were proven for spike-and-slab priors. However, these priors are less convenient from a computational point of view. In the meanwhile, a large number of continuous shrinkage…

Statistics Theory · Mathematics 2016-08-16 Stéphanie van der Pas , Jean-Bernard Salomond , Johannes Schmidt-Hieber

Precision matrices are crucial in many fields such as social networks, neuroscience, and economics, representing the edge structure of Gaussian graphical models (GGMs), where a zero in an off-diagonal position of the precision matrix…

Statistics Theory · Mathematics 2025-01-24 The Tien Mai

Heavy-tailed continuous shrinkage priors, such as the horseshoe prior, are widely used for sparse estimation problems. However, there is limited work extending these priors to predictors with grouping structures. Of particular interest in…

Methodology · Statistics 2023-03-09 Jonathan Boss , Jyotishka Datta , Xin Wang , Sung Kyun Park , Jian Kang , Bhramar Mukherjee

We consider a Bayesian approach to variable selection in the presence of high dimensional covariates based on a hierarchical model that places prior distributions on the regression coefficients as well as on the model space. We adopt the…

Statistics Theory · Mathematics 2014-07-28 Naveen Naidu Narisetty , Xuming He