English
Related papers

Related papers: A Beta Cauchy-Cauchy (BECCA) shrinkage prior for B…

200 papers

We propose a variational Bayesian (VB) procedure for high-dimensional linear model inferences with heavy tail shrinkage priors, such as student-t prior. Theoretically, we establish the consistency of the proposed VB method and prove that…

Machine Learning · Statistics 2020-10-27 Jincheng Bai , Qifan Song , Guang Cheng

Multi-group covariance estimation for matrix-variate data with small within group sample sizes is a key part of many data analysis tasks in modern applications. To obtain accurate group-specific covariance estimates, shrinkage estimation…

Methodology · Statistics 2024-03-08 Elizabeth Bersson , Peter D. Hoff

Approximate Bayesian computation (ABC) methods are standard tools for inferring parameters of complex models when the likelihood function is analytically intractable. A popular approach to improving the poor acceptance rate of the basic…

Methodology · Statistics 2025-01-27 Henri Pesonen , Jukka Corander

We propose a general algorithmic framework for Bayesian model selection. A spike-and-slab Laplacian prior is introduced to model the underlying structural assumption. Using the notion of effective resistance, we derive an EM-type algorithm…

Methodology · Statistics 2020-06-19 Youngseok Kim , Chao Gao

The paper revisits the Bayesian group lasso and uses spike and slab priors for group variable selection. In the process, the connection of our model with penalized regression is demonstrated, and the role of posterior median for…

Statistics Theory · Mathematics 2015-12-04 Xiaofan Xu , Malay Ghosh

Modeled along the truncated approach in Panigrahi (2016), selection-adjusted inference in a Bayesian regime is based on a selective posterior. Such a posterior is determined together by a generative model imposed on data and the selection…

Methodology · Statistics 2017-09-12 Snigdha Panigrahi , Jonathan Taylor

Sparse high-dimensional linear regression is a central problem in statistics, where the goal is often variable selection and/or coefficient estimation. We propose a mean-field variational Bayes approximation for sparse regression with…

Methodology · Statistics 2025-12-02 Chadi Bsila , Yiqi Tang , Kaiwen Wang , Laurie Heyer

In the problem of selecting variables in a multivariate linear regression model, we derive new Bayesian information criteria based on a prior mixing a smooth distribution and a delta distribution. Each of them can be interpreted as a fusion…

Statistics Theory · Mathematics 2022-09-29 Haruki Kono , Tatsuya Kubokawa

Over the past two decades, shrinkage priors have become increasingly popular, and many proposals can be found in the literature. These priors aim to shrink small effects to zero while maintaining true large effects. Horseshoe-type priors…

Statistics Theory · Mathematics 2025-01-14 Maria De Iorio , Andreas Heinecke , Beatrice Franzolini , Rafael Cabral

Bayesian shrinkage methods have generated a lot of recent interest as tools for high-dimensional regression and model selection. These methods naturally facilitate tractable uncertainty quantification and incorporation of prior information.…

Methodology · Statistics 2017-04-21 Bala Rajaratnam , Doug Sparks , Kshitij Khare , Liyuan Zhang

Shrinkage prior are becoming more and more popular in Bayesian modeling for high dimensional sparse problems due to its computational efficiency. Recent works show that a polynomially decaying prior leads to satisfactory posterior…

Statistics Theory · Mathematics 2020-04-14 Qifan Song

We propose a novel class of dynamic shrinkage processes for Bayesian time series and regression analysis. Building upon a global-local framework of prior construction, in which continuous scale mixtures of Gaussian distributions are…

Methodology · Statistics 2019-07-02 Daniel R. Kowal , David S. Matteson , David Ruppert

We consider Bayesian variable selection for binary outcomes under a probit link with a spike-and-slab prior on the regression coefficients. Motivated by the computational challenges encountered by Markov chain Monte Carlo (MCMC) samplers in…

Computation · Statistics 2026-05-18 Augusto Fasano , Giovanni Rebaudo

This paper argues that the half-Cauchy distribution should replace the inverse-Gamma distribution as a default prior for a top-level scale parameter in Bayesian hierarchical models, at least for cases where a proper prior is necessary. Our…

Methodology · Statistics 2011-09-27 Nicholas G. Polson , James G. Scott

We consider exact algorithms for Bayesian inference with model selection priors (including spike-and-slab priors) in the sparse normal sequence model. Because the best existing exact algorithm becomes numerically unstable for sample sizes…

Methodology · Statistics 2020-04-16 Tim van Erven , Botond Szabo

We study the use of spike and slab priors for consistent estimation of the number of change points and their locations. Leveraging recent results in the variable selection literature, we show that an estimator based on spike and slab priors…

Methodology · Statistics 2021-06-22 Lorenzo Cappello , Oscar Hernan Madrid Padilla , Julia A. Palacios

Motivated by the increasing use of and rapid changes in array technologies, we consider the prediction problem of fitting a linear regression relating a continuous outcome $Y$ to a large number of covariates $\mathbf {X}$, for example,…

Applications · Statistics 2014-01-13 Philip S. Boonstra , Bhramar Mukherjee , Jeremy M. G. Taylor

High-dimensional spatially correlated covariates are common in regression models encountered in environmental sciences and other fields. In such models, the regression coefficients often exhibit a sparse structure with spatial dependence.…

Methodology · Statistics 2026-05-08 Zihan Zhu , Xueying Tang , Shuang Zhou

Linear mixed effects models are widely used in statistical modelling. We consider a mixed effects model with Bayesian variable selection in the random effects using spike-and-slab priors and developed a variational Bayes inference scheme…

Methodology · Statistics 2024-08-15 M-Z. Spyropoulou , J. Hopker , J. E. Griffin

Large Bayesian VARs are now widely used in empirical macroeconomics. One popular shrinkage prior in this setting is the natural conjugate prior as it facilitates posterior simulation and leads to a range of useful analytical results. This…

Econometrics · Economics 2021-11-16 Joshua C. C. Chan