English
Related papers

Related papers: Scalable Bayesian shrinkage and uncertainty quanti…

200 papers

There has been an intense development of Bayes graphical model estimation approaches over the past decade - however, most of the existing methods are restricted to moderate dimensions. We propose a novel approach suitable for high…

Methodology · Statistics 2013-08-20 Suprateek Kundu , Veera Baladandayuthapani , Bani K. Mallick

Shrinkage prior are becoming more and more popular in Bayesian modeling for high dimensional sparse problems due to its computational efficiency. Recent works show that a polynomially decaying prior leads to satisfactory posterior…

Statistics Theory · Mathematics 2020-04-14 Qifan Song

Bayesian neural networks (BNNs) require scalable sampling algorithms to approximate posterior distributions over parameters. Existing stochastic gradient Markov Chain Monte Carlo (SGMCMC) methods are highly sensitive to the choice of…

Machine Learning · Computer Science 2026-04-10 Rajit Rajpal , Benedict Leimkuhler , Yuanhao Jiang

In many large-scale inverse problems, such as computed tomography and image deblurring, characterization of sharp edges in the solution is desired. Within the Bayesian approach to inverse problems, edge-preservation is often achieved using…

Computation · Statistics 2022-07-20 Felipe Uribe , Yiqiu Dong , Per Christian Hansen

Harvey et al. (2010) extended the Bayesian estimation method by Sahu et al. (2003) to a multivariate skew-elliptical distribution with a general skewness matrix, and applied it to Bayesian portfolio optimization with higher moments.…

Methodology · Statistics 2021-08-10 Sakae Oya , Teruo Nakatsuma

In this paper we consider a Bayesian framework for making inferences about dynamical systems from ergodic observations. The proposed Bayesian procedure is based on the Gibbs posterior, a decision theoretic generalization of standard…

Statistics Theory · Mathematics 2019-01-28 Kevin McGoff , Sayan Mukherjee , Andrew Nobel

We propose a flexible class of models based on scale mixture of uniform distributions to construct shrinkage priors for covariance matrix estimation. This new class of priors enjoys a number of advantages over the traditional scale mixture…

Methodology · Statistics 2011-10-07 Hao Wang , Natesh S. Pillai

Approximate Bayesian computation (ABC) methods are standard tools for inferring parameters of complex models when the likelihood function is analytically intractable. A popular approach to improving the poor acceptance rate of the basic…

Methodology · Statistics 2025-01-27 Henri Pesonen , Jukka Corander

This paper concerns the robust regression model when the number of predictors and the number of observations grow in a similar rate. Theory for M-estimators in this regime has been recently developed by several authors [El Karoui et al.,…

Statistics Theory · Mathematics 2016-04-06 Daniel Nevo , Ya'acov Ritov

Slice sampling is a well-established Markov chain Monte Carlo method for (approximate) sampling of target distributions which are only known up to a normalizing constant. The method is based on choosing a new state on a slice, i.e., a…

Computation · Statistics 2025-12-22 Kevin Bitterlich , Daniel Rudolf , Björn Sprungk

We consider the joint inference of regression coefficients and the inverse covariance matrix for covariates in high-dimensional probit regression, where the predictors are both relevant to the binary response and functionally related to one…

Methodology · Statistics 2022-03-15 Xuan Cao , Kyoungjae Lee

We propose a variational Bayesian (VB) procedure for high-dimensional linear model inferences with heavy tail shrinkage priors, such as student-t prior. Theoretically, we establish the consistency of the proposed VB method and prove that…

Machine Learning · Statistics 2020-10-27 Jincheng Bai , Qifan Song , Guang Cheng

This paper introduces a novel Bayesian approach for variable selection in high-dimensional and potentially sparse regression settings. Our method replaces the indicator variables in the traditional spike and slab prior with continuous,…

Methodology · Statistics 2025-02-07 Linduni M. Rodrigo , Robert Kohn , Hadi M. Afshar , Sally Cripps

We consider exact algorithms for Bayesian inference with model selection priors (including spike-and-slab priors) in the sparse normal sequence model. Because the best existing exact algorithm becomes numerically unstable for sample sizes…

Methodology · Statistics 2020-04-16 Tim van Erven , Botond Szabo

Global-local shrinkage prior has been recognized as useful class of priors which can strongly shrink small signals towards prior means while keeping large signals unshrunk. Although such priors have been extensively discussed under Gaussian…

Methodology · Statistics 2020-08-18 Yasuyuki Hamura , Kaoru Irie , Shonosuke Sugasawa

Many statistical problems include model parameters that are defined as the solutions to optimization sub-problems. These include classical approaches such as profile likelihood as well as modern applications involving flow networks or…

Methodology · Statistics 2025-03-17 Cheng Zeng , Yaozhi Yang , Jason Xu , Leo L Duan

Choosing between classical and Bayesian sparse regression methods involves a real trade-off: penalized estimators like Lasso run in milliseconds but give no uncertainty estimates,while Horseshoe and Spike-and-Slab priors produce full…

Machine Learning · Computer Science 2026-05-05 Hao Xiao

Randomized controlled clinical trials provide the gold standard for evidence generation in relation to the efficacy of a new treatment in medical research. Relevant information from previous studies may be desirable to incorporate in the…

Methodology · Statistics 2024-05-29 Lou E. Whitehead , James M. S. Wason , Oliver Sailer , Haiyan Zheng

A fully Bayesian treatment of complicated predictive models (such as deep neural networks) would enable rigorous uncertainty quantification and the automation of higher-level tasks including model selection. However, the intractability of…

A common analytical problem in neuroscience is the interpretation of neural activity with respect to sensory input or behavioral output. This is typically achieved by regressing measured neural activity against known stimuli or behavioral…

Computation · Statistics 2016-06-28 Kamiar Rahnama Rad , Timothy A. Machado , Liam Paninski