中文
相关论文

相关论文: Gibbs posterior for variable selection in high-dim…

200 篇论文

We introduce a symmetric random scan Gibbs sampler for scalable Bayesian variable selection that eliminates storage of the full cross-product matrix by computing required quantities on-the-fly. Data-informed proposal weights, constructed…

统计方法学 · 统计学 2026-01-14 Mengta Chung

Variable selection in the linear regression model takes many apparent faces from both frequentist and Bayesian standpoints. In this paper we introduce a variable selection method referred to as a rescaled spike and slab model. We study the…

统计理论 · 数学 2007-06-13 Hemant Ishwaran , J. Sunil Rao

We study data-driven decision-making problems in the Bayesian framework, where the expectation in the Bayes risk is replaced by a risk-sensitive entropic risk measure. We focus on problems where calculating the posterior distribution is…

最优化与控制 · 数学 2021-09-13 Prateek Jaiswal , Harsha Honnappa , Vinayak A. Rao

We use Bayesian model selection paradigms, such as group least absolute shrinkage and selection operator priors, to facilitate generalized additive model selection. Our approach allows for the effects of continuous predictors to be…

统计方法学 · 统计学 2023-09-29 Virginia X. He , Matt P. Wand

Monte Carlo methods are essential tools for Bayesian inference. Gibbs sampling is a well-known Markov chain Monte Carlo (MCMC) algorithm, extensively used in signal processing, machine learning, and statistics, employed to draw samples from…

统计计算 · 统计学 2017-12-21 Luca Martino , Victor Elvira , Gustau Camps-Valls

In this paper, we study sampling from a posterior derived from a neural network. We propose a new probabilistic model consisting of adding noise at every pre- and post-activation in the network, arguing that the resulting posterior can be…

机器学习 · 计算机科学 2024-07-22 Giovanni Piccioli , Emanuele Troiani , Lenka Zdeborová

Variable selection in linear regression has been a central topic in statistical research for decades. Bayesian variable selection methods, which account for uncertainty in both the regression coefficients and the noise variance, have…

统计方法学 · 统计学 2026-04-24 Leo L Duan

Variational Bayes (VB) is rapidly becoming a popular tool for Bayesian inference in statistical modeling. However, the existing VB algorithms are restricted to cases where the likelihood is tractable, which precludes the use of VB in many…

统计方法学 · 统计学 2016-08-05 Minh-Ngoc Tran , David J. Nott , Robert Kohn

In many domains, we are interested in analyzing the structure of the underlying distribution, e.g., whether one variable is a direct parent of the other. Bayesian model-selection attempts to find the MAP model and use its structure to…

机器学习 · 计算机科学 2013-01-18 Nir Friedman , Daphne Koller

Bayesian model selection provides a powerful framework for objectively comparing models directly from observed data, without reference to ground truth data. However, Bayesian model selection requires the computation of the marginal…

统计方法学 · 统计学 2024-01-17 Xiaohao Cai , Jason D. McEwen , Marcelo Pereyra

The random dot product graph is a popular model for network data with extensions that accommodate dynamic (time-varying) networks. However, two significant deficiencies exist in the dynamic random dot product graph literature: (1) no…

统计方法学 · 统计学 2025-09-25 Joshua Daniel Loyal

Variational Bayesian (VB) methods produce posterior inference in a time frame considerably smaller than traditional Markov Chain Monte Carlo approaches. Although the VB posterior is an approximation, it has been shown to produce good…

统计计算 · 统计学 2019-08-02 Nathaniel Tomasetti , Catherine S. Forbes , Anastasios Panagiotelis

Fitted probabilities from widely used Bayesian multinomial probit models can depend strongly on the choice of a base category, which is used to uniquely identify the parameters of the model. This paper proposes a novel identification…

统计方法学 · 统计学 2020-05-19 Lane F. Burgette , David Puelz , P. Richard Hahn

We introduce a class of generic spike-and-slab priors for high-dimensional linear regression with grouped variables and present a Coordinate-ascent Variational Inference (CAVI) algorithm for obtaining an optimal variational Bayes…

统计方法学 · 统计学 2023-10-02 Buyu Lin , Changhao Ge , Jun S. Liu

Consider the normal linear regression setup when the number of covariates p is much larger than the sample size n, and the covariates form correlated groups. The response variable y is not related to an entire group of covariates in all or…

统计方法学 · 统计学 2023-09-06 Pranay Agarwal , Subhajit Dutta , Minerva Mukhopadhyay

Bayesian shrinkage methods have generated a lot of recent interest as tools for high-dimensional regression and model selection. These methods naturally facilitate tractable uncertainty quantification and incorporation of prior information.…

统计计算 · 统计学 2017-04-17 Bala Rajaratnam , Doug Sparks , Kshitij Khare , Liyuan Zhang

In data sets with many predictors, algorithms for identifying a good subset of predictors are often used. Most such algorithms do not account for any relationships between predictors. For example, stepwise regression might select a model…

bayes-an · 物理学 2008-02-03 Hugh Chipman

This paper aims at developing a quasi-Bayesian analysis of the nonparametric instrumental variables model, with a focus on the asymptotic properties of quasi-posterior distributions. In this paper, instead of assuming a distributional…

统计理论 · 数学 2013-11-21 Kengo Kato

Variational Bayesian inference and (collapsed) Gibbs sampling are the two important classes of inference algorithms for Bayesian networks. Both have their advantages and disadvantages: collapsed Gibbs sampling is unbiased but is also…

机器学习 · 计算机科学 2012-06-18 Max Welling , Yee Whye Teh , Hilbert Kappen

The quantile varying coefficient (VC) model can flexibly capture dynamical patterns of regression coefficients. In addition, due to the quantile check loss function, it is robust against outliers and heavy-tailed distributions of the…

统计方法学 · 统计学 2023-07-11 Fei Zhou , Jie Ren , Shuangge Ma , Cen Wu