中文
相关论文

相关论文: Disjunct Support Spike and Slab Priors for Variabl…

200 篇论文

Consider the problem of high dimensional variable selection for the Gaussian linear model when the unknown error variance is also of interest. In this paper, we show that the use of conjugate shrinkage priors for Bayesian variable selection…

统计方法学 · 统计学 2025-04-17 Gemma E. Moran , Veronika Rockova , Edward I. George

Variable selection in the linear regression model takes many apparent faces from both frequentist and Bayesian standpoints. In this paper we introduce a variable selection method referred to as a rescaled spike and slab model. We study the…

统计理论 · 数学 2007-06-13 Hemant Ishwaran , J. Sunil Rao

The emergence of Big Data raises the question of how to model economic relations when there is a large number of possible explanatory variables. We revisit the issue by comparing the possibility of using dense or sparse models in a Bayesian…

统计方法学 · 统计学 2020-10-01 Bruno Fava , Hedibert F. Lopes

Structured additive regression provides a general framework for complex Gaussian and non-Gaussian regression models, with predictors comprising arbitrary combinations of nonlinear functions and surfaces, spatial effects, varying…

统计方法学 · 统计学 2015-03-19 Fabian Scheipl , Ludwig Fahrmeir , Thomas Kneib

Variable fusion in linear regression models is a statistical method that identifies covariates making similar contributions to the response variable and imposes the same coefficient values on them. Many methods for variable fusion also…

统计方法学 · 统计学 2026-04-29 Junya Miyake , Akira Okazaki , Shuichi Kawano

Choosing between classical and Bayesian sparse regression methods involves a real trade-off: penalized estimators like Lasso run in milliseconds but give no uncertainty estimates,while Horseshoe and Spike-and-Slab priors produce full…

机器学习 · 计算机科学 2026-05-05 Hao Xiao

Supremum norm loss is intuitively more meaningful to quantify function estimation error in statistics. In the context of multivariate nonparametric regression with unknown error, we propose a Bayesian procedure based on spike-and-slab prior…

统计理论 · 数学 2018-06-29 William Weimin Yoo , Vincent Rivoirard , Judith Rousseau

The use of L1 regularisation for sparse learning has generated immense research interest, with successful application in such diverse areas as signal acquisition, image coding, genomics and collaborative filtering. While existing work…

机器学习 · 计算机科学 2012-08-20 Shakir Mohamed , Katherine Heller , Zoubin Ghahramani

We study predictive density estimation under Kullback-Leibler loss in $\ell_0$-sparse Gaussian sequence models. We propose proper Bayes predictive density estimates and establish asymptotic minimaxity in sparse models. A surprise is the…

统计理论 · 数学 2017-08-01 Gourab Mukherjee , Iain M. Johnstone

We propose a general framework using spike-and-slab prior distributions to aid with the development of high-dimensional Bayesian inference. Our framework allows inference with a general quasi-likelihood function. We show that highly…

统计理论 · 数学 2019-08-21 Yves Atchade , Anwesha Bhattacharyya

In the sparse normal means model, convergence of the Bayesian posterior distribution associated to spike and slab prior distributions is considered. The key sparsity hyperparameter is calibrated via marginal maximum likelihood empirical…

统计理论 · 数学 2018-10-17 Ismaël Castillo , Romain Mismer

Sparsity is a desirable attribute. It can lead to more efficient and more effective representations compared to the dense model. Meanwhile, learning sparse latent representations has been a challenging problem in the field of computer…

计算机视觉与模式识别 · 计算机科学 2022-09-22 Hanao Li , Tian Han

Spike and Slab priors have been of much recent interest in signal processing as a means of inducing sparsity in Bayesian inference. Applications domains that benefit from the use of these priors include sparse recovery, regression and…

机器学习 · 计算机科学 2016-10-27 Tiep H. Vu , Hojjat S. Mousavi , Vishal Monga

In this paper we develop a novel approach for estimating large and sparse dynamic factor models using variational inference, also allowing for missing data. Inspired by Bayesian variable selection, we apply slab-and-spike priors onto the…

统计方法学 · 统计学 2022-10-14 Erik Spånberg

In this paper we study grouped variable selection problems by proposing a specified prior, called the nested spike and slab prior, to model collective behavior of regression coefficients. At the group level, the nested spike and slab prior…

统计方法学 · 统计学 2011-06-30 Tso-Jung Yen , Yu-Min Yen

Spike-and-slab and horseshoe regression are arguably the most popular Bayesian variable selection approaches for linear regression models. However, their performance can deteriorate if outliers and heteroskedasticity are present in the…

统计方法学 · 统计学 2022-10-20 Alberto Cabezas , Marco Battiston , Christopher Nemeth

Variational Bayes (VB) is a popular scalable alternative to Markov chain Monte Carlo for Bayesian inference. We study a mean-field spike and slab VB approximation of widely used Bayesian model selection priors in sparse high-dimensional…

机器学习 · 统计学 2021-09-07 Kolyan Ray , Botond Szabo , Gabriel Clara

Spike-and-slab priors are commonly used for Bayesian variable selection, due to their interpretability and favorable statistical properties. However, existing samplers for spike-and-slab posteriors incur prohibitive computational costs when…

统计计算 · 统计学 2022-06-28 Niloy Biswas , Lester Mackey , Xiao-Li Meng

We propose a Bayesian methodology for estimating spiked covariance matrices with jointly sparse structure in high dimensions. The spiked covariance matrix is reparametrized in terms of the latent factor model, where the loading matrix is…

统计方法学 · 统计学 2019-01-31 Fangzheng Xie , Yanxun Xu , Carey E. Priebe , Joshua Cape

There is a rich literature proposing methods and establishing asymptotic properties of Bayesian variable selection methods for parametric models, with a particular focus on the normal linear regression model and an increasing emphasis on…

统计理论 · 数学 2011-08-16 Suprateek Kundu , David B. Dunson