English
Related papers

Related papers: Simultaneous Variable and Covariance Selection wit…

200 papers

The impracticality of posterior sampling has prevented the widespread adoption of spike-and-slab priors in high-dimensional applications. To alleviate the computational burden, optimization strategies have been proposed that quickly find…

Methodology · Statistics 2021-03-30 Lizhen Nie , Veronika Ročková

Spike-and-slab priors are commonly used for Bayesian variable selection, due to their interpretability and favorable statistical properties. However, existing samplers for spike-and-slab posteriors incur prohibitive computational costs when…

Computation · Statistics 2022-06-28 Niloy Biswas , Lester Mackey , Xiao-Li Meng

We consider a Bayesian approach to variable selection in the presence of high dimensional covariates based on a hierarchical model that places prior distributions on the regression coefficients as well as on the model space. We adopt the…

Statistics Theory · Mathematics 2014-07-28 Naveen Naidu Narisetty , Xuming He

Linear mixed effects models are widely used in statistical modelling. We consider a mixed effects model with Bayesian variable selection in the random effects using spike-and-slab priors and developed a variational Bayes inference scheme…

Methodology · Statistics 2024-08-15 M-Z. Spyropoulou , J. Hopker , J. E. Griffin

Variable selection in the linear regression model takes many apparent faces from both frequentist and Bayesian standpoints. In this paper we introduce a variable selection method referred to as a rescaled spike and slab model. We study the…

Statistics Theory · Mathematics 2007-06-13 Hemant Ishwaran , J. Sunil Rao

We aim to incorporate variable selection routines into variable-by-variable (or sequential) imputation in clustered data to achieve computational improvement in applications with large-scale health data. Specifically, we utilize variable…

Methodology · Statistics 2025-04-08 Qiushuang Li , Recai Yucel

Variable selection in Gaussian processes (GPs) is typically undertaken by thresholding the inverse lengthscales of automatic relevance determination kernels, but in high-dimensional datasets this approach can be unreliable. A more…

Machine Learning · Statistics 2022-02-25 Hugh Dance , Brooks Paige

The R package spikeSlabGAM implements Bayesian variable selection, model choice, and regularized estimation in (geo-)additive mixed models for Gaussian, binomial, and Poisson responses. Its purpose is to (1) choose an appropriate subset of…

Methodology · Statistics 2015-03-19 Fabian Scheipl

We consider Bayesian linear regression with sparsity-inducing prior and design efficient sampling algorithms leveraging posterior contraction properties. A quasi-likelihood with Gaussian spike-and-slab (that is favorable both statistically…

Computation · Statistics 2023-07-13 Qijia Jiang

Discovering governing equations from data is important to many scientific and engineering applications. Despite promising successes, existing methods are still challenged by data sparsity and noise issues, both of which are ubiquitous in…

Machine Learning · Computer Science 2024-04-23 Da Long , Wei W. Xing , Aditi S. Krishnapriyan , Robert M. Kirby , Shandian Zhe , Michael W. Mahoney

We consider a high-dimensional multi-outcome regression in which $q,$ possibly dependent, binary and continuous outcomes are regressed onto $p$ covariates. We model the observed outcome vector as a partially observed latent realization from…

Methodology · Statistics 2025-11-05 Soham Ghosh , Sameer K. Deshpande

The Gaussian process latent variable model (GP-LVM) is a popular approach to non-linear probabilistic dimensionality reduction. One design choice for the model is the number of latent variables. We present a spike and slab prior for the…

Machine Learning · Statistics 2015-05-12 Zhenwen Dai , James Hensman , Neil Lawrence

This paper presents the use of spike-and-slab (SS) priors for discovering governing differential equations of motion of nonlinear structural dynamic systems. The problem of discovering governing equations is cast as that of selecting…

Methodology · Statistics 2021-06-02 Rajdip Nayek , Ramon Fuentes , Keith Worden , Elizabeth J. Cross

We study the Bayesian approach to variable selection in the context of linear regression. Motivated by a recent work by Rockova and George (2014), we propose an EM algorithm that returns the MAP estimate of the set of relevant variables.…

Computation · Statistics 2016-03-15 Jin Wang , Feng Liang , Yuan Ji

Spike-and-slab priors are popular Bayesian solutions for high-dimensional linear regression problems. Previous theoretical studies on spike-and-slab methods focus on specific prior formulations and use prior-dependent conditions and…

Statistics Theory · Mathematics 2020-02-14 Bai Jiang , Qiang Sun

Structured additive regression provides a general framework for complex Gaussian and non-Gaussian regression models, with predictors comprising arbitrary combinations of nonlinear functions and surfaces, spatial effects, varying…

Methodology · Statistics 2015-03-19 Fabian Scheipl , Ludwig Fahrmeir , Thomas Kneib

Covariate-dependent graph learning has gained increasing interest in the graphical modeling literature for the analysis of heterogeneous data. This task, however, poses challenges to modeling, computational efficiency, and interpretability.…

Methodology · Statistics 2025-04-04 Zijian Zeng , Meng Li , Marina Vannucci

In this article, we propose a novel spatial global-local spike-and-slab selection prior for image-on-scalar regression. We consider a Bayesian hierarchical Gaussian process model for image smoothing, that uses a flexible Inverse-Wishart…

Methodology · Statistics 2022-12-19 Zijian Zeng , Meng Li , Marina Vannucci

Data irregularity in cancer genomics studies has been widely observed in the form of outliers and heavy-tailed distributions in the complex traits. In the past decade, robust variable selection methods have emerged as powerful alternatives…

Methodology · Statistics 2024-05-14 Yuwen Liu , Jie Ren , Shuangge Ma , Cen Wu

In many practices, scientists are particularly interested in detecting which of the predictors are truly associated with a multivariate response. It is more accurate to model multiple responses as one vector rather than separating each…

Methodology · Statistics 2021-11-16 Xiaotian Dai , Guifang Fu , Randall Reese , Shaofei Zhao , Zuofeng Shang