中文
相关论文

相关论文: A Variational Spike-and-Slab Approach for Group Va…

200 篇论文

We propose a novel spike and slab prior specification with scaled beta prime marginals for the importance parameters of regression coefficients to allow for general effect selection within the class of structured additive distributional…

统计方法学 · 统计学 2020-06-30 Nadja Klein , Manuel Carlan , Thomas Kneib , Stefan Lang , Helga Wagner

In this paper, we consider a Bayesian bi-level variable selection problem in high-dimensional regressions. In many practical situations, it is natural to assign group membership to each predictor. Examples include that genetic variants can…

应用统计 · 统计学 2018-03-29 Mingxuan Cai , Mingwei Dai , Jingsi Ming , Heng Peng , Jin Liu , Can Yang

Sparse high-dimensional linear regression is a central problem in statistics, where the goal is often variable selection and/or coefficient estimation. We propose a mean-field variational Bayes approximation for sparse regression with…

统计方法学 · 统计学 2025-12-02 Chadi Bsila , Yiqi Tang , Kaiwen Wang , Laurie Heyer

We propose a variational Bayesian (VB) procedure for high-dimensional linear model inferences with heavy tail shrinkage priors, such as student-t prior. Theoretically, we establish the consistency of the proposed VB method and prove that…

机器学习 · 统计学 2020-10-27 Jincheng Bai , Qifan Song , Guang Cheng

Variable selection in the linear regression model takes many apparent faces from both frequentist and Bayesian standpoints. In this paper we introduce a variable selection method referred to as a rescaled spike and slab model. We study the…

统计理论 · 数学 2007-06-13 Hemant Ishwaran , J. Sunil Rao

Covariate-dependent graph learning has gained increasing interest in the graphical modeling literature for the analysis of heterogeneous data. This task, however, poses challenges to modeling, computational efficiency, and interpretability.…

统计方法学 · 统计学 2025-04-04 Zijian Zeng , Meng Li , Marina Vannucci

Sparse deep neural networks have proven to be efficient for predictive model building in large-scale studies. Although several works have studied theoretical and numerical properties of sparse neural architectures, they have primarily…

机器学习 · 统计学 2023-09-18 Sanket Jantre , Shrijita Bhattacharya , Tapabrata Maiti

Variational inference (VI) provides fast approximations of a Bayesian posterior in part because it formulates posterior approximation as an optimization problem: to find the closest distribution to the exact posterior over some family of…

机器学习 · 统计学 2017-03-03 Fangjian Guo , Xiangyu Wang , Kai Fan , Tamara Broderick , David B. Dunson

Approximate Bayesian Computation (ABC) is a framework for performing likelihood-free posterior inference for simulation models. Stochastic Variational inference (SVI) is an appealing alternative to the inefficient sampling approaches…

机器学习 · 统计学 2016-06-29 Alexander Moreno , Tameem Adel , Edward Meeds , James M. Rehg , Max Welling

We introduce varbvs, a suite of functions written in R and MATLAB for regression analysis of large-scale data sets using Bayesian variable selection methods. We have developed numerical optimization algorithms based on variational…

统计计算 · 统计学 2017-09-21 Peter Carbonetto , Xiang Zhou , Matthew Stephens

A conventional Bayesian approach to prediction uses the posterior distribution to integrate out parameters in a density for unobserved data conditional on the observed data and parameters. When the true posterior is intractable, it is…

统计方法学 · 统计学 2026-02-27 Lucas Kock , Scott A. Sisson , G. S. Rodrigues , David J. Nott

Spike-and-slab priors are commonly used for Bayesian variable selection, due to their interpretability and favorable statistical properties. However, existing samplers for spike-and-slab posteriors incur prohibitive computational costs when…

统计计算 · 统计学 2022-06-28 Niloy Biswas , Lester Mackey , Xiao-Li Meng

We present Sequential Neural Variational Inference (SNVI), an approach to perform Bayesian inference in models with intractable likelihoods. SNVI combines likelihood-estimation (or likelihood-ratio-estimation) with variational inference to…

机器学习 · 统计学 2022-10-20 Manuel Glöckler , Michael Deistler , Jakob H. Macke

We consider the problem of variable selection in high-dimensional settings with missing observations among the covariates. To address this relatively understudied problem, we propose a new synergistic procedure -- adaptive Bayesian SLOPE --…

The recognition network in deep latent variable models such as variational autoencoders (VAEs) relies on amortized inference for efficient posterior approximation that can scale up to large datasets. However, this technique has also been…

机器学习 · 统计学 2019-02-28 Rui Shu , Hung H. Bui , Jay Whang , Stefano Ermon

We address the problem of dynamic variable selection in time series regression with unknown residual variances, where the set of active predictors is allowed to evolve over time. To capture time-varying variable selection uncertainty, we…

统计方法学 · 统计学 2019-09-24 Veronika Rockova , Kenichiro McAlinn

We aim to incorporate variable selection routines into variable-by-variable (or sequential) imputation in clustered data to achieve computational improvement in applications with large-scale health data. Specifically, we utilize variable…

统计方法学 · 统计学 2025-04-08 Qiushuang Li , Recai Yucel

Structured additive regression provides a general framework for complex Gaussian and non-Gaussian regression models, with predictors comprising arbitrary combinations of nonlinear functions and surfaces, spatial effects, varying…

统计方法学 · 统计学 2015-03-19 Fabian Scheipl , Ludwig Fahrmeir , Thomas Kneib

The paper revisits the Bayesian group lasso and uses spike and slab priors for group variable selection. In the process, the connection of our model with penalized regression is demonstrated, and the role of posterior median for…

统计理论 · 数学 2015-12-04 Xiaofan Xu , Malay Ghosh

We introduce a flexible empirical Bayes approach for fitting Bayesian generalized linear models. Specifically, we adopt a novel mean-field variational inference (VI) method and the prior is estimated within the VI algorithm, making the…

机器学习 · 统计学 2026-01-30 Dongyue Xie , Wanrong Zhu , Matthew Stephens