English
Related papers

Related papers: Two-Step Mixed-Type Multivariate Bayesian Sparse V…

200 papers

Bayesian computation of high dimensional linear regression models with a popular Gaussian scale mixture prior distribution using Markov Chain Monte Carlo (MCMC) or its variants can be extremely slow or completely prohibitive due to the…

Methodology · Statistics 2021-05-12 Rajarshi Guhaniyogi , Aaron Scheffler

Many methods have been developed to estimate the set of relevant variables in a sparse linear model Y= XB+e where the dimension p of B can be much higher than the length n of Y. Here we propose two new methods based on multiple hypotheses…

Statistics Theory · Mathematics 2012-06-12 Florian Rohart

Sparse regression based on global-local shrinkage priors are increasingly used for Bayesian modeling of modern high-dimensional data, but scaling up the Gibbs sampler for posterior inference remains a challenge. While much effort has gone…

Methodology · Statistics 2026-05-08 Andrew Chin , Xiyu Ding , Akihiko Nishimura

The training of high-dimensional regression models on comparably sparse data is an important yet complicated topic, especially when there are many more model parameters than observations in the data. From a Bayesian perspective, inference…

Methodology · Statistics 2025-03-03 Javier Enrique Aguilar , Paul-Christian Bürkner

Bayesian nonparametric regression under a rescaled Gaussian process prior offers smoothness-adaptive function estimation with near minimax-optimal error rates. Hierarchical extensions of this approach, equipped with stochastic variable…

Statistics Theory · Mathematics 2020-12-15 Sheng Jiang , Surya T. Tokdar

Clustering is one of the most widely used procedures in the analysis of microarray data, for example with the goal of discovering cancer subtypes based on observed heterogeneity of genetic marks between different tissues. It is well-known…

Methodology · Statistics 2009-04-21 Heng Lian

The choice of tuning parameters in Bayesian variable selection is a critical problem in modern statistics. In particular, for Bayesian linear regression with non-local priors, the scale parameter in the non-local prior density is an…

Statistics Theory · Mathematics 2019-02-25 Xuan Cao , Kshitij Khare , Malay Ghosh

This paper addresses the weak instruments problem in linear instrumental variable models from a Bayesian perspective. The new approach has two components. First, a novel predictor-dependent shrinkage prior is developed for the many…

Methodology · Statistics 2014-08-05 P. Richard Hahn , Hedibert Lopes

Time-varying parameter (TVP) models are very flexible in capturing gradual changes in the effect of a predictor on the outcome variable. However, in particular when the number of predictors is large, there is a known risk of overfitting and…

Econometrics · Economics 2019-12-09 Annalisa Cadonna , Sylvia Frühwirth-Schnatter , Peter Knaus

We consider Bayesian inference of sparse covariance matrices and propose a post-processed posterior. This method consists of two steps. In the first step, posterior samples are obtained from the conjugate inverse-Wishart posterior without…

Statistics Theory · Mathematics 2021-08-24 Kwangmin Lee , Jaeyong Lee

We propose a new approach to mixed-frequency regressions in a high-dimensional environment that resorts to Group Lasso penalization and Bayesian techniques for estimation and inference. In particular, to improve the prediction properties of…

Econometrics · Economics 2020-06-12 Matteo Mogliani , Anna Simoni

Bayesian variable selection has gained much empirical success recently in a variety of applications when the number $K$ of explanatory variables $(x_1,...,x_K)$ is possibly much larger than the sample size $n$. For generalized linear…

Statistics Theory · Mathematics 2009-09-29 Wenxin Jiang

Consider a problem of predicting a response variable using a set of covariates in a linear regression model. If it is \emph{a priori} known or suspected that a subset of the covariates do not significantly contribute to the overall fit of…

Applications · Statistics 2011-09-13 SM Enayetur Raheem , S. Ejaz Ahmed

Numerous variable selection methods rely on a two-stage procedure, where a sparsity-inducing penalty is used in the first stage to predict the support, which is then conveyed to the second stage for estimation or inference purposes. In this…

Applications · Statistics 2015-05-28 Jean-Michel Bécu , Yves Grandvalet , Christophe Ambroise , Cyril Dalmasso

Bayesian model selection provides a powerful framework for objectively comparing models directly from observed data, without reference to ground truth data. However, Bayesian model selection requires the computation of the marginal…

Methodology · Statistics 2024-01-17 Xiaohao Cai , Jason D. McEwen , Marcelo Pereyra

Ultra-high-dimensional tensor predictors are increasingly common in neuroimaging and other biomedical studies, yet existing methods rarely integrate continuous, count, and binary responses in a single coherent model. We present a Bayesian…

Methodology · Statistics 2025-05-21 Shao-Hsuan Wang , Hsin-Hsiung Huang

Polynomial chaos expansion (PCE) is a versatile tool widely used in uncertainty quantification and machine learning, but its successful application depends strongly on the accuracy and reliability of the resulting PCE-based response…

Computation · Statistics 2023-06-14 Paul-Christian Bürkner , Ilja Kröker , Sergey Oladyshkin , Wolfgang Nowak

We develop a fast and accurate grouped penalized credible region approach for variable selection and prediction in Bayesian high-dimensional linear regression. Most existing Bayesian methods either are subject to high computational costs…

Methodology · Statistics 2026-01-26 Weichang Yu , Khue-Dung Dang

We aim to incorporate variable selection routines into variable-by-variable (or sequential) imputation in clustered data to achieve computational improvement in applications with large-scale health data. Specifically, we utilize variable…

Methodology · Statistics 2025-04-08 Qiushuang Li , Recai Yucel

Two-component mixture priors provide a traditional way to induce sparsity in high-dimensional Bayes models. However, several aspects of such a prior, including computational complexities in high-dimensions, interpretation of exact zeros and…

Statistics Theory · Mathematics 2016-05-19 Anirban Bhattacharya , David B. Dunson , Debdeep Pati , Natesh S. Pillai