English
Related papers

Related papers: A study of variable selection using g-prior distri…

200 papers

Consider the problem of high dimensional variable selection for the Gaussian linear model when the unknown error variance is also of interest. In this paper, we show that the use of conjugate shrinkage priors for Bayesian variable selection…

Methodology · Statistics 2025-04-17 Gemma E. Moran , Veronika Rockova , Edward I. George

In this paper, we consider Bayesian variable selection problem of linear regression model with global-local shrinkage priors on the regression coefficients. We propose a variable selection procedure that select a variable if the ratio of…

Methodology · Statistics 2016-05-26 Xueying Tang , Xiaofan Xu , Malay Ghosh , Prasenjit Ghosh

A statistical method for the elicitation of priors in Bayesian generalised linear models (GLMs) and extensions is proposed. Probabilistic predictions are elicited from the expert to parametrise a multivariate t prior distribution for the…

Methodology · Statistics 2025-02-21 Geoffrey R. Hosack

Bayesian model selection procedures based on nonlocal alternative prior densities are extended to ultrahigh dimensional settings and compared to other variable selection procedures using precision-recall curves. Variable selection…

Methodology · Statistics 2017-01-19 Minsuk Shin , Anirban Bhattacharya , Valen E. Johnson

We propose a novel Bayesian approach to the problem of variable selection in multiple linear regression models. In particular, we present a hierarchical setting which allows for direct specification of a-priori beliefs about the number of…

Computation · Statistics 2019-03-14 Konstantin Posch , Maximilian Arbeiter , Jürgen Pilz

Bayesian model selection poses two main challenges: the specification of parameter priors for all models, and the computation of the resulting Bayes factors between models. There is now a large literature on automatic and objective…

Methodology · Statistics 2016-08-11 Leonhard Held , Daniel Sabanés Bové , Isaac Gravestock

This paper develops some objective priors for certain parameters of the bivariate normal distribution. The parameters considered are the regression coefficient, the generalized variance, and the ratio of the conditional variance of one…

Statistics Theory · Mathematics 2008-12-18 Malay Ghosh , Upasana Santra , Dalho Kim

Gaussian processes (GPs) are widely used metamodels for approximating expensive computer simulations, particularly in engineering design and spatial prediction. However, their performance can deteriorate significantly when covariance…

Computation · Statistics 2025-11-17 Ayumi Mutoh , Junoh Heo

In this work, we show that under specific choices of the copula, the lasso, elastic net, and $g$-prior are particular cases of `copula prior,' for regularization and variable selection method. We present `lasso with Gauss copula prior' and…

Methodology · Statistics 2018-03-14 Rahul Sharma , Sourish Das

Ridge regression with random coefficients provides an important alternative to fixed coefficients regression in high dimensional setting when the effects are expected to be small but not zeros. This paper considers estimation and prediction…

Machine Learning · Statistics 2023-06-29 Hongzhe Zhang , Hongzhe Li

In high dimensional regression, global local shrinkage priors have gained significant traction for their ability to yield sparse estimates, improve parameter recovery, and support accurate predictive modeling. While recent work has explored…

Methodology · Statistics 2025-05-19 Javier Enrique Aguilar , Paul-Christian Bürkner

The behavior of Bayesian model averaging (BMA) for the normal linear regression model in the presence of influential observations that contribute to model misfit is investigated. Remedies to attenuate the potential negative impacts of such…

Methodology · Statistics 2021-11-23 Christopher M. Hans , Mario Peruggia , Junyan Wang

We propose new model selection criteria based on generalized ridge estimators dominating the maximum likelihood estimator under the squared risk and the Kullback-Leibler risk in multivariate linear regression. Our model selection criteria…

Statistics Theory · Mathematics 2016-04-08 Yuichi Mori , Taiji Suzuki

Variable selection and classification are common objectives in the analysis of high-dimensional data. Most such methods make distributional assumptions that may not be compatible with the diverse families of distributions data can take. A…

Methodology · Statistics 2019-08-28 Weichang Yu , Lamiae Azizi , John T. Ormerod

Mixture regression models are powerful tools for capturing heterogeneous covariate-response relationships, yet classical finite mixtures and Bayesian nonparametric alternatives often suffer from instability or overestimation of clusters…

Methodology · Statistics 2025-12-19 Yuta Hayashida , Shonosuke Sugasawa

General ridge estimators are widely used in the general linear model because they possess desirable properties such as linear sufficiency and linear admissibility. However, when the covariance matrix of the error term is partially unknown,…

Statistics Theory · Mathematics 2026-01-27 Hirai Mukasa

For high-dimensional linear regression models, we review and compare several estimators of variances $\tau^2$ and $\sigma^2$ of the random slopes and errors, respectively. These variances relate directly to ridge regression penalty…

Computation · Statistics 2019-02-08 Jurre R. Veerman , Gwenael G. R. Leday , Mark A. van de Wiel

In the context of a high-dimensional linear regression model, we propose the use of an empirical correlation-adaptive prior that makes use of information in the observed predictor variable matrix to adaptively address high collinearity,…

Methodology · Statistics 2022-07-04 Chang Liu , Yue Yang , Howard Bondell , Ryan Martin

High-dimensional linear regression has been thoroughly studied in the context of independent and identically distributed data. We propose to investigate high-dimensional regression models for independent but non-identically distributed…

Statistics Theory · Mathematics 2026-05-20 Jérémie Bigot , Issa-Mbenard Dabo , Camille Male

We study full Bayesian procedures for high-dimensional linear regression. We adopt data-dependent empirical priors introduced in [1]. In their paper, these priors have nice posterior contraction properties and are easy to compute. Our paper…

Statistics Theory · Mathematics 2022-02-14 Xiao Fang , Malay Ghosh