English
Related papers

Related papers: Robust Bayesian Nonparametric Variable Selection f…

200 papers

Gene-environment (G$\times$E) interactions have important implications to elucidate the etiology of complex diseases beyond the main genetic and environmental effects. Outliers and data contamination in disease phenotypes of G$\times$E…

Methodology · Statistics 2020-06-11 Jie Ren , Fei Zhou , Xiaoxi Li , Shuangge Ma , Yu Jiang , Cen Wu

The development of parsimonious models for reliable inference and prediction of responses in high-dimensional regression settings is often challenging due to relatively small sample sizes and the presence of complex interaction patterns…

Methodology · Statistics 2016-04-15 Subharup Guha , Veerabhadran Baladandayuthapani

A fully Bayesian approach is proposed for ultrahigh-dimensional nonparametric additive models in which the number of additive components may be larger than the sample size, though ideally the true model is believed to include only a small…

Methodology · Statistics 2013-09-24 Zuofeng Shang , Ping Li

We incorporate heteroskedasticity into Bayesian Additive Regression Trees (BART) by modeling the log of the error variance parameter as a linear function of prespecified covariates. Under this scheme, the Gibbs sampling procedure for the…

Methodology · Statistics 2014-02-24 Justin Bleich , Adam Kapelner

In binary-transaction data-mining, traditional frequent itemset mining often produces results which are not straightforward to interpret. To overcome this problem, probability models are often used to produce more compact and conclusive…

Machine Learning · Computer Science 2012-09-27 Ruefei He , Jonathan Shapiro

There has been an intense development on the estimation of a sparse regression coefficient vector in statistics, machine learning and related fields. In this paper, we focus on the Bayesian approach to this problem, where sparsity is…

Computation · Statistics 2016-02-25 Xichen Huang , Jin Wang , Feng Liang

We introduce the spike-and-slab group lasso (SSGL) for Bayesian estimation and variable selection in linear regression with grouped variables. We further extend the SSGL to sparse generalized additive models (GAMs), thereby introducing the…

Methodology · Statistics 2020-07-29 Ray Bai , Gemma E. Moran , Joseph Antonelli , Yong Chen , Mary R. Boland

This paper investigates the high-dimensional linear regression with highly correlated covariates. In this setup, the traditional sparsity assumption on the regression coefficients often fails to hold, and consequently many model selection…

Methodology · Statistics 2019-03-26 Jianqing Fan , Bai Jiang , Qiang Sun

Latent autoregressive processes are a popular choice to model time varying parameters. These models can be formulated as nonlinear state space models for which inference is not straightforward due to the high number of parameters. Therefore…

Computation · Statistics 2019-11-01 Alexander Kreuzer , Claudia Czado

We propose a cautious Bayesian variable selection routine by investigating the sensitivity of a hierarchical model, where the regression coefficients are specified by spike and slab priors. We exploit the use of latent variables to…

Methodology · Statistics 2022-06-20 Tathagata Basu , Matthias C. M. Troffaes , Jochen Einbeck

We consider heteroscedastic nonparametric regression models, when both the mean function and variance function are unknown and to be estimated with nonparametric approaches. We derive convergence rates of posterior distributions for this…

Statistics Theory · Mathematics 2010-10-07 Yuao Hu

We propose a Bayesian variable selection method in the framework of modal regression for heavy-tailed responses. An efficient expectation-maximization algorithm is employed to expedite parameter estimation. A test statistic is constructed…

Methodology · Statistics 2025-10-29 Jiasong Duan , Hongmei Zhang , Xianzheng Huang

The SLOPE estimates regression coefficients by minimizing a regularized residual sum of squares using a sorted-$\ell_1$-norm penalty. The SLOPE combines testing and estimation in regression problems. It exhibits suitable variable selection…

Methodology · Statistics 2016-09-02 Amir Sepehri

Principal component regression uses principal components as regressors. It is particularly useful in prediction settings with high-dimensional covariates. The existing literature treating of Bayesian approaches is relatively sparse. We…

Methodology · Statistics 2020-01-28 Philippe Gagnon , Mylène Bédard , Alain Desgagné

Modern regression analyses are often undermined by covariate measurement error, misspecification of the regression model, and misspecification of the measurement error distribution. We present, to the best of our knowledge, the first…

Methodology · Statistics 2026-03-25 Mengqi Chen , Charita Dellaporta , Thomas B. Berrett , Theodoros Damoulas

Variable selection and classification are common objectives in the analysis of high-dimensional data. Most such methods make distributional assumptions that may not be compatible with the diverse families of distributions data can take. A…

Methodology · Statistics 2019-08-28 Weichang Yu , Lamiae Azizi , John T. Ormerod

Large-scale modern data often involves estimation and testing for high-dimensional unknown parameters. It is desirable to identify the sparse signals, ``the needles in the haystack'', with accuracy and false discovery control. However, the…

Machine Learning · Computer Science 2021-11-08 Junhui Cai , Xu Han , Ya'acov Ritov , Linda Zhao

Variable selection is an important statistical problem. This problem becomes more challenging when the candidate predictors are of mixed type (e.g. continuous and binary) and impact the response variable in nonlinear and/or non-additive…

Methodology · Statistics 2021-12-30 Chuji Luo , Michael J. Daniels

We develop a Bayesian nonparametric autoregressive model applied to flexibly estimate general transition densities exhibiting nonlinear lag dependence. Our approach is related to Bayesian density regression using Dirichlet process mixtures,…

Methodology · Statistics 2023-02-14 Matthew Heiner , Athanasios Kottas

Inference in the presence of outliers is an important field of research as outliers are ubiquitous and may arise across a variety of problems and domains. Bayesian optimization is method that heavily relies on probabilistic inference. This…

Machine Learning · Computer Science 2017-12-14 Ruben Martinez-Cantin , Kevin Tee , Michael McCourt