English
Related papers

Related papers: Broken Adaptive Ridge Method for Variable Selectio…

200 papers

We consider the problem of constructing an adaptive bridge regression modeling, which is a penalized procedure by imposing different weights to different coefficients in the bridge penalty term. A crucial issue in the modeling process is…

Methodology · Statistics 2013-02-15 Shuichi Kawano

We propose some extensions to semi-parametric models based on Bayesian additive regression trees (BART). In the semi-parametric BART paradigm, the response variable is approximated by a linear predictor and a BART model, where the linear…

Machine Learning · Statistics 2026-03-10 Estevão B. Prado , Andrew C. Parnell , Keefe Murphy , Nathan McJames , Ann O'Shea , Rafael A. Moral

In many longitudinal studies, the covariate and response are often intermittently observed at irregular, mismatched and subject-specific times. How to deal with such data when covariate and response are observed asynchronously is an often…

Methodology · Statistics 2021-08-27 Hao Ran , Yang Bai

Current status data are commonly encountered in medical and epidemiological studies in which the failure time for study units is the outcome variable of interest. Data of this form are characterized by the fact that the failure time is not…

Methodology · Statistics 2019-04-25 Yan Liu , Minggen Lu , Christopher S. McMahan

Variable selection is an important statistical problem. This problem becomes more challenging when the candidate predictors are of mixed type (e.g. continuous and binary) and impact the response variable in nonlinear and/or non-additive…

Methodology · Statistics 2021-12-30 Chuji Luo , Michael J. Daniels

In this paper we propose the Highly Adaptive Ridge (HAR): a regression method that achieves a $n^{-1/3}$ dimension-free L2 convergence rate in the class of right-continuous functions with square-integrable sectional derivatives. This is a…

Machine Learning · Statistics 2024-10-04 Alejandro Schuler , Alexander Hagemeister , Mark van der Laan

This paper introduces BART-RDD, a sum-of-trees regression model built around a novel regression tree prior, which incorporates the special covariate structure of regression discontinuity designs. Specifically, the tree splitting process is…

Methodology · Statistics 2024-07-22 Rafael Alcantara , Meijia Wang , P. Richard Hahn , Hedibert Lopes

Personalization is becoming an important feature in many predictive applications. We introduce a penalized regression method implementing personalization inherently in the penalty. Personalized angle (PAN) regression constructs regression…

Methodology · Statistics 2020-01-30 Kristoffer H. Hellton

This paper focuses on variable selection for a partially linear single-index varying-coefficient model. A regularized variable selection procedure by combining basis function approximations with SCAD penalty is proposed. It can…

Statistics Theory · Mathematics 2024-12-19 Lijuan Han , Liugen Xue , Junshan Xie

This paper develops a performant Bayesian approach to conditional average treatment effect (CATE) estimation in regression discontinuity designs (RDD), an increasingly prevalent form of quasi-experiment that facilitates causal inference.…

Methodology · Statistics 2026-05-18 Rafael Alcantara , P. Richard Hahn , Hedibert F. Lopes

I propose kernel ridge regression estimators for nonparametric dose response curves and semiparametric treatment effects in the setting where an analyst has access to a selected sample rather than a random sample; only for select…

Econometrics · Economics 2022-08-24 Rahul Singh

Nonparametric regression models with locally stationary covariates have received increasing interest in recent years. As a nice relief of "curse of dimensionality" induced by large dimension of covariates, additive regression model is…

Statistics Theory · Mathematics 2016-12-02 Lixia Hu , Tao Huang , Jinhong You

Variable selection naturally arises as a useful subject when faced with data with massive predictor space. In addition to the massive dimensionality, the data may be characterized by intra-subject correlation, and cure fraction, which are…

Methodology · Statistics 2025-12-24 Richard Tawiah , Shu Kay Ng , Geoffrey J. McLachlan

We propose a new method for the simultaneous selection and estimation of multivariate sparse additive models with correlated errors. Our method called Covariance Assisted Multivariate Penalized Additive Regression (CoMPAdRe) simultaneously…

We introduce the arbitrary rectangle-range generalized elastic net penalty method, abbreviated to ARGEN, for performing constrained variable selection and regularization in high-dimensional sparse linear models. As a natural extension of…

Machine Learning · Statistics 2021-12-16 Yujia Ding , Qidi Peng , Zhengming Song , Hansen Chen

We incorporate heteroskedasticity into Bayesian Additive Regression Trees (BART) by modeling the log of the error variance parameter as a linear function of prespecified covariates. Under this scheme, the Gibbs sampling procedure for the…

Methodology · Statistics 2014-02-24 Justin Bleich , Adam Kapelner

We consider the task of discovering gene regulatory networks, which are defined as sets of genes and the corresponding transcription factors which regulate their expression levels. This can be viewed as a variable selection problem,…

Methodology · Statistics 2014-12-04 Justin Bleich , Adam Kapelner , Edward I. George , Shane T. Jensen

In the era of precision medicine, genome-wide epigenetic modifications offer rich data that could inform risk prediction. However, these data are high-dimensional and exhibit complex dependence structures, which makes it difficult to…

Applications · Statistics 2026-05-25 Saurabh Bhandari , Parveen Bhatti , Brian C. -H. Chiu , Yuan Ji

While shrinkage is essential in high-dimensional settings, its use for low-dimensional regression-based prediction has been debated. It reduces variance, often leading to improved prediction accuracy. However, it also inevitably introduces…

In modern randomized experiments, large-scale data collection increasingly yields rich baseline covariates and auxiliary information from multiple sources. Such information offers opportunities for more precise treatment effect estimation,…

Methodology · Statistics 2026-03-10 Wei Ma , Zeqi Wu , Zheng Zhang