English
Related papers

Related papers: Variable selection in high-dimensional linear mode…

200 papers

Sparse penalized quantile regression provides an effective framework for variable selection and robust estimation in high-dimensional data analysis. When ex planatory variables are organized into groups, achieving sparsity both within and…

Computation · Statistics 2026-04-23 Huayan Kou , Yuwen Gu , Yi Lian , Rui Zhang , Jun Fan

Penalized likelihood approaches are widely used for high-dimensional regression. Although many methods have been proposed and the associated theory is now well-developed, the relative efficacy of different approaches in finite-sample…

Methodology · Statistics 2020-01-29 Fan Wang , Sach Mukherjee , Sylvia Richardson , Steven M. Hill

We consider regression problems where the number of predictors greatly exceeds the number of observations. We propose a method for variable selection that first estimates the regression function, yielding a "pre-conditioned" response…

Statistics Theory · Mathematics 2013-04-16 Debashis Paul , Eric Bair , Trevor Hastie , Robert Tibshirani

Augmenting a smooth cost function with an $\ell_1$ penalty allows analysts to efficiently conduct estimation and variable selection simultaneously in sophisticated models and can be efficiently implemented using proximal gradient methods.…

Machine Learning · Statistics 2024-12-10 Nathan Wycoff , Lisa O. Singh , Ali Arab , Katharine M. Donato

This article introduces lassopack, a suite of programs for regularized regression in Stata. lassopack implements lasso, square-root lasso, elastic net, ridge regression, adaptive lasso and post-estimation OLS. The methods are suitable for…

Econometrics · Economics 2019-01-17 Achim Ahrens , Christian B. Hansen , Mark E. Schaffer

For some special data in reality, such as the genetic data, adjacent genes may have the similar function. Thus ensuring the smoothness between adjacent genes is highly necessary. But, in this case, the standard lasso penalty just doesn't…

Methodology · Statistics 2022-09-29 Xin Xin , Boyi Xie , Yunhai Xiao

We consider the problem of non-parametric regression with a potentially large number of covariates. We propose a convex, penalized estimation framework that is particularly well-suited for high-dimensional sparse additive models. The…

Methodology · Statistics 2019-06-19 Asad Haris , Ali Shojaie , Noah Simon

A new method is proposed for variable screening, variable selection and prediction in linear regression problems where the number of predictors can be much larger than the number of observations. The method involves minimizing a penalized…

Statistics Theory · Mathematics 2017-09-14 D. Vasiliu , T. Dey , I. L. Dryden

In high-dimensional survival analysis, effective variable selection is crucial for both model interpretation and predictive performance. This paper investigates Cox regression with lasso and adaptive lasso penalties in genomic datasets…

Methodology · Statistics 2025-07-02 Pilar González-Barquero , Rosa E. Lillo , Álvaro Méndez-Civieta

Beta regression is commonly employed when the outcome variable is a proportion. Since its conception, the approach has been widely used in applications spanning various scientific fields. A series of extensions have been proposed over time,…

Methodology · Statistics 2025-07-29 Niloofar Ramezani , Martin Slawski

We consider a Bayesian approach to model selection in Gaussian linear regression, where the number of predictors might be much larger than the number of observations. From a frequentist view, the proposed procedure results in the penalized…

Statistics Theory · Mathematics 2010-09-14 Felix Abramovich , Vadim Grinshtein

The purpose of this article is to provide an adaptive estimator of the baseline function in the Cox model with high-dimensional covariates. We consider a two-step procedure : first, we estimate the regression parameter of the Cox model via…

Statistics Theory · Mathematics 2015-03-04 Agathe Guilloux , Sarah Lemler , Marie-Luce Taupin

We consider the problem of variable selection in varying-coefficient functional linear models, where multiple predictors are functions and a response is a scalar and depends on an exogenous variable. The varying-coefficient functional…

Methodology · Statistics 2021-10-26 Hidetoshi Matsui

We consider model selection in generalized linear models (GLM) for high-dimensional data and propose a wide class of model selection criteria based on penalized maximum likelihood with a complexity penalty on the model size. We derive a…

Statistics Theory · Mathematics 2016-03-31 Felix Abramovich , Vadim Grinshtein

We consider the problem of simultaneous variable selection and estimation in partially linear models with a divergent number of covariates in the linear part, under the assumption that the vector of regression coefficients is sparse. We…

Statistics Theory · Mathematics 2009-04-01 Huiliang Xie , Jian Huang

The adaptive LASSO has been used for consistent variable selection in place of LASSO in the linear regression model. In this article, we propose a modified LARS algorithm to combine adaptive LASSO with some biased estimators, namely the…

Methodology · Statistics 2024-07-02 Manickavasagar Kayanan , Pushpakanthie Wijekoon

We propose a novel approach for detecting change points in high-dimensional linear regression models. Unlike previous research that relied on strict Gaussian/sub-Gaussian error assumptions and had prior knowledge of change points, we…

Methodology · Statistics 2024-05-22 Bin Liu , Zhengling Qi , Xinsheng Zhang , Yufeng Liu

The adaptive lasso refers to a class of methods that use weighted versions of the $L_1$-norm penalty, with weights derived from an initial estimate of the parameter vector to be estimated. Irrespective of the method chosen to compute this…

Methodology · Statistics 2021-07-16 Ballout Nadim , Etievant Lola , Viallon Vivian

Partial linear models have been widely used as flexible method for modelling linear components in conjunction with non-parametric ones. Despite the presence of the non-parametric part, the linear, parametric part can under certain…

Statistics Theory · Mathematics 2013-07-04 Patric Müller , Sara van de Geer

We propose a novel model selection algorithm based on a penalized maximum likelihood estimator (PMLE) for functional hidden dynamic geostatistical models (f-HDGM). These models employ a classic mixed-effect regression structure with…

Methodology · Statistics 2023-10-24 Paolo Maranzano , Philipp Otto , Alessandro Fassò
‹ Prev 1 4 5 6 7 8 10 Next ›