中文
相关论文

相关论文: Lasso Screening Rules via Dual Polytope Projection

200 篇论文

Selective Inference (SI) has been actively studied in the past few years for conducting inference on the features of linear models that are adaptively selected by feature selection methods such as Lasso. The basic idea of SI is to make…

机器学习 · 统计学 2021-02-23 Vo Nguyen Le Duy , Ichiro Takeuchi

This paper introduces a framework that utilizes the Safe Screening technique to accelerate the optimization process of the Unbalanced Optimal Transport (UOT) problem by proactively identifying and eliminating zero elements in the sparse…

最优化与控制 · 数学 2023-07-04 Xun Su , Zhongxi Fang , Hiroyuki Kasai

It is well-known that the statistical performance of Lasso can suffer significantly when the covariates of interest have strong correlations. In particular, the prediction error of Lasso becomes much worse than computationally inefficient…

机器学习 · 统计学 2024-02-26 Jonathan Kelner , Frederic Koehler , Raghu Meka , Dhruv Rohatgi

Inference for high-dimensional logistic regression models using penalized methods has been a challenging research problem. As an illustration, a major difficulty is the significant bias of the Lasso estimator, which limits its direct…

统计方法学 · 统计学 2024-10-29 Yuming Zhang , Stéphane Guerrier , Runze Li

Inferring network structures remains an interesting question for its importance on the understanding and controlling collective dynamics of complex systems. The existing shrinking methods such as Lasso-type estimation can not suitably…

统计理论 · 数学 2025-09-03 Lei Shi , Jie Hu , Huaiyu Tan , Libin Jin , Wei Zhong , Chen Shen

A sparse modeling is a major topic in machine learning and statistics. LASSO (Least Absolute Shrinkage and Selection Operator) is a popular sparse modeling method while it has been known to yield unexpected large bias especially at a sparse…

机器学习 · 计算机科学 2018-08-23 Katsuyuki Hagiwara

We describe a fast method to eliminate features (variables) in l1 -penalized least-square regression (or LASSO) problems. The elimination of features leads to a potentially substantial reduction in running time, specially for large values…

机器学习 · 计算机科学 2011-05-19 Laurent El Ghaoui , Vivian Viallon , Tarek Rabbani

Estimating a prediction function is a fundamental component of many data analyses. The super learner ensemble, a particular implementation of stacking, has desirable theoretical properties and has been used successfully in many…

机器学习 · 统计学 2025-10-23 Brian D. Williamson , Drew King , Ying Huang

We study the problem of variable selection in convex nonparametric least squares (CNLS). Whereas the least absolute shrinkage and selection operator (Lasso) is a popular technique for least squares, its variable selection performance is…

统计方法学 · 统计学 2025-10-31 Zhiqiang Liao , Zhaonan Qu

We introduce a recursive adaptive group lasso algorithm for real-time penalized least squares prediction that produces a time sequence of optimal sparse predictor coefficient vectors. At each time index the proposed algorithm computes an…

统计方法学 · 统计学 2015-05-27 Yilun Chen , Alfred O. Hero

Penalized regression is an attractive framework for variable selection problems. Often, variables possess a grouping structure, and the relevant selection problem is that of selecting groups, not individual variables. The group lasso has…

统计计算 · 统计学 2016-07-20 Patrick Breheny , Jian Huang

In a polynomial regression model, the divisibility conditions implicit in polynomial hierarchy give way to a natural construction of constraints for the model parameters. We use this principle to derive versions of strong and weak hierarchy…

统计计算 · 统计学 2020-01-23 Hugo Maruri-Aguilar , Simon Lunagomez

In high dimensional settings, sparse structures are crucial for efficiency, both in term of memory, computation and performance. It is customary to consider $\ell_1$ penalty to enforce sparsity in such scenarios. Sparsity enforcing methods,…

机器学习 · 统计学 2017-11-22 Eugene Ndiaye , Olivier Fercoq , Alexandre Gramfort , Vincent Leclère , Joseph Salmon

The LASSO-Patternsearch algorithm is proposed to efficiently identify patterns of multiple dichotomous risk factors for outcomes of interest in demographic and genomic studies. The patterns considered are those that arise naturally from the…

统计理论 · 数学 2008-03-07 Weiliang Shi , Grace Wahba , Stephen Wright , Kristine Lee , Ronald Klein , Barbara Klein

Supersaturated designs investigate more factors than there are runs, and are often constructed under a criterion measuring a design's proximity to an unattainable orthogonal design. The most popular analysis identifies active factors by…

Recent work has focused on the problem of conducting linear regression when the number of covariates is very large, potentially greater than the sample size. To facilitate this, one useful tool is to assume that the model can be well…

统计方法学 · 统计学 2011-11-21 Zhou Fang

The Lasso is a prominent algorithm for variable selection. However, its instability in the presence of correlated variables in the high-dimensional setting is well-documented. Although previous research has attempted to address this issue…

统计方法学 · 统计学 2025-05-28 Mahdi Nouraie , Connor Smith , Samuel Muller

We consider the least-square linear regression problem with regularization by the $\ell^1$-norm, a problem usually referred to as the Lasso. In this paper, we first present a detailed asymptotic analysis of model consistency of the Lasso in…

机器学习 · 计算机科学 2009-01-22 Francis Bach

The LASSO is an attractive regularisation method for linear regression that combines variable selection with an efficient computation procedure. This paper is concerned with enhancing the performance of LASSO for square-free hierarchical…

统计方法学 · 统计学 2023-05-10 Shaoxiong Hu , Hugo Maruri-Aguliar , Zixiang Ma

The Lasso has been widely used as a method for variable selection, valued for its simplicity and empirical performance. However, Lasso's selection stability deteriorates in the presence of correlated predictors. Several approaches have been…

统计方法学 · 统计学 2025-11-05 Mahdi Nouraie , Houying Zhu , Samuel Muller