English
Related papers

Related papers: Beyond GAP screening for Lasso by exploiting new d…

200 papers

Screening rules allow to early discard irrelevant variables from the optimization in Lasso problems, or its derivatives, making solvers faster. In this paper, we propose new versions of the so-called $\textit{safe rules}$ for the Lasso.…

Machine Learning · Statistics 2015-12-07 Olivier Fercoq , Alexandre Gramfort , Joseph Salmon

This paper focusses on "safe" screening techniques for the LASSO problem. Motivated by the need for low-complexity algorithms, we propose a new approach, dubbed "joint" screening test, allowing to screen a set of atoms by carrying out one…

Machine Learning · Computer Science 2017-11-10 C. Herzet , A. Drémeau

Recently dictionary screening has been proposed as an effective way to improve the computational efficiency of solving the lasso problem, which is one of the most commonly used method for learning sparse representations. To address today's…

Machine Learning · Computer Science 2016-08-29 Yun Wang , Peter J. Ramadge

Lasso is a widely used regression technique to find sparse representations. When the dimension of the feature space and the number of samples are extremely large, solving the Lasso problem remains challenging. To improve the efficiency of…

Machine Learning · Computer Science 2014-10-17 Jie Wang , Peter Wonka , Jieping Ye

The lasso is a popular method to induce shrinkage and sparsity in the solution vector (coefficients) of regression problems, particularly when there are many predictors relative to the number of observations. Solving the lasso in this…

Machine Learning · Statistics 2024-05-14 Johan Larsson

In high dimensional settings, sparse structures are crucial for efficiency, either in term of memory, computation or performance. In some contexts, it is natural to handle more refined structures than pure sparsity, such as for instance…

Machine Learning · Statistics 2016-02-24 Eugene Ndiaye , Olivier Fercoq , Alexandre Gramfort , Joseph Salmon

Recently, to solve large-scale lasso and group lasso problems, screening rules have been developed, the goal of which is to reduce the problem size by efficiently discarding zero coefficients using simple rules independently of the others.…

Machine Learning · Statistics 2014-10-28 Seunghak Lee , Eric P. Xing

High dimensional regression benefits from sparsity promoting regularizations. Screening rules leverage the known sparsity of the solution by ignoring some variables in the optimization, hence speeding up solvers. When the procedure is…

Machine Learning · Statistics 2015-11-19 Eugene Ndiaye , Olivier Fercoq , Alexandre Gramfort , Joseph Salmon

Sparse optimization problems are ubiquitous in many fields such as statistics, signal/image processing and machine learning. This has led to the birth of many iterative algorithms to solve them. A powerful strategy to boost the performance…

Machine Learning · Computer Science 2023-01-09 Cassio F. Dantas , Emmanuel Soubies , Cédric Févotte

The problems of Lasso regression and optimal design of experiments share a critical property: their optimal solutions are typically \emph{sparse}, i.e., only a small fraction of the optimal variables are non-zero. Therefore, the…

Methodology · Statistics 2023-12-07 Guillaume Sagnol , Luc Pronzato

This paper is a survey of dictionary screening for the lasso problem. The lasso problem seeks a sparse linear combination of the columns of a dictionary to best match a given target vector. This sparse representation has proven useful in a…

Machine Learning · Computer Science 2016-08-23 Zhen James Xiang , Yun Wang , Peter J. Ramadge

Detecting changepoints in a one-dimensional signal is a classical yet fundamental problem. The fused lasso provides an elegant convex formulation that produces a stepwise estimate of the mean, but quantifying the uncertainty of the detected…

Statistics Theory · Mathematics 2025-11-13 Rieko Tasaka , Tatsuya Kimura , Joe Suzuki

In high dimensional regression settings, sparsity enforcing penalties have proved useful to regularize the data-fitting term. A recently introduced technique called screening rules propose to ignore some variables in the optimization…

Machine Learning · Statistics 2017-12-29 Eugene Ndiaye , Olivier Fercoq , Alexandre Gramfort , Joseph Salmon

We introduce the LOCal Universe Screening Test Suite (LOCUSTS) project, an effort to create 'screening maps' in the nearby Universe to identify regions in our neighbourhood which are screened, i.e., regions where deviations from General…

Cosmology and Nongalactic Astrophysics · Physics 2019-09-18 Shi Shao , Baojiu Li , Marius Cautun , Huiyuan Wang , Jie Wang

Sparse learning techniques have been routinely used for feature selection as the resulting model usually has a small number of non-zero entries. Safe screening, which eliminates the features that are guaranteed to have zero coefficients for…

Machine Learning · Computer Science 2014-05-13 Jun Liu , Zheng Zhao , Jie Wang , Jieping Ye

This paper introduces a framework that utilizes the Safe Screening technique to accelerate the optimization process of the Unbalanced Optimal Transport (UOT) problem by proactively identifying and eliminating zero elements in the sparse…

Optimization and Control · Mathematics 2023-07-04 Xun Su , Zhongxi Fang , Hiroyuki Kasai

In surgical oncology, it is challenging for surgeons to identify lymph nodes and completely resect cancer even with pre-operative imaging systems like PET and CT, because of the lack of reliable intraoperative visualization tools.…

Image and Video Processing · Electrical Eng. & Systems 2023-07-10 Baoru Huang , Yicheng Hu , Anh Nguyen , Stamatia Giannarou , Daniel S. Elson

Fused Lasso was proposed to characterize the sparsity of the coefficients and the sparsity of their successive differences for the linear regression. Due to its wide applications, there are many existing algorithms to solve fused Lasso.…

Computation · Statistics 2024-04-17 Pan Shang , Huangyue Chen , Lingchen Kong

Recent computational strategies based on screening tests have been proposed to accelerate algorithms addressing penalized sparse regression problems such as the Lasso. Such approaches build upon the idea that it is worth dedicating some…

Machine Learning · Statistics 2015-10-28 Antoine Bonnefoy , Valentin Emiya , Liva Ralaivola , Rémi Gribonval

The Lasso is one of the most important approaches for parameter estimation and variable selection in high dimensional linear regression. At the heart of its success is the attractive rate of convergence result even when $p$, the dimension…

Statistics Theory · Mathematics 2019-08-09 Junlong Zhao , Chenlei Leng
‹ Prev 1 2 3 10 Next ›