English
Related papers

Related papers: Hybrid safe-strong rules for efficient optimizatio…

200 papers

Extracting relevant features from data sets where the number of observations ($n$) is much smaller then the number of predictors ($p$) is a major challenge in modern statistics. Sorted L-One Penalized Estimation (SLOPE), a generalization of…

Machine Learning · Statistics 2024-05-14 Johan Larsson , Małgorzata Bogdan , Jonas Wallin

Fused Lasso was proposed to characterize the sparsity of the coefficients and the sparsity of their successive differences for the linear regression. Due to its wide applications, there are many existing algorithms to solve fused Lasso.…

Computation · Statistics 2024-04-17 Pan Shang , Huangyue Chen , Lingchen Kong

Screening rules allow to early discard irrelevant variables from the optimization in Lasso problems, or its derivatives, making solvers faster. In this paper, we propose new versions of the so-called $\textit{safe rules}$ for the Lasso.…

Machine Learning · Statistics 2015-12-07 Olivier Fercoq , Alexandre Gramfort , Joseph Salmon

Lasso is a widely used regression technique to find sparse representations. When the dimension of the feature space and the number of samples are extremely large, solving the Lasso problem remains challenging. To improve the efficiency of…

Machine Learning · Computer Science 2014-10-17 Jie Wang , Peter Wonka , Jieping Ye

The lasso is a popular method to induce shrinkage and sparsity in the solution vector (coefficients) of regression problems, particularly when there are many predictors relative to the number of observations. Solving the lasso in this…

Machine Learning · Statistics 2024-05-14 Johan Larsson

In high dimensional settings, sparse structures are crucial for efficiency, either in term of memory, computation or performance. In some contexts, it is natural to handle more refined structures than pure sparsity, such as for instance…

Machine Learning · Statistics 2016-02-24 Eugene Ndiaye , Olivier Fercoq , Alexandre Gramfort , Joseph Salmon

Predictor screening rules, which discard predictors before fitting a model, have had considerable impact on the speed with which sparse regression problems, such as the lasso, can be solved. In this paper we present a new screening rule for…

Machine Learning · Statistics 2024-05-14 Johan Larsson , Jonas Wallin

In high dimensional regression settings, sparsity enforcing penalties have proved useful to regularize the data-fitting term. A recently introduced technique called screening rules propose to ignore some variables in the optimization…

Machine Learning · Statistics 2017-12-29 Eugene Ndiaye , Olivier Fercoq , Alexandre Gramfort , Joseph Salmon

Distributed optimization has been widely used as one of the most efficient approaches for model training with massive samples. However, large-scale learning problems with both massive samples and high-dimensional features widely exist in…

Machine Learning · Computer Science 2022-04-26 Runxue Bao , Xidong Wu , Wenhan Xian , Heng Huang

Directly solving large-scale Integer Linear Programs (ILPs) using traditional solvers is slow due to their NP-hard nature. While recent frameworks based on Large Neighborhood Search (LNS) can accelerate the solving process, their…

Machine Learning · Computer Science 2025-09-23 Ning Xu , Junkai Zhang , Yang Wu , Huigen Ye , Hua Xu , Huiling Xu , Yifan Zhang

The high-dimensional rank lasso (hdr lasso) model is an efficient approach to deal with high-dimensional data analysis. It was proposed as a tuning-free robust approach for the high-dimensional regression and was demonstrated to enjoy…

Optimization and Control · Mathematics 2024-04-19 Xiaoning Bai , Qingna Li

The problems of Lasso regression and optimal design of experiments share a critical property: their optimal solutions are typically \emph{sparse}, i.e., only a small fraction of the optimal variables are non-zero. Therefore, the…

Methodology · Statistics 2023-12-07 Guillaume Sagnol , Luc Pronzato

In many modern data sets, High dimension low sample size (HDLSS) data is prevalent in many fields of studies. There has been an increased focus recently on using machine learning and statistical methods to mine valuable information out of…

Optimization and Control · Mathematics 2023-05-23 Srivathsan Amruth , Xin Yee Lam

Taking into account high-order interactions among covariates is valuable in many practical regression problems. This is, however, computationally challenging task because the number of high-order interaction features to be considered would…

Machine Learning · Statistics 2015-06-29 Kazuya Nakagawa , Shinya Suzumura , Masayuki Karasuyama , Koji Tsuda , Ichiro Takeuchi

High dimensional regression benefits from sparsity promoting regularizations. Screening rules leverage the known sparsity of the solution by ignoring some variables in the optimization, hence speeding up solvers. When the procedure is…

Machine Learning · Statistics 2015-11-19 Eugene Ndiaye , Olivier Fercoq , Alexandre Gramfort , Joseph Salmon

With the rapid development of big data and cloud computing, data management has become increasingly challenging. Over the years, a number of frameworks for data management and storage with various characteristics and features have become…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-16 Tianru Zhang , Salman Toor , Andreas Hellander

In variable or graph selection problems, finding a right-sized model or controlling the number of false positives is notoriously difficult. Recently, a meta-algorithm called Stability Selection was proposed that can provide reliable…

Machine Learning · Statistics 2017-12-14 George Philipp , Seunghak Lee , Eric P. Xing

We consider the problem of learning a sparse rule model, a prediction model in the form of a sparse linear combination of rules, where a rule is an indicator function defined over a hyper-rectangle in the input space. Since the number of…

Machine Learning · Statistics 2025-03-13 Hiroki Kato , Hiroyuki Hanada , Ichiro Takeuchi

Over the last years collaborative robots have gained great success in manufacturing applications where human and robot work together in close proximity. However, current ISO/TS-15066-compliant implementations often limit the efficiency of…

Robotics · Computer Science 2025-11-25 David Bricher , Andreas Mueller

Estimating a prediction function is a fundamental component of many data analyses. The super learner ensemble, a particular implementation of stacking, has desirable theoretical properties and has been used successfully in many…

Machine Learning · Statistics 2025-10-23 Brian D. Williamson , Drew King , Ying Huang
‹ Prev 1 2 3 10 Next ›