中文
相关论文

相关论文: Safe rules for the identification of zeros in the …

200 篇论文

Extracting relevant features from data sets where the number of observations ($n$) is much smaller then the number of predictors ($p$) is a major challenge in modern statistics. Sorted L-One Penalized Estimation (SLOPE), a generalization of…

机器学习 · 统计学 2024-05-14 Johan Larsson , Małgorzata Bogdan , Jonas Wallin

The lasso is the most famous sparse regression and feature selection method. One reason for its popularity is the speed at which the underlying optimization problem can be solved. Sorted L-One Penalized Estimation (SLOPE) is a…

最优化与控制 · 数学 2024-05-14 Johan Larsson , Quentin Klopfenstein , Mathurin Massias , Jonas Wallin

Sorted L-One Penalized Estimation is a relatively new convex optimization procedure which allows for adaptive selection of regressors under sparse high dimensional designs. Here we extend the idea of SLOPE to deal with the situation when…

统计理论 · 数学 2015-12-01 Damian Brzyski , Weijie Su , Małgorzata Bogdan

We introduce a new estimator for the vector of coefficients $\beta$ in the linear model $y=X\beta+z$, where $X$ has dimensions $n\times p$ with $p$ possibly larger than $n$. SLOPE, short for Sorted L-One Penalized Estimation, is the…

统计方法学 · 统计学 2015-11-05 Małgorzata Bogdan , Ewout van den Berg , Chiara Sabatti , Weijie Su , Emmanuel J. Candès

Sorted L-One Penalized Estimation (SLOPE) is a relatively new convex optimization procedure which allows for adaptive selection of regressors under sparse high dimensional designs. Here we extend the idea of SLOPE to deal with the situation…

统计方法学 · 统计学 2016-10-18 Damian Brzyski , Alexej Gossmann , Weijie Su , Malgorzata Bogdan

The l1-regularized logistic regression (or sparse logistic regression) is a widely used method for simultaneous classification and feature selection. Although many recent efforts have been devoted to its efficient implementation, its…

机器学习 · 计算机科学 2013-07-22 Jie Wang , Jiayu Zhou , Jun Liu , Peter Wonka , Jieping Ye

Tuning the regularization parameter in penalized regression models is an expensive task, requiring multiple models to be fit along a path of parameters. Strong screening rules drastically reduce computational costs by lowering the…

机器学习 · 统计学 2025-05-07 Fabio Feser , Marina Evangelou

Variable selection is a challenging problem in high-dimensional sparse learning, especially when group structures exist. Group SLOPE performs well for the adaptive selection of groups of predictors. However, the block non-separable group…

机器学习 · 计算机科学 2025-06-12 Runxue Bao , Quanchao Lu , Yanfu Zhang

We introduce a novel method for sparse regression and variable selection, which is inspired by modern ideas in multiple testing. Imagine we have observations from the linear model y = X beta + z, then we suggest estimating the regression…

统计方法学 · 统计学 2013-10-30 Malgorzata Bogdan , Ewout van den Berg , Weijie Su , Emmanuel Candes

We present a novel screening methodology to safely discard irrelevant nodes within a generic branch-and-bound (BnB) algorithm solving the l0-penalized least-squares problem. Our contribution is a set of two simple tests to detect sets of…

信号处理 · 电气工程与系统科学 2022-02-04 Théo Guyard , Cédric Herzet , Clément Elvira

SLOPE is a relatively new convex optimization procedure for high-dimensional linear regression via the sorted l1 penalty: the larger the rank of the fitted coefficient, the larger the penalty. This non-separable penalty renders many…

机器学习 · 统计学 2019-07-18 Zhiqi Bu , Jason Klusowski , Cynthia Rush , Weijie Su

This work studies the problem of sparse signal recovery with automatic grouping of variables. To this end, we investigate sorted nonsmooth penalties as a regularization approach for generalized linear models. We focus on a family of sorted…

最优化与控制 · 数学 2025-06-19 Anne Gagneux , Mathurin Massias , Emmanuel Soubies

This paper introduces a framework that utilizes the Safe Screening technique to accelerate the optimization process of the Unbalanced Optimal Transport (UOT) problem by proactively identifying and eliminating zero elements in the sparse…

最优化与控制 · 数学 2023-07-04 Xun Su , Zhongxi Fang , Hiroyuki Kasai

In linear regression, SLOPE is a new convex analysis method that generalizes the Lasso via the sorted L1 penalty: larger fitted coefficients are penalized more heavily. This magnitude-dependent regularization requires an input of penalty…

机器学习 · 统计学 2021-12-14 Yiliang Zhang , Zhiqi Bu

The linear ordering problem (LOP), which consists in ordering M objects from their pairwise comparisons, is commonly applied in many areas of research. While efforts have been made to devise efficient LOP algorithms, verification of whether…

机器学习 · 计算机科学 2023-05-23 Leszek Szczecinski , Harsh Sukheja

In high dimensional regression settings, sparsity enforcing penalties have proved useful to regularize the data-fitting term. A recently introduced technique called screening rules propose to ignore some variables in the optimization…

机器学习 · 统计学 2017-12-29 Eugene Ndiaye , Olivier Fercoq , Alexandre Gramfort , Joseph Salmon

The Sorted L-One Estimator (SLOPE) is a popular regularization method in regression, which induces clustering of the estimated coefficients. That is, the estimator can have coefficients of identical magnitude. In this paper, we derive an…

统计理论 · 数学 2023-04-17 Ivan Hejný , Jonas Wallin , Małgorzata Bogdan

We formulate the sparse classification problem of $n$ samples with $p$ features as a binary convex optimization problem and propose a cutting-plane algorithm to solve it exactly. For sparse logistic regression and sparse SVM, our algorithm…

最优化与控制 · 数学 2025-01-08 Dimitris Bertsimas , Jean Pauphilet , Bart Van Parys

Screening rules allow to early discard irrelevant variables from the optimization in Lasso problems, or its derivatives, making solvers faster. In this paper, we propose new versions of the so-called $\textit{safe rules}$ for the Lasso.…

机器学习 · 统计学 2015-12-07 Olivier Fercoq , Alexandre Gramfort , Joseph Salmon

We consider high-dimensional sparse regression problems in which we observe $y = X \beta + z$, where $X$ is an $n \times p$ design matrix and $z$ is an $n$-dimensional vector of independent Gaussian errors, each with variance $\sigma^2$.…

统计理论 · 数学 2015-09-25 Weijie Su , Emmanuel Candes
‹ 上一页 1 2 3 10 下一页 ›