English
Related papers

Related papers: Weak pattern convergence for SLOPE and its robust …

200 papers

Popular regularizers with non-differentiable penalties, such as Lasso, Elastic Net, Generalized Lasso, or SLOPE, reduce the dimension of the parameter space by inducing sparsity or clustering in the estimators' coordinates. In this paper,…

Statistics Theory · Mathematics 2025-01-03 Ivan Hejný , Jonas Wallin , Małgorzata Bogdan , Michał Kos

Sorted L-One Penalized Estimator (SLOPE) is a relatively new convex optimization procedure for selecting predictors in large data bases. Contrary to LASSO, SLOPE has been proved to be asymptotically minimax in the context of sparse…

Statistics Theory · Mathematics 2020-05-11 Michał Kos , Małgorzata Bogdan

We introduce a novel method for sparse regression and variable selection, which is inspired by modern ideas in multiple testing. Imagine we have observations from the linear model y = X beta + z, then we suggest estimating the regression…

Methodology · Statistics 2013-10-30 Malgorzata Bogdan , Ewout van den Berg , Weijie Su , Emmanuel Candes

Sorted $\ell_1$ Penalized Estimator (SLOPE) is a relatively new convex regularization method for fitting high-dimensional regression models. SLOPE allows to reduce the model dimension by shrinking some estimates of the regression…

Statistics Theory · Mathematics 2022-06-17 Tomasz Skalski , Piotr Graczyk , Bartosz Kołodziejek , Maciej Wilczyński

The lasso is the most famous sparse regression and feature selection method. One reason for its popularity is the speed at which the underlying optimization problem can be solved. Sorted L-One Penalized Estimation (SLOPE) is a…

Optimization and Control · Mathematics 2024-05-14 Johan Larsson , Quentin Klopfenstein , Mathurin Massias , Jonas Wallin

Sorted L-One Penalized Estimation is a relatively new convex optimization procedure which allows for adaptive selection of regressors under sparse high dimensional designs. Here we extend the idea of SLOPE to deal with the situation when…

Statistics Theory · Mathematics 2015-12-01 Damian Brzyski , Weijie Su , Małgorzata Bogdan

We introduce a new estimator for the vector of coefficients $\beta$ in the linear model $y=X\beta+z$, where $X$ has dimensions $n\times p$ with $p$ possibly larger than $n$. SLOPE, short for Sorted L-One Penalized Estimation, is the…

Sorted L-One Penalized Estimation (SLOPE) is a relatively new convex optimization procedure which allows for adaptive selection of regressors under sparse high dimensional designs. Here we extend the idea of SLOPE to deal with the situation…

Methodology · Statistics 2016-10-18 Damian Brzyski , Alexej Gossmann , Weijie Su , Malgorzata Bogdan

Sorted $L_1$ penalization estimator (SLOPE) is a regularization technique for sorted absolute coefficients in high-dimensional regression. By arbitrarily setting its regularization weights $\lambda$ under the monotonicity constraint, SLOPE…

Methodology · Statistics 2020-10-30 Shunichi Nomura

In sparse linear regression, the SLOPE estimator generalizes LASSO by penalizing different coordinates of the estimate according to their magnitudes. In this paper, we present a precise performance characterization of SLOPE in the…

Information Theory · Computer Science 2021-06-07 Hong Hu , Yue M. Lu

We study a set of regularization methods for high-dimensional linear regression models. These penalized estimators have the square root of the residual sum of squared errors as loss function, and any weakly decomposable norm as penalty…

Statistics Theory · Mathematics 2016-06-28 Benjamin Stucky , Sara van de Geer

We consider high-dimensional sparse regression problems in which we observe $y = X \beta + z$, where $X$ is an $n \times p$ design matrix and $z$ is an $n$-dimensional vector of independent Gaussian errors, each with variance $\sigma^2$.…

Statistics Theory · Mathematics 2015-09-25 Weijie Su , Emmanuel Candes

SLOPE is a popular method for dimensionality reduction in the high-dimensional regression. Indeed some regression coefficient estimates of SLOPE can be null (sparsity) or can be equal in absolute value (clustering). Consequently, SLOPE may…

Among techniques for high-dimensional linear regression, Sorted L-One Penalized Estimation (SLOPE) generalizes the LASSO via an adaptive $l_1$ regularization that applies heavier penalties to larger coefficients in the model. To achieve…

Methodology · Statistics 2025-07-15 Zhiqi Bu , Jason M. Klusowski , Cynthia Rush , Ruijia Wu

This paper studies Graphical SLOPE for precision matrix estimation, with emphasis on its ability to recover both sparsity and clusters of edges with equal or similar strength. In a fixed-dimensional regime, we establish that the root-$n$…

Statistics Theory · Mathematics 2026-04-15 Ivan Hejný , Giovanni Bonaccolto , Philipp Kremer , Sandra Paterlini , Małgorzata Bogdan , Jonas Wallin

Sorted L-One Penalized Estimation (SLOPE) has shown the nice theoretical property as well as empirical behavior recently on the false discovery rate (FDR) control of high-dimensional feature selection by adaptively imposing the…

Statistics Theory · Mathematics 2023-02-22 Jingxuan Liang , Hong Chen , Xuelin Zhang , Weifu Li , Xin Tang

In linear regression, SLOPE is a new convex analysis method that generalizes the Lasso via the sorted L1 penalty: larger fitted coefficients are penalized more heavily. This magnitude-dependent regularization requires an input of penalty…

Machine Learning · Statistics 2021-12-14 Yiliang Zhang , Zhiqi Bu

SLOPE is a relatively new convex optimization procedure for high-dimensional linear regression via the sorted l1 penalty: the larger the rank of the fitted coefficient, the larger the penalty. This non-separable penalty renders many…

Machine Learning · Statistics 2019-07-18 Zhiqi Bu , Jason Klusowski , Cynthia Rush , Weijie Su

Extracting relevant features from data sets where the number of observations ($n$) is much smaller then the number of predictors ($p$) is a major challenge in modern statistics. Sorted L-One Penalized Estimation (SLOPE), a generalization of…

Machine Learning · Statistics 2024-05-14 Johan Larsson , Małgorzata Bogdan , Jonas Wallin

This article investigates the asymptotic distribution of penalized estimators with non-differentiable penalties designed to recover low-dimensional pattern structures. Patterns play a central role in estimation, as they reveal the…

Statistics Theory · Mathematics 2025-11-18 Ivan Hejný , Jonas Wallin , Małgorzata Bogdan
‹ Prev 1 2 3 10 Next ›