English
Related papers

Related papers: Weak pattern convergence for SLOPE and its robust …

200 papers

This work studies the problem of sparse signal recovery with automatic grouping of variables. To this end, we investigate sorted nonsmooth penalties as a regularization approach for generalized linear models. We focus on a family of sorted…

Optimization and Control · Mathematics 2025-06-19 Anne Gagneux , Mathurin Massias , Emmanuel Soubies

We provide a necessary and sufficient condition for the uniqueness of penalized least-squares estimators whose penalty term is given by a norm with a polytope unit ball, covering a wide range of methods including SLOPE, PACS, fused,…

Statistics Theory · Mathematics 2022-11-29 Ulrike Schneider , Patrick Tardivel

We study a family of sparse estimators defined as minimizers of some empirical Lipschitz loss function -- which include the hinge loss, the logistic loss and the quantile regression loss -- with a convex, sparse or group-sparse…

Machine Learning · Statistics 2021-09-23 Antoine Dedieu

Sorted l1 regularization has been incorporated into many methods for solving high-dimensional statistical estimation problems, including the SLOPE estimator in linear regression. In this paper, we study how this relatively new…

Statistics Theory · Mathematics 2022-06-07 Zhiqi Bu , Jason Klusowski , Cynthia Rush , Weijie J. Su

In this paper we propose a methodology to accelerate the resolution of the so-called "Sorted L-One Penalized Estimation" (SLOPE) problem. Our method leverages the concept of "safe screening", well-studied in the literature for…

Machine Learning · Computer Science 2022-10-05 Clément Elvira , Cédric Herzet

The octagonal shrinkage and clustering algorithm for regression (OSCAR), equipped with the $\ell_1$-norm and a pair-wise $\ell_{\infty}$-norm regularizer, is a useful tool for feature selection and grouping in high-dimensional data…

Optimization and Control · Mathematics 2018-03-29 Ziyan Luo , Defeng Sun , Kim-Chuan Toh , Naihua Xiu

We prove an L2 recovery bound for a family of sparse estimators defined as minimizers of some empirical loss functions -- which include hinge loss and logistic loss. More precisely, we achieve an upper-bound for coefficients estimation…

Statistics Theory · Mathematics 2019-01-15 Antoine Dedieu

The problems of outliers detection and robust regression in a high-dimensional setting are fundamental in statistics, and have numerous applications. Following a recent set of works providing methods for simultaneous robust regression and…

Machine Learning · Statistics 2017-12-08 Alain Virouleau , Agathe Guilloux , Stéphane Gaïffas , Malgorzata Bogdan

The SLOPE estimates regression coefficients by minimizing a regularized residual sum of squares using a sorted-$\ell_1$-norm penalty. The SLOPE combines testing and estimation in regression problems. It exhibits suitable variable selection…

Methodology · Statistics 2016-09-02 Amir Sepehri

Nonconvex penalty methods for sparse modeling in linear regression have been a topic of fervent interest in recent years. Herein, we study a family of nonconvex penalty functions that we call the trimmed Lasso and that offers exact control…

Methodology · Statistics 2017-08-16 Dimitris Bertsimas , Martin S. Copenhaver , Rahul Mazumder

This article proposes a novel estimator for regression coefficients in clustered data that explicitly accounts for within-cluster dependence. We study the asymptotic properties of the proposed estimator under both finite and infinite…

Methodology · Statistics 2026-02-05 Subhodeep Dey , Gopal K. Basak , Samarjit Das

The extremes of a stationary time series typically occur in clusters. A primary measure for this phenomenon is the extremal index, representing the reciprocal of the expected cluster size. Both a disjoint and a sliding blocks estimator for…

Statistics Theory · Mathematics 2017-07-14 Betina Berghaus , Axel Bücher

A recently proposed SLOPE estimator (arXiv:1407.3824) has been shown to adaptively achieve the minimax $\ell_2$ estimation rate under high-dimensional sparse linear regression models (arXiv:1503.08393). Such minimax optimality holds in the…

Machine Learning · Statistics 2021-09-24 Shuaiwen Wang , Haolei Weng , Arian Maleki

This article aims to seek a selection and estimation procedure for a class of tensor regression problems with multivariate covariates and matrix responses, which can provide theoretical guarantees for model selection in finite samples.…

Statistics Theory · Mathematics 2023-10-10 Yang Chen , Ziyan Luo

Classical least squares estimators are well-known to be robust with respect to moment assumptions concerning the error distribution in a wide variety of finite-dimensional statistical problems; generally only a second moment assumption is…

Statistics Theory · Mathematics 2018-05-08 Qiyang Han , Jon A. Wellner

Clustering is a foundational task in data analysis, yet most algorithms impose rigid assumptions on cluster geometry: centroid-based methods favor convex structures, while density-based approaches break down under variable local density or…

Machine Learning · Computer Science 2026-05-19 Randolph Wiredu-Aidoo

This paper is a direct followup of the recent author's paper. In this paper we continue to analyze approximation and recovery properties with respect to systems satisfying universal sampling discretization property and a special…

Numerical Analysis · Mathematics 2024-01-29 V. Temlyakov

Deep neural networks (DNNs) are used in many applications, but their large size and high computational cost make them hard to run on devices with limited resources. Two widely used techniques to address this challenge are weight…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Dan Liu , Nikita Dvornik , Xue Liu

In this paper we introduce a new optimization formulation for sparse regression and compressed sensing, called CLOT (Combined L-One and Two), wherein the regularizer is a convex combination of the $\ell_1$- and $\ell_2$-norms. This…

Machine Learning · Statistics 2017-06-21 Mehmet Eren Ahsen , Niharika Challapalli , Mathukumalli Vidyasagar

We study an asymptotic preserving scheme for the temporal discretization of a system of parabolic semilinear SPDEs with two time scales. Owing to the averaging principle, when the time scale separation $\epsilon$ vanishes, the slow…

Numerical Analysis · Mathematics 2022-03-22 Charles-Edouard Bréhier