English
Related papers

Related papers: Computational approaches to non-convex, sparsity-i…

200 papers

In this paper, we consider a class of structured nonsmooth fractional minimization, where the first part of the objective is the ratio of a nonnegative nonsmooth nonconvex function to a nonnegative nonsmooth convex function, while the…

Optimization and Control · Mathematics 2025-12-25 Junpeng Zhou , Na Zhang , Qia Li

We study the problem of learning a sparse linear regression vector under additional conditions on the structure of its sparsity pattern. This problem is relevant in machine learning, statistics and signal processing. It is well known that a…

Machine Learning · Statistics 2015-03-17 Charles A. Micchelli , Jean M. Morales , Massimiliano Pontil

Partial least squares, as a dimension reduction method, has become increasingly important for its ability to deal with problems with a large number of variables. Since noisy variables may weaken the performance of the model, the sparse…

Methodology · Statistics 2020-06-08 Weijuan Liang , Shuangge Ma , Qingzhao Zhang , Tingyu Zhu

Sparsity constrained minimization captures a wide spectrum of applications in both machine learning and signal processing. This class of problems is difficult to solve since it is NP-hard and existing solutions are primarily based on…

Optimization and Control · Mathematics 2018-12-31 Ganzhao Yuan , Bernard Ghanem

This work studies the problem of sparse signal recovery with automatic grouping of variables. To this end, we investigate sorted nonsmooth penalties as a regularization approach for generalized linear models. We focus on a family of sorted…

Optimization and Control · Mathematics 2025-06-19 Anne Gagneux , Mathurin Massias , Emmanuel Soubies

Non-convex sparsity-inducing penalties have recently received considerable attentions in sparse learning. Recent theoretical investigations have demonstrated their superiority over the convex counterparts in several sparse learning…

Machine Learning · Computer Science 2013-03-20 Pinghua Gong , Changshui Zhang , Zhaosong Lu , Jianhua Huang , Jieping Ye

This paper considers the problem of signal denoising using a sparse tight-frame analysis prior. The L1 norm has been extensively used as a regularizer to promote sparsity; however, it tends to under-estimate non-zero values of the…

Computer Vision and Pattern Recognition · Computer Science 2015-09-11 Ankit Parekh , Ivan W. Selesnick

We consider the problem of the recovery of a k-sparse vector from compressed linear measurements when data are corrupted by a quantization noise. When the number of measurements is not sufficiently large, different $k$-sparse solutions may…

Optimization and Control · Mathematics 2019-09-10 Vito Cerone , Sophie M. Fosson , Diego Regruto

We study sparse linear regression over a network of agents, modeled as an undirected graph (with no centralized node). The estimation problem is formulated as the minimization of the sum of the local LASSO loss functions plus a quadratic…

Machine Learning · Computer Science 2023-06-23 Yao Ji , Gesualdo Scutari , Ying Sun , Harsha Honnappa

This work addresses the recovery and demixing problem of signals that are sparse in some general dictionary. Involved applications include source separation, image inpainting, super-resolution, and restoration of signals corrupted by…

Information Theory · Computer Science 2017-03-24 Fei Wen , Lasith Adhikari , Ling Pei , Roummel F. Marcia , Peilin Liu , Robert C. Qiu

Iterative regularization exploits the implicit bias of an optimization algorithm to regularize ill-posed problems. Constructing algorithms with such built-in regularization mechanisms is a classic challenge in inverse problems but also in…

Optimization and Control · Mathematics 2022-02-02 Cesare Molinari , Mathurin Massias , Lorenzo Rosasco , Silvia Villa

We consider minimization problems with structured objective function and smooth constraints, and present a flexible framework that combines the beneficial regularization effects of (exact) penalty and interior-point methods. In the fully…

Optimization and Control · Mathematics 2025-08-27 Alberto De Marchi , Andreas Themelis

The popular Lasso approach for sparse estimation can be derived via marginalization of a joint density associated with a particular stochastic model. A different marginalization of the same probabilistic model leads to a different…

Machine Learning · Statistics 2013-02-28 Aleksandr Y. Aravkin , James V. Burke , Alessandro Chiuso , Gianluigi Pillonetto

We introduce a new weakly-convex penalty function for signals with a group behavior. The penalty promotes signals with a few number of active groups, where within each group, only a few high magnitude coefficients are active. We derive the…

Numerical Analysis · Computer Science 2017-08-02 İlker Bayram , Savaşkan Bulek

Sign information is the key to overcoming the inevitable saturation error in compressive sensing systems, which causes information loss and results in bias. For sparse signal recovery from saturation, we propose to use a linear loss to…

Information Theory · Computer Science 2021-02-02 Fan He , Xiaolin Huang , Yipeng Liu , Ming Yan

We develop two new proximal alternating penalty algorithms to solve a wide range class of constrained convex optimization problems. Our approach mainly relies on a novel combination of the classical quadratic penalty, alternating…

Optimization and Control · Mathematics 2018-09-20 Quoc Tran-Dinh

In this paper, we study a variant of the quadratic penalty method for linearly constrained convex problems, which has already been widely used but actually lacks theoretical justification. Namely, the penalty parameter steadily increases…

Numerical Analysis · Mathematics 2017-11-30 Huan Li , Cong Fang , Zhouchen Lin

In recent studies on sparse modeling, non-convex penalties have received considerable attentions due to their superiorities on sparsity-inducing over the convex counterparts. Compared with the convex optimization approaches, however, the…

Optimization and Control · Mathematics 2015-07-28 Jinshan Zeng , Shaobo Lin , Zongben Xu

We investigate a compressive sensing framework in which the sensors introduce a distortion to the measurements in the form of unknown gains. We focus on blind calibration, using measures performed on multiple unknown (but sparse) signals…

Information Theory · Computer Science 2014-08-26 Cagdas Bilen , Gilles Puy , Rémi Gribonval , Laurent Daudet

A computationally efficient method to solve non-convex programming problems with linear equality constraints is presented. The proposed method is based on a recursively feasible and descending sequential convex programming procedure proven…

Optimization and Control · Mathematics 2018-10-25 Josep Virgili-Llop , Marcello Romano