English
Related papers

Related papers: Upper-Bounding the Regularization Constant for Con…

200 papers

Motivated by the observation that a given signal $\boldsymbol{x}$ admits sparse representations in multiple dictionaries $\boldsymbol{\Psi}_d$ but with varying levels of sparsity across dictionaries, we propose two new algorithms for the…

Information Theory · Computer Science 2015-09-29 Rizwan Ahmad , Philip Schniter

Non-stationary blind super-resolution is an extension of the traditional super-resolution problem, which deals with the problem of recovering fine details from coarse measurements. The non-stationary blind super-resolution problem appears…

Information Theory · Computer Science 2019-10-09 Shuang Li , Michael B. Wakin , Gongguo Tang

The $\ell_{1\text{-}2}$ regularization method has a strong sparsity promoting capability in approaching sparse solutions of linear inverse problems and gained successful applications in various mathematics and applied science fields. This…

Optimization and Control · Mathematics 2026-03-04 Yaohua Hu , Hao Wang , Xiaoqi Yang

Over the past decades, many individual nonconvex methods have been proposed to achieve better sparse recovery performance in various scenarios. However, how to construct a valid nonconvex regularization function remains open in practice. In…

Machine Learning · Statistics 2022-02-16 Zhiyong Zhou

The mathematical theory of super-resolution developed recently by Cand\`{e}s and Fernandes-Granda states that a continuous, sparse frequency spectrum can be recovered with infinite precision via a (convex) atomic norm technique given a set…

Information Theory · Computer Science 2015-10-19 Zai Yang , Lihua Xie

In recent studies on sparse modeling, the nonconvex regularization approaches (particularly, $L_{q}$ regularization with $q\in(0,1)$) have been demonstrated to possess capability of gaining much benefit in sparsity-inducing and efficiency.…

Numerical Analysis · Computer Science 2015-06-17 Jinshan Zeng , Shaobo Lin , Yao Wang , Zongben Xu

We propose a new constrained optimization approach to hyperspectral (HS) image restoration. Most existing methods restore a desirable HS image by solving some optimization problem, which consists of a regularization term(s) and a…

Signal Processing · Electrical Eng. & Systems 2020-09-09 Saori Takeyama , Shunsuke Ono , Itsuo Kumazawa

Consider the problem of minimizing the sum of a smooth convex function and a separable nonsmooth convex function subject to linear coupling constraints. Problems of this form arise in many contemporary applications including signal…

Optimization and Control · Mathematics 2014-01-29 Mingyi Hong , Tsung-Hui Chang , Xiangfeng Wang , Meisam Razaviyayn , Shiqian Ma , Zhi-Quan Luo

This paper concerns model reduction of dynamical systems using the nuclear norm of the Hankel matrix to make a trade-off between model fit and model complexity. This results in a convex optimization problem where this trade-off is…

Systems and Control · Computer Science 2014-07-23 Niclas Blomberg , Cristian R. Rojas , Bo Wahlberg

Two important goals of high-dimensional modeling are prediction and variable selection. In this article, we consider regularization with combined $L_1$ and concave penalties, and study the sampling properties of the global optimum of the…

Methodology · Statistics 2016-05-12 Yingying Fan , Jinchi Lv

This paper focuses on regularisation methods using models up to the third order to search for up to second-order critical points of a finite-sum minimisation problem. The variant presented belongs to the framework of [3]: it employs random…

Numerical Analysis · Mathematics 2021-04-05 Stefania Bellavia , Gianmarco Gurioli , Benedetta Morini , Philippe L. Toint

Within the statistical and machine learning literature, regularization techniques are often used to construct sparse (predictive) models. Most regularization strategies only work for data where all predictors are treated identically, such…

Computation · Statistics 2020-12-16 Sander Devriendt , Katrien Antonio , Tom Reynkens , Roel Verbelen

This work considers recovery of signals that are sparse over two bases. For instance, a signal might be sparse in both time and frequency, or a matrix can be low rank and sparse simultaneously. To facilitate recovery, we consider minimizing…

Information Theory · Computer Science 2012-02-17 Samet Oymak , Babak Hassibi

In compressed sensing, the l0-norm minimization of sparse signal reconstruction is NP-hard. Recent work shows that compared with the best convex relaxation (l1-norm), nonconvex penalties can better approximate the l0-norm and can…

Signal Processing · Electrical Eng. & Systems 2018-05-03 Hao Wang , Zhanglei Shi , Chi-Sing Leung , Hing Cheung So

Many imaging problems require solving an inverse problem that is ill-conditioned or ill-posed. Imaging methods typically address this difficulty by regularising the estimation problem to make it well-posed. This often requires setting the…

Methodology · Statistics 2020-08-17 Ana F. Vidal , Valentin De Bortoli , Marcelo Pereyra , Alain Durmus

Popular machine learning estimators involve regularization parameters that can be challenging to tune, and standard strategies rely on grid search for this task. In this paper, we revisit the techniques of approximating the regularization…

Machine Learning · Statistics 2019-05-28 Eugene Ndiaye , Tam Le , Olivier Fercoq , Joseph Salmon , Ichiro Takeuchi

This paper presents a regularized Newton method (RNM) with generalized regularization terms for unconstrained convex optimization problems. The generalized regularization includes quadratic, cubic, and elastic net regularizations as special…

Optimization and Control · Mathematics 2024-07-11 Yuya Yamakawa , Nobuo Yamashita

We focus on the maximum regularization parameter for anisotropic total-variation denoising. It corresponds to the minimum value of the regularization parameter above which the solution remains constant. While this value is well know for the…

Machine Learning · Statistics 2016-12-12 Charles-Alban Deledalle , Nicolas Papadakis , Joseph Salmon , Samuel Vaiter

In this work, we consider a class of differentiable criteria for sparse image computing problems, where a nonconvex regularization is applied to an arbitrary linear transform of the target image. As special cases, it includes…

Optimization and Control · Mathematics 2013-08-27 Emilie Chouzenoux , Anna Jezierska , Jean-Christophe Pesquet , Hugues Talbot

We know that compressive sensing can establish stable sparse recovery results from highly undersampled data under a restricted isometry property condition. In reality, however, numerous problems are coherent, and vast majority conventional…

Optimization and Control · Mathematics 2021-11-25 Yanyun Ding , Haibin Zhang , Peili Li , Yunhai Xiao