English
Related papers

Related papers: A General Theory for Exact Sparse Representation R…

200 papers

Difference-of-Convex (DC) minimization, referring to the problem of minimizing the difference of two convex functions, has been found rich applications in statistical learning and studied extensively for decades. However, existing methods…

Optimization and Control · Mathematics 2022-12-20 Ganzhao Yuan

Consider reconstructing a signal $x$ by minimizing a weighted sum of a convex differentiable negative log-likelihood (NLL) (data-fidelity) term and a convex regularization term that imposes a convex-set constraint on $x$ and enforces its…

Computation · Statistics 2017-02-28 Renliang Gu , Aleksandar Dogandžić

The problem of finding the sparsest vector (direction) in a low dimensional subspace can be considered as a homogeneous variant of the sparse recovery problem, which finds applications in robust subspace recovery, dictionary learning,…

Machine Learning · Computer Science 2020-01-22 Qing Qu , Zhihui Zhu , Xiao Li , Manolis C. Tsakiris , John Wright , René Vidal

In this paper we introduce the class of infinite infimal convolution functionals and apply these functionals to the regularization of ill-posed inverse problems. The proposed regularization involves an infimal convolution of a continuously…

Optimization and Control · Mathematics 2024-12-17 Kristian Bredies , Marcello Carioni , Martin Holler , Yury Korolev , Carola-Bibiane Schönlieb

This paper conducts a rigorous analysis for provable estimation of multidimensional arrays, in particular third-order tensors, from a random subset of its corrupted entries. Our study rests heavily on a recently proposed tensor algebraic…

Machine Learning · Computer Science 2017-08-03 Jonathan Q. Jiang , Michael K. Ng

Recovering nonlinearly degraded signal in the presence of noise is a challenging problem. In this work, this problem is tackled by minimizing the sum of a non convex least-squares fit criterion and a penalty term. We assume that the…

Signal Processing · Electrical Eng. & Systems 2019-02-27 Marc Castella , Jean-Christophe Pesquet , Arthur Marmin

Over the past decade, the celebrated sparse representation model has achieved impressive results in various signal and image processing tasks. A convolutional version of this model, termed convolutional sparse coding (CSC), has been…

Signal Processing · Electrical Eng. & Systems 2018-10-03 Ives Rey-Otero , Jeremias Sulam , Michael Elad

This paper considers the problem of recovering an ensemble of Diracs on a sphere from its low resolution measurements. The Diracs can be located at any location on the sphere, not necessarily on a grid. We show that under a separation…

Information Theory · Computer Science 2015-06-23 Tamir Bendory , Shai Dekel , Arie Feuer

Decentralized minimax optimization has been actively studied in the past few years due to its application in a wide range of machine learning models. However, the current theoretical understanding of its convergence rate is far from…

Machine Learning · Computer Science 2023-04-25 Yihan Zhang , Wenhao Jiang , Feng Zheng , Chiu C. Tan , Xinghua Shi , Hongchang Gao

Centered finite-difference discretizations of convection--diffusion equations may oscillate when convection dominates at the mesh scale. For homogeneous Dirichlet problems with constant coefficients on uniform Cartesian grids, we derive…

Numerical Analysis · Mathematics 2026-05-29 Gossrin Jean-Marc Bomisso , Ali Ouattara Kouma

Non-Local Total Variation (NLTV) has emerged as a useful tool in variational methods for image recovery problems. In this paper, we extend the NLTV-based regularization to multicomponent images by taking advantage of the Structure Tensor…

Computer Vision and Pattern Recognition · Computer Science 2014-12-11 Giovanni Chierchia , Nelly Pustelnik , Beatrice Pesquet-Popescu , Jean-Christophe Pesquet

We consider simultaneously identifying the membership and locations of point sources that are convolved with different band-limited point spread functions, from the observation of their superpositions. This problem arises in…

Information Theory · Computer Science 2017-03-22 Yuanxin Li , Yuejie Chi

We present an algorithm for the minimization of a nonconvex quadratic function subject to linear inequality constraints and a two-sided bound on the 2-norm of its solution. The algorithm minimizes the objective using an active-set method by…

Optimization and Control · Mathematics 2021-12-28 Nikitas Rontsis , Paul J. Goulart , Yuji Nakatsukasa

By the asymptotic oracle property, non-convex penalties represented by minimax concave penalty (MCP) and smoothly clipped absolute deviation (SCAD) have attracted much attentions in high-dimensional data analysis, and have been widely used…

Computation · Statistics 2021-11-24 Peili Li , Min Liu , Zhou Yu

We consider composite linear inverse problems where the signal to recover is modeled as a sum of two functions. We study a variational framework formulated as an optimization problem over the pairs of components using two regularization…

Optimization and Control · Mathematics 2026-05-25 Adrian Jarret , Julien Fageot

We consider the following signal recovery problem: given a measurement matrix $\Phi\in \mathbb{R}^{n\times p}$ and a noisy observation vector $c\in \mathbb{R}^{n}$ constructed from $c = \Phi\theta^* + \epsilon$ where $\epsilon\in…

Machine Learning · Statistics 2013-07-23 Ji Liu , Lei Yuan , Jieping Ye

Optimization problems with norm-bounding constraints arise in a variety of applications, including portfolio optimization, machine learning, and feature selection. A common approach to these problems involves relaxing the norm constraint…

Optimization and Control · Mathematics 2025-05-08 Danial Davarnia , Mohammadreza Kiaghadi

We study the problem of estimating a low-rank positive semidefinite (PSD) matrix from a set of rank-one measurements using sensing vectors composed of i.i.d. standard Gaussian entries, which are possibly corrupted by arbitrary outliers.…

Information Theory · Computer Science 2016-12-21 Yuanxin Li , Yue Sun , Yuejie Chi

We consider an optimal control problem subject to the thin-film equation which is deduced from the Navier--Stokes equation. The PDE constraint lacks well-posedness for general right-hand sides due to possible degeneracies; state constraints…

Optimization and Control · Mathematics 2015-08-11 Markus Klein , Andreas Prohl

This paper considers the problem of recovery of a low-rank matrix in the situation when most of its entries are not observed and a fraction of observed entries are corrupted. The observations are noisy realizations of the sum of a low rank…

Statistics Theory · Mathematics 2016-07-05 Olga Klopp , Karim Lounici , Alexandre B. Tsybakov