中文
相关论文

相关论文: An iterative support shrinking algorithm for $\ell…

200 篇论文

The $\ell^0$ minimization of compressed sensing is often relaxed to $\ell^1$, which yields easy computation using the shrinkage mapping known as soft thresholding, and can be shown to recover the original solution under certain hypotheses.…

信息论 · 计算机科学 2016-06-22 Joseph Woodworth , Rick Chartrand

We consider the problem of approximating a given matrix by a low-rank matrix so as to minimize the entrywise $\ell_p$-approximation error, for any $p \geq 1$; the case $p = 2$ is the classical SVD problem. We obtain the first provably good…

数据结构与算法 · 计算机科学 2017-05-19 Flavio Chierichetti , Sreenivas Gollapudi , Ravi Kumar , Silvio Lattanzi , Rina Panigrahy , David P. Woodruff

We advance both the theory and practice of robust $\ell_p$-quasinorm regression for $p \in (0,1]$ by using novel variants of iteratively reweighted least-squares (IRLS) to solve the underlying non-smooth problem. In the convex case, $p=1$,…

最优化与控制 · 数学 2022-10-14 Liangzu Peng , Christian Kümmerle , René Vidal

We propose a sequential quadratic programming (SQP) algorithm for inequality constrained optimization that is robust to the presence of bounded noise in function and derivative evaluations. We cover the case where constraint evaluations…

最优化与控制 · 数学 2026-04-17 Figen Oztoprak , Richard Byrd

A classical approach for solving discrete time nonlinear control on a finite horizon consists in repeatedly minimizing linear quadratic approximations of the original problem around current candidate solutions. While widely popular in many…

最优化与控制 · 数学 2025-07-08 Vincent Roulet , Siddhartha Srinivasa , Maryam Fazel , Zaid Harchaoui

In this paper, we propose a novel algorithm for analysis-based sparsity reconstruction. It can solve the generalized problem by structured sparsity regularization with an orthogonal basis and total variation regularization. The proposed…

计算机视觉与模式识别 · 计算机科学 2015-04-29 Chen Chen , Junzhou Huang , Lei He , Hongsheng Li

We introduce an iterative scheme for discrete convex minimization problems of $p$-Laplace type such as variational graph $p$-Laplace problems and $\ell^p$ regression. In each iteration, the scheme solves only a weighted least-squares…

最优化与控制 · 数学 2026-03-30 Johannes Storn

We study the proximal gradient descent (PGD) method for $\ell^{0}$ sparse approximation problem as well as its accelerated optimization with randomized algorithms in this paper. We first offer theoretical analysis of PGD showing the bounded…

最优化与控制 · 数学 2017-09-06 Yingzhen Yang , Jiashi Feng , Nebojsa Jojic , Jianchao Yang , Thomas S. Huang

We address the problem of recovering a sparse signal from clipped or quantized measurements. We show how these two problems can be formulated as minimizing the distance to a convex feasibility set, which provides a convex and differentiable…

信号处理 · 电气工程与系统科学 2018-12-05 Lucas Rencker , Francis Bach , Wenwu Wang , Mark D. Plumbley

In this study, we focus on computing the projection onto the $\ell_p$ quasi-norm ball, which is challenging due to the non-convex and non-Lipschitz nature inherent in the $\ell_p$ quasi-norm with $0<p<1$. We propose a novel localized…

最优化与控制 · 数学 2024-12-30 Qi An , Jiao Wang , Zequn Niu , Nana Zhang

In this paper we look at a particular problem related to under-determined linear systems of equations with sparse solutions. $\ell_1$-minimization is a fairly successful polynomial technique that can in certain statistical scenarios find…

信息论 · 计算机科学 2015-07-17 Mihailo Stojnic

We investigate implicit regularization schemes for gradient descent methods applied to unpenalized least squares regression to solve the problem of reconstructing a sparse signal from an underdetermined system of linear measurements under…

机器学习 · 统计学 2019-09-12 Tomas Vaškevičius , Varun Kanade , Patrick Rebeschini

We study an iterative Galerkin method for quasilinear elliptic problems in the Browder-Minty setting. The resulting discrete nonlinear systems are solved by linearization via a (damped) Zarantonello iteration. Unlike prior work, adaptive…

数值分析 · 数学 2026-05-25 Maximilian Brunner , Gregor Gantner , Christoph Lietz , Dirk Praetorius

This paper proposes and analyzes an iterative minimization formulation for search- ing index-1 saddle points of an energy function. This formulation differs from other eigenvector-following methods by constructing a new objective function…

数值分析 · 数学 2014-06-10 Weiguo Gao , Jing Leng , Xiang Zhou

Finding a sparse representation of a possibly noisy signal can be modeled as a variational minimization with l_q-sparsity constraints for q less than one. Especially for real-time, on-line, or iterative applications, in which problems of…

数值分析 · 数学 2017-09-04 Martin Ehler

We propose an iterative algorithm for low-rank matrix completion that can be interpreted as an iteratively reweighted least squares (IRLS) algorithm, a saddle-escaping smoothing Newton method or a variable metric proximal gradient method…

最优化与控制 · 数学 2021-06-07 Christian Kümmerle , Claudio Mayrink Verdun

We present faster high-accuracy algorithms for computing $\ell_p$-norm minimizing flows. On a graph with $m$ edges, our algorithm can compute a $(1+1/\text{poly}(m))$-approximate unweighted $\ell_p$-norm minimizing flow with…

数据结构与算法 · 计算机科学 2020-01-10 Deeksha Adil , Sushant Sachdeva

A number of recent works have studied algorithms for entrywise $\ell_p$-low rank approximation, namely, algorithms which given an $n \times d$ matrix $A$ (with $n \geq d$), output a rank-$k$ matrix $B$ minimizing…

数据结构与算法 · 计算机科学 2021-02-09 Frank Ban , Vijay Bhattiprolu , Karl Bringmann , Pavel Kolev , Euiwoong Lee , David P. Woodruff

In this paper we look at a connection between the $\ell_q,0\leq q\leq 1$, optimization and under-determined linear systems of equations with sparse solutions. The case $q=1$, or in other words $\ell_1$ optimization and its a connection with…

信息论 · 计算机科学 2013-06-19 Mihailo Stojnic

We study $\ell^1$ regularized least squares optimization problem in a separable Hilbert space. We show that the iterative soft-thresholding algorithm (ISTA) converges linearly, without making any assumption on the linear operator into play…

最优化与控制 · 数学 2017-12-04 Guillaume Garrigos , Lorenzo Rosasco , Silvia Villa