English
Related papers

Related papers: Complexity of Unconstrained L_2-L_p Minimization

200 papers

This paper investigates the theoretical guarantees of L1-analysis regularization when solving linear inverse problems. Most of previous works in the literature have mainly focused on the sparse synthesis prior where the sparsity is measured…

Information Theory · Computer Science 2012-10-03 Samuel Vaiter , Gabriel Peyré , Charles Dossal , Jalal Fadili

Problems in signal processing and medical imaging often lead to calculating sparse solutions to under-determined linear systems. Methodologies for solving this problem are presented as background to the method used in this work where the…

Numerical Analysis · Computer Science 2009-07-21 R. Broughton , I. Coope , P. Renaud , R. Tappenden

We study randomized algorithms for constrained optimization, in abstract frameworks that include, in strictly increasing generality: convex programming; LP-type problems; violator spaces; and a setting we introduce, consistent spaces. Such…

Computational Geometry · Computer Science 2019-06-04 Kenneth L. Clarkson , Bernd Gärtner , Johannes Lengler , May Szedlak

This paper considers solving the unconstrained $\ell_q$-norm ($0\leq q<1$) regularized least squares ($\ell_q$-LS) problem for recovering sparse signals in compressive sensing. We propose two highly efficient first-order algorithms via…

Information Theory · Computer Science 2016-03-16 Fei Wen , Yuan Yang , Peilin Liu , Rendong Ying , Yipeng Liu

We consider the problem of computing a positive definite $p \times p$ inverse covariance matrix aka precision matrix $\theta=(\theta_{ij})$ which optimizes a regularized Gaussian maximum likelihood problem, with the elastic-net regularizer…

Statistics Theory · Mathematics 2015-09-02 Yves F. Atchadé , Rahul Mazumder , Jie Chen

This article addresses two topics of significant mathematical and practical interest in the theory of kernel approximation: the existence of local and stable bases and the L_p--boundedness of the least squares operator. The latter is an…

Classical Analysis and ODEs · Mathematics 2011-03-10 Thomas Hangelbroek , Fran J Narcowich , Xingping Sun , Joe D Ward

We introduce multiple symmetric LP relaxations for minimum cut problems. The relaxations give optimal and approximate solutions when the input is a Hamiltonian cycle. We show that this leads to one of two interesting results. In one case,…

Data Structures and Algorithms · Computer Science 2020-05-26 Robert D. Carr , Jennifer Iglesias , Giuseppe Lanciac , Benjamin Moseley

For an ill-posed inverse problem, particularly with incomplete and limited measurement data, regularization is an essential tool for stabilizing the inverse problem. Among various forms of regularization, the lp penalty term provides a…

Numerical Analysis · Mathematics 2021-12-23 Jihun Han , Yoonsang Lee

$L_1$ regularization is used for finding sparse solutions to an underdetermined linear system. As sparse signals are widely expected in remote sensing, this type of regularization scheme and its extensions have been widely employed in many…

Image and Video Processing · Electrical Eng. & Systems 2018-05-07 Yilei Shi , Xiao Xiang Zhu , Wotao Yin , Richard Bamler

We show weighted non-autonomous $L^q(L^p)$ maximal regularity for families of complex second-order systems in divergence form under a mixed regularity condition in space and time. To be more precise, we let $p,q \in (1,\infty)$ and we…

Analysis of PDEs · Mathematics 2025-07-15 Sebastian Bechtel

In this work, we study the iteration complexity of gradient methods for minimizing convex quadratic functions regularized by powers of Euclidean norms. We show that, due to the uniform convexity of the objective, gradient methods have…

Optimization and Control · Mathematics 2025-01-28 Daniel Berg Thomsen , Nikita Doikov

We present a note on the implementation and efficacy of a box-constrained $L_1/L_2$ regularization in numerical optimization approaches to performing tomographic reconstruction from a single projection view. The constrained $L_1/L_2$…

Optimization and Control · Mathematics 2023-03-16 Sean Breckling , Malena I. Español , Victoria Uribe , Chrisitan Bobmara , Jordan Pillow , Brandon Baldonado

The $\ell_{1\text{-}2}$ regularization method has a strong sparsity promoting capability in approaching sparse solutions of linear inverse problems and gained successful applications in various mathematics and applied science fields. This…

Optimization and Control · Mathematics 2026-03-04 Yaohua Hu , Hao Wang , Xiaoqi Yang

We investigate implicit regularization schemes for gradient descent methods applied to unpenalized least squares regression to solve the problem of reconstructing a sparse signal from an underdetermined system of linear measurements under…

Machine Learning · Statistics 2019-09-12 Tomas Vaškevičius , Varun Kanade , Patrick Rebeschini

In this paper, we develop a parameterized proximal point algorithm (P-PPA) for solving a class of separable convex programming problems subject to linear and convex constraints. The proposed algorithm is provable to be globally convergent…

Optimization and Control · Mathematics 2018-12-11 Jianchao Bai , Hongchao Zhang , Jicheng Li

We prove some regularity results for a connected set S in the planar domain O, which minimizes the compliance of its complement O\S, plus its length. This problem, interpreted as to find the best location for attaching a membrane subject to…

Optimization and Control · Mathematics 2016-04-18 Antonin Chambolle , Jimmy Lamboley , Antoine Lemenant , Eugene Stepanov

In this paper we study optimal control problems with either fractional or regional fractional $p$-Laplace equation, of order $s$ and $p\in [2,\infty)$, as constraints over a bounded open set with Lipschitz continuous boundary. The control,…

Optimization and Control · Mathematics 2017-01-20 Harbir Antil , Mahamadi Warma

We give improved algorithms for the $\ell_{p}$-regression problem, $\min_{x} \|x\|_{p}$ such that $A x=b,$ for all $p \in (1,2) \cup (2,\infty).$ Our algorithms obtain a high accuracy solution in $\tilde{O}_{p}(m^{\frac{|p-2|}{2p + |p-2|}})…

Data Structures and Algorithms · Computer Science 2024-12-20 Deeksha Adil , Rasmus Kyng , Richard Peng , Sushant Sachdeva

Our contribution in this paper is two folded. We consider first the case of linear programming with real coefficients and give a method which allows the computation of a new upper bound on the distance from the origin to a feasible point.…

Optimization and Control · Mathematics 2020-10-30 Beniamin Costandin , Marius Costandin , Petru Dobra

Recently, the worse-case analysis, probabilistic analysis and empirical justification have been employed to address the fundamental question: When does $\ell_1$-minimization find the sparsest solution to an underdetermined linear system? In…

Information Theory · Computer Science 2015-06-16 Yunbin Zhao