English
Related papers

Related papers: Iterative Reweighted Minimization Methods for $l_p…

200 papers

We propose a new iteratively reweighted least squares (IRLS) algorithm for the recovery of a matrix $X \in \mathbb{C}^{d_1\times d_2}$ of rank $r \ll\min(d_1,d_2)$ from incomplete linear observations, solving a sequence of low complexity…

Numerical Analysis · Mathematics 2018-02-28 Christian Kümmerle , Juliane Sigl

This paper is concerned with the analysis of the $L_p\ (p\in[1,\infty), p=\infty)$ induced norms of continuous-time linear systems where input signals are restricted to be nonnegative. This norm is referred to as the $L_{p+}$ induced norm…

Optimization and Control · Mathematics 2026-03-24 Yoshio Ebihara , Noboru Sebe , Hayato Waki , Dimitri Peaucelle , Sophie Tarbouriech , Victor Magron , Tomomichi Hagiwara

We give improved algorithms for the $\ell_{p}$-regression problem, $\min_{x} \|x\|_{p}$ such that $A x=b,$ for all $p \in (1,2) \cup (2,\infty).$ Our algorithms obtain a high accuracy solution in $\tilde{O}_{p}(m^{\frac{|p-2|}{2p + |p-2|}})…

Data Structures and Algorithms · Computer Science 2024-12-20 Deeksha Adil , Rasmus Kyng , Richard Peng , Sushant Sachdeva

This survey reviews variational and iterative methods for reconstructing non-negative solutions of ill-posed problems in infinite-dimensional spaces. We focus on two classes of methods: variational methods based on entropy-minimization or…

Numerical Analysis · Mathematics 2018-05-07 Christian Clason , Barbara Kaltenbacher , Elena Resmerita

We propose novel high-order algorithms for a class of $\ell_p$-structured non-monotone variational inequalities. In particular, work by Diakonikolas et al. (2021), which introduced the weak Minty variational inequality (weak-MVI) setting,…

Optimization and Control · Mathematics 2026-03-17 Abhijeet Vyas , Brian Bullins

Linear superiorization (abbreviated: LinSup) considers linear programming (LP) problems wherein the constraints as well as the objective function are linear. It allows to steer the iterates of a feasibility-seeking iterative process toward…

Optimization and Control · Mathematics 2016-12-22 Yair Censor , Yehuda Zur

This paper proposes a new regularization technique for reinforcement learning (RL) towards making policy and value functions smooth and stable. RL is known for the instability of the learning process and the sensitivity of the acquired…

Robotics · Computer Science 2023-07-04 Taisuke Kobayashi

In the paper arXiv:1708.02289 we have introduced new solvability methods for strongly elliptic second order systems in divergence form on a domains above a Lipschitz graph, satisfying $L^p$-boundary data for $p$ near $2$. The main novel…

Analysis of PDEs · Mathematics 2020-06-24 Martin Dindoš

Iteratively reweighted least squares (IRLS) is a widely-used method in machine learning to estimate the parameters in the generalised linear models. In particular, IRLS for L1 minimisation under the linear model provides a closed-form…

Cryptography and Security · Computer Science 2016-05-25 Mijung Park , Max Welling

We introduce fast algorithms for solving $\ell_{p}$ regression problems using the iteratively reweighted least squares (IRLS) method. Our approach achieves state-of-the-art iteration complexity, outperforming the IRLS algorithm by…

Data Structures and Algorithms · Computer Science 2025-10-03 Alina Ene , Ta Duy Nguyen , Adrian Vladu

We develop a maximal regularity approach in temporally weighted $L_p$-spaces for vector-valued parabolic initial-boundary value problems with inhomogeneous boundary conditions, both of static and of relaxation type. Normal ellipticity and…

Analysis of PDEs · Mathematics 2012-02-20 Martin Meyries , Roland Schnaubelt

This paper is concerned with $\ell_q\,(0<q<1)$-norm regularized minimization problems with a twice continuously differentiable loss function. For this class of nonconvex and nonsmooth composite problems, many algorithms have been proposed…

Optimization and Control · Mathematics 2023-06-27 Yuqia Wu , Shaohua Pan , Xiaoqi Yang

We study integer linear programs (ILP) of the form $\min\{c^\top x\ \vert\ Ax=b,l\le x\le u,x\in\mathbb Z^n\}$ and analyze their parameterized complexity with respect to their distance to the generalized matching problem, following the…

Computational Complexity · Computer Science 2025-10-20 Alexandra Lassota , Koen Ligthart

Motivated by $\ell_p$-optimization arising from sparse optimization, high dimensional data analytics and statistics, this paper studies sparse properties of a wide range of $p$-norm based optimization problems with $p > 1$, including…

Optimization and Control · Mathematics 2017-08-22 Jinglai Shen , Seyedahmad Mousavi

We continue the development, by reduction to a first order system for the conormal gradient, of $L^2$ \textit{a priori} estimates and solvability for boundary value problems of Dirichlet, regularity, Neumann type for divergence form second…

Classical Analysis and ODEs · Mathematics 2015-05-20 Pascal Auscher , Andreas Rosén

Low rank approximation is a commonly occurring problem in many computer vision and machine learning applications. There are two common ways of optimizing the resulting models. Either the set of matrices with a given rank can be explicitly…

Computer Vision and Pattern Recognition · Computer Science 2019-07-24 Marcus Valtonen Örnhag , Carl Olsson , Anders Heyden

A wide range of applications arising in machine learning and signal processing can be cast as convex optimization problems. These problems are often ill-posed, i.e., the optimal solution lacks a desired property such as uniqueness or…

Optimization and Control · Mathematics 2019-07-18 Mostafa Amini , Farzad Yousefian

In this paper, we develop a new adaptive regularization method for minimizing a composite function, which is the sum of a $p$th-order ($p \ge 1$) Lipschitz continuous function and a simple, convex, and possibly nonsmooth function. We use a…

Optimization and Control · Mathematics 2025-11-17 Chang He , Bo Jiang , Yuntian Jiang , Chuwen Zhang , Shuzhong Zhang

We introduce a novel optimization algorithm for image recovery under learned sparse and low-rank constraints, which we parameterize as weighted extensions of the $\ell_p^p$-vector and $\mathcal S_p^p$ Schatten-matrix quasi-norms for…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Stamatios Lefkimmiatis , Iaroslav Koshelev

Inspired by regularization techniques in statistics and machine learning, we study complementary composite minimization in the stochastic setting. This problem corresponds to the minimization of the sum of a (weakly) smooth function endowed…

Machine Learning · Computer Science 2024-01-24 Alexandre d'Aspremont , Cristóbal Guzmán , Clément Lezane