English
Related papers

Related papers: Splitting-based randomized iterative methods for s…

200 papers

For solving the continuous Sylvester equation, a class of the multiplicative splitting iteration method is presented. We consider two symmetric positive definite splittings for each coefficient matrix of the continuous Sylvester equations…

Numerical Analysis · Mathematics 2020-05-19 Yu Huang , Mohammad Khorsand Zak , Emran Tohidi

We introduce an iterative scheme for discrete convex minimization problems of $p$-Laplace type such as variational graph $p$-Laplace problems and $\ell^p$ regression. In each iteration, the scheme solves only a weighted least-squares…

Optimization and Control · Mathematics 2026-03-30 Johannes Storn

Edge-preserving smoothing (EPS) can be formulated as minimizing an objective function that consists of data and prior terms. This global EPS approach shows better smoothing performance than a local one that typically has a form of weighted…

Computer Vision and Pattern Recognition · Computer Science 2016-04-27 Youngjung Kim , Dongbo Min , Bumsub Ham , Kwanghoon Sohn

Probabilistic ideas and tools have recently begun to permeate into several fields where they had traditionally not played a major role, including fields such as numerical linear algebra and optimization. One of the key ways in which these…

Numerical Analysis · Mathematics 2016-12-20 Robert M. Gower

We consider least squares semidefinite programming (LSSDP) where the primal matrix variable must satisfy given linear equality and inequality constraints, and must also lie in the intersection of the cone of symmetric positive semidefinite…

Optimization and Control · Mathematics 2015-05-26 Defeng Sun , Kim-Chuan Toh , Liuqin Yang

A new iterative method for solving large scale symmetric nonlinear eigenvalue problems is presented. We firstly derive an infinite dimensional symmetric linearization of the nonlinear eigenvalue problem, then we apply the indefinite Lanczos…

Numerical Analysis · Mathematics 2019-10-11 Giampaolo Mele

Nonlinear matrix equations arise in many practical contexts related to control theory, dynamical programming and finite element methods for solving some partial differential equations. In most of these applications, it is needed to compute…

Numerical Analysis · Mathematics 2014-10-22 Negin Bagherpour , Nezam Mahdavi-Amiri

We consider linear inverse problems where the solution is assumed to have a sparse expansion on an arbitrary pre-assigned orthonormal basis. We prove that replacing the usual quadratic regularizing penalties by weighted l^p-penalties on the…

Functional Analysis · Mathematics 2025-10-20 Ingrid Daubechies , Michel Defrise , Christine De Mol

We present a new algorithm and the corresponding convergence analysis for the regularization of linear inverse problems with sparsity constraints, applied to a new generalized sparsity promoting functional. The algorithm is based on the…

Numerical Analysis · Mathematics 2016-12-30 Sergey Voronin , Ingrid Daubechies

We propose a new algorithm for the problem of recovering data that adheres to multiple, heterogeneous low-dimensional structures from linear observations. Focusing on data matrices that are simultaneously row-sparse and low-rank, we propose…

Machine Learning · Computer Science 2024-01-19 Christian Kümmerle , Johannes Maly

Stochastic optimization algorithms update models with cheap per-iteration costs sequentially, which makes them amenable for large-scale data analysis. Such algorithms have been widely studied for structured sparse models where the sparsity…

Machine Learning · Computer Science 2019-05-10 Baojian Zhou , Feng Chen , Yiming Ying

We consider large-scale nonlinear least squares problems with sparse residuals, each of them depending on a small number of variables. A decoupling procedure which results in a splitting of the original problems into a sequence of…

Optimization and Control · Mathematics 2023-01-12 Natasa Krejic , Greta Malaspina , Lense Swaenen

In this paper, an efficient iterative method is proposed for solving multiple scattering problem in locally inhomogeneous media. The key idea is to enclose the inhomogeneity of the media by well separated artificial boundaries and then…

Numerical Analysis · Mathematics 2019-10-23 Ziqing Xie , Rui Zhang , Bo Wang , Li-lian Wang

In this paper, we propose a sparse least squares (SLS) optimization model for solving multilinear equations, in which the sparsity constraint on the solutions can effectively reduce storage and computation costs. By employing variational…

Optimization and Control · Mathematics 2023-10-10 Xin Li , Ziyan Luo , Yang Chen

LSMR is a widely recognized method for solving least squares problems via the double QR decomposition. Various preconditioning techniques have been explored to improve its efficiency. One issue that arises when implementing these…

Numerical Analysis · Mathematics 2024-08-30 Mei Yang , Gul Karaduman , Ren-Cang Li

The classical iteratively reweighted least-squares (IRLS) algorithm aims to recover an unknown signal from linear measurements by performing a sequence of weighted least squares problems, where the weights are recursively updated at each…

Machine Learning · Statistics 2024-06-06 Chiraag Kaushik , Justin Romberg , Vidya Muthukumar

This paper deals with speeding up the convergence of a class of two-step iterative methods for solving linear systems of equations. To implement the acceleration technique, the residual norm associated with computed approximations for each…

Numerical Analysis · Mathematics 2024-04-24 Fatemeh P. A. Beik , Michele Benzi , Mehdi Najafi-Kalyani

Linear programming (LP) is an extremely useful tool and has been successfully applied to solve various problems in a wide range of areas, including operations research, engineering, economics, or even more abstract mathematical areas such…

Data Structures and Algorithms · Computer Science 2020-03-19 Agniva Chowdhury , Palma London , Haim Avron , Petros Drineas

We analyze an Iteratively Re-weighted Least Squares (IRLS) algorithm for promoting l1-minimization in sparse and compressible vector recovery. We prove its convergence and we estimate its local rate. We show how the algorithm can be…

Numerical Analysis · Mathematics 2008-07-04 Ingrid Daubechies , Ronald DeVore , Massimo Fornasier , C. Sinan Gunturk

Sketch-and-solve (SAS) is a very successful method to efficiently estimate the solution of heavily overdetermined large linear least squares problems. It uses random sketching to reduce the size of the problem, hence reducing the…

Numerical Analysis · Mathematics 2026-05-26 Irina-Beatrice Haas , Michael B. Giles , Yuji Nakatsukasa