English
Related papers

Related papers: Perturbation Analysis for Preconditioned Normal Eq…

200 papers

Random matrices tend to be well conditioned, and we employ this well known property to advance matrix computations. We prove that our algorithms employing Gaussian random matrices are efficient, but in our tests the algorithms have…

Numerical Analysis · Mathematics 2012-10-30 Victor Y. Pan , Guoliang Qian , Ai-Long Zheng

Pre-conditioning is a well-known concept that can significantly improve the convergence of optimization algorithms. For noise-free problems, where good pre-conditioners are not known a priori, iterative linear algebra methods offer one way…

Machine Learning · Computer Science 2019-02-21 Filip de Roos , Philipp Hennig

With the recent emergence of mixed precision hardware, there has been a renewed interest in its use for solving numerical linear algebra problems fast and accurately. The solution of total least squares problems, i.e., solving $\min_{E,r}…

Numerical Analysis · Mathematics 2023-09-14 Eda Oktay , Erin Carson

Despite hundreds of papers on preconditioned linear systems of equations, there remains a significant lack of comprehensive performance benchmarks comparing various preconditioners for solving symmetric positive definite (SPD) systems. In…

Numerical Analysis · Mathematics 2025-05-28 Marc A. Tunnell , David F. Gleich

In this paper, we further investigate and refine the subspace-constrained preconditioning technique to enhance the theoretical and numerical convergence properties of randomized iterative methods for solving linear systems. In particular,…

Numerical Analysis · Mathematics 2026-05-29 Yonghan Sun , Hou-Duo Qi , Deren Han , Jiaxin Xie

Solving systems of linear equations is a problem occuring frequently in water engineering applications. Usually the size of the problem is too large to be solved via direct factorization. One can resort to iterative approaches, in…

Machine Learning · Computer Science 2019-06-18 Johannes Sappl , Laurent Seiler , Matthias Harders , Wolfgang Rauch

Recent literature has advocated the use of randomized methods for accelerating the solution of various matrix problems arising throughout data science and computational science. One popular strategy for leveraging randomization is to use it…

Numerical Analysis · Mathematics 2024-09-27 Boris Shustin , Haim Avron

In this paper we present general-purpose preconditioners for regularized augmented systems arising from optimization problems, and their corresponding normal equations. We discuss positive definite preconditioners, suitable for CG and…

Optimization and Control · Mathematics 2022-04-01 Jacek Gondzio , Spyridon Pougkakiotis , John W. Pearson

In this paper, we address the efficient numerical solution of linear and quadratic programming problems, often of large scale. With this aim, we devise an infeasible interior point method, blended with the proximal method of multipliers,…

Numerical Analysis · Mathematics 2021-01-18 Luca Bergamaschi , Jacek Gondzio , Ángeles Martínez , John W. Pearson , Spyridon Pougkakiotis

We consider approximation algorithms for the problem of finding $x$ of minimal norm $\|x\|$ satisfying a linear system $\mathbf{A} x = \mathbf{b}$, where the norm $\|\cdot \|$ is arbitrary and generally non-Euclidean. We show a simple…

Data Structures and Algorithms · Computer Science 2016-06-28 Jonah Sherman

In this work we study preprocessing for tractable problems when part of the input is unknown or uncertain. This comes up naturally if, e.g., the load of some machines or the congestion of some roads is not known far enough in advance, or if…

Data Structures and Algorithms · Computer Science 2015-10-20 Stefan Fafianie , Stefan Kratsch , Voung Anh Quyen

In this research, to solve the large indefinite least squares problem, we firstly transform its normal equation into a sparse block three-by-three linear systems, then use GMRES method with an accelerated preconditioner to solve it. The…

Numerical Analysis · Mathematics 2025-05-26 Jun Li , Lingsheng Meng

Trimming is a ubiquitous operation in computer-aided-design whereby parts of a geometry are merged, intersected, or simply discarded. While it grants virtually unlimited flexibility in geometric design, it introduces a plethora of other…

Numerical Analysis · Mathematics 2026-04-15 Yannis Voet , Matthias Möller , Pablo Antolin , Cornelis Vuik

We develop a family of reformulations of an arbitrary consistent linear system into a stochastic problem. The reformulations are governed by two user-defined parameters: a positive definite matrix defining a norm, and an arbitrary discrete…

Numerical Analysis · Mathematics 2020-01-27 Peter Richtárik , Martin Takáč

Preconditioning is a technique from numerical linear algebra that can accelerate algorithms to solve systems of equations. In this paper, we demonstrate how preconditioning can circumvent a stringent assumption for sign consistency in…

Statistics Theory · Mathematics 2012-08-29 Jinzhu Jia , Karl Rohe

We use the practical framework for abstract perturbed saddle point problems recently introduced by Hong et al. to analyze the mixed formulation of the Hodge Laplace problem. We compose two parameter-dependent norms in which the uniform…

Numerical Analysis · Mathematics 2025-08-01 Wietse M. Boon , Johannes Kraus , Tomáš Luber , Maria Lymbery

A new preconditioner is developed for high order finite element approximation of linear elastic problems on triangular meshes in two dimensions. The new preconditioner results in a condition number that is bounded independently of the…

Numerical Analysis · Mathematics 2023-02-10 Mark Ainsworth , Charles Parker

In this paper, we present perturbation analysis and randomized algorithms for the total least squares (TLS) problems. We derive the perturbation bound and check its sharpness by numerical experiments. Motivated by the recently popular…

Numerical Analysis · Mathematics 2014-11-12 Pengpeng Xie , Yimin Wei , Hua Xiang

Large linear systems are ubiquitous in modern computational science and engineering. The main recipe for solving them is the use of Krylov subspace iterative methods with well-designed preconditioners. Recently, GNNs have been shown to be a…

Machine Learning · Computer Science 2025-02-04 Vladislav Trifonov , Alexander Rudikov , Oleg Iliev , Yuri M. Laevsky , Ivan Oseledets , Ekaterina Muravleva

Randomized methods are becoming increasingly popular in numerical linear algebra. However, few attempts have been made to use them in developing preconditioners. Our interest lies in solving large-scale sparse symmetric positive definite…

Numerical Analysis · Mathematics 2021-11-16 Hussam Al Daas , Tyrone Rees , Jennifer Scott