English
Related papers

Related papers: Nearly-Linear Time Algorithms for Preconditioning …

200 papers

We initiate a study of solving a row/column diagonally dominant (RDD/CDD) linear system $Mx=b$ in sublinear time, with the goal of estimating $t^{\top}x^*$ for a given vector $t\in R^n$ and a specific solution $x^*$. This setting naturally…

Data Structures and Algorithms · Computer Science 2026-01-27 Tsz Chiu Kwok , Zhewei Wei , Mingji Yang

We revisit Matrix Balancing, a pre-conditioning task used ubiquitously for computing eigenvalues and matrix exponentials. Since 1960, Osborne's algorithm has been the practitioners' algorithm of choice and is now implemented in most…

Optimization and Control · Mathematics 2021-07-06 Jason M. Altschuler , Pablo A. Parrilo

We introduce a randomized algorithm for computing the minimal-norm solution to an underdetermined system of linear equations. Given an arbitrary full-rank m x n matrix A with m<n, any m x 1 vector b, and any positive real number epsilon…

Numerical Analysis · Computer Science 2009-09-08 Mark Tygert

Preconditioning of a linear system obtained from spectral discretization of time-dependent PDEs often results in a full matrix which is expensive to compute and store specially when the problem size increases. A matrix-free implementation…

Statistics Theory · Mathematics 2016-06-09 A. Ghasemi , L. K. Taylor

In this paper, we present a simple combinatorial algorithm that solves symmetric diagonally dominant (SDD) linear systems in nearly-linear time. It uses very little of the machinery that previously appeared to be necessary for a such an…

Data Structures and Algorithms · Computer Science 2013-01-29 Jonathan A. Kelner , Lorenzo Orecchia , Aaron Sidford , Zeyuan Allen Zhu

Although some preconditioners are available for solving dense linear systems, there are still many matrices for which preconditioners are lacking, in particular in cases where the size of the matrix $N$ becomes very large. There remains…

Numerical Analysis · Mathematics 2016-02-05 Pieter Coulier , Hadi Pouransari , Eric Darve

Preconditioning is a technique from numerical linear algebra that can accelerate algorithms to solve systems of equations. In this paper, we demonstrate how preconditioning can circumvent a stringent assumption for sign consistency in…

Statistics Theory · Mathematics 2012-08-29 Jinzhu Jia , Karl Rohe

We show how to solve directed Laplacian systems in nearly-linear time. Given a linear system in an $n \times n$ Eulerian directed Laplacian with $m$ nonzero entries, we show how to compute an $\epsilon$-approximate solution in time $O(m…

Data Structures and Algorithms · Computer Science 2018-11-28 Michael B. Cohen , Jonathan Kelner , Rasmus Kyng , John Peebles , Richard Peng , Anup B. Rao , Aaron Sidford

This paper introduces the Nystr\"om PCG algorithm for solving a symmetric positive-definite linear system. The algorithm applies the randomized Nystr\"om method to form a low-rank approximation of the matrix, which leads to an efficient…

Numerical Analysis · Mathematics 2021-12-20 Zachary Frangella , Joel A. Tropp , Madeleine Udell

We study the problem of detecting outlier pairs of strongly correlated variables among a collection of $n$ variables with otherwise weak pairwise correlations. After normalization, this task amounts to the geometric task where we are given…

Data Structures and Algorithms · Computer Science 2018-01-08 Matti Karppa , Petteri Kaski , Jukka Kohonen

A new domain decomposition preconditioner is introduced for efficiently solving linear systems Ax = b with a symmetric positive definite matrix A. The particularity of the new preconditioner is that it is not necessary to have access to the…

Numerical Analysis · Mathematics 2021-06-23 Nicole Spillane

We present classical sublinear-time algorithms for solving low-rank linear systems of equations. Our algorithms are inspired by the HHL quantum algorithm for solving linear systems and the recent breakthrough by Tang of dequantizing the…

Data Structures and Algorithms · Computer Science 2018-11-13 Nai-Hui Chia , Han-Hsuan Lin , Chunhao Wang

We show that preconditioners constructed by random sampling can perform well without meeting the standard requirements of iterative methods. When applied to graph Laplacians, this leads to ultra-sparsifiers that in expectation behave as the…

Data Structures and Algorithms · Computer Science 2014-01-27 Michael B. Cohen , Rasmus Kyng , Jakub W. Pachocki , Richard Peng , Anup Rao

Preconditioning has long been a staple technique in optimization, often applied to reduce the condition number of a matrix and speed up the convergence of algorithms. Although there are many popular preconditioning techniques in practice,…

Optimization and Control · Mathematics 2022-11-08 Zhaonan Qu , Wenzhi Gao , Oliver Hinder , Yinyu Ye , Zhengyuan Zhou

This paper presents a weakly intrusive strategy for computing a low-rank approximation of the solution of a system of nonlinear parameter-dependent equations. The proposed strategy relies on a Newton-like iterative solver which only…

Numerical Analysis · Mathematics 2020-05-06 Loic Giraldi , Anthony Nouy

Causal effect estimation from observational data is a fundamental task in empirical sciences. It becomes particularly challenging when unobserved confounders are involved in a system. This paper focuses on front-door adjustment -- a classic…

Artificial Intelligence · Computer Science 2024-01-29 Marcel Wienöbst , Benito van der Zander , Maciej Liśkiewicz

In this work we revisit the elementary scheduling problem $1||\sum p_j U_j$. The goal is to select, among $n$ jobs with processing times and due dates, a subset of jobs with maximum total processing time that can be scheduled in sequence…

Data Structures and Algorithms · Computer Science 2025-07-23 Nick Fischer , Leo Wennmann

We present the first near optimal approximation schemes for the maximum weighted (uncapacitated or capacitated) $b$--matching problems for non-bipartite graphs that run in time (near) linear in the number of edges. For any…

Data Structures and Algorithms · Computer Science 2018-06-19 Kook Jin Ahn , Sudipto Guha

This work aims to accelerate the convergence of proximal gradient methods used to solve regularized linear inverse problems. This is achieved by designing a polynomial-based preconditioner that targets the eigenvalue spectrum of the normal…

In this paper, we investigate the preconditioned AOR method for solving linear systems. We study two general preconditioners and propose some lower triangular, upper triangular and combination preconditioners. For $A$ being an L-matrix, a…

Numerical Analysis · Mathematics 2020-02-04 Yongzhong Song