English
Related papers

Related papers: Sparsified Cholesky Solvers for SDD linear systems

200 papers

We present new algorithms for computing the log-determinant of symmetric, diagonally dominant matrices. Existing algorithms run with cubic complexity with respect to the size of the matrix in the worst case. Our algorithm computes an…

Numerical Analysis · Computer Science 2014-08-11 Timothy Hunter , Ahmed El Alaoui , Alexandre Bayen

In this paper we propose and analyze new efficient sparse approximate inverse (SPAI) smoothers for solving the two-dimensional (2D) and three-dimensional (3D) Laplacian linear system with geometric multigrid methods. Local Fourier analysis…

Numerical Analysis · Mathematics 2022-06-14 Yunhui He , Jun Liu , Xiang-Sheng Wang

We show that if the probabilistic logarithmic-space solver or the deterministic nearly logarithmic-space solver for undirected Laplacian matrices can be extended to solve slightly larger subclasses of linear systems, then they can be use to…

Computational Complexity · Computer Science 2020-03-17 Xuangui Huang

We present the design and analysis of a near linear-work parallel algorithm for solving symmetric diagonally dominant (SDD) linear systems. On input of a SDD $n$-by-$n$ matrix $A$ with $m$ non-zero entries and a vector $b$, our algorithm…

Data Structures and Algorithms · Computer Science 2011-11-09 Guy E. Blelloch , Anupam Gupta , Ioannis Koutis , Gary L. Miller , Richard Peng , Kanat Tangwongsan

We present a fast sparse matrix permutation algorithm tailored to linear systems arising from triangle meshes. Our approach produces nested-dissection-style permutations while significantly reducing permutation runtime overhead. Rather than…

In this work, we show that solvers of elliptic boundary value problems in $d$ dimensions can be approximated to accuracy $\epsilon$ from only $\mathcal{O}\left(\log(N)\log^{d}(N / \epsilon)\right)$ matrix-vector products with carefully…

Numerical Analysis · Mathematics 2023-10-03 Florian Schäfer , Houman Owhadi

Incomplete factorizations have long been popular general-purpose algebraic preconditioners for solving large sparse linear systems of equations. Guaranteeing the factorization is breakdown free while computing a high quality preconditioner…

Numerical Analysis · Mathematics 2025-02-04 Jennifer Scott , Miroslav Tůma

The solution of sparse symmetric positive definite linear systems is an important computational kernel in large-scale scientific and engineering modeling and simulation. We will solve the linear systems using a direct method, in which a…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-02-13 M. Ozan Karsavuran , Esmond G. Ng , Barry W. Peyton

We consider a fast approximation method for a solution of a certain stochastic non-local pseudodifferential equation. This equation defines a Mat\'ern class random field. The approximation method is based on the spectral compactness of the…

Statistics Theory · Mathematics 2014-10-09 Lassi Roininen , Sari Lasanen , Mikko Orispää , Simo Särkkä

Dense kernel matrices resulting from pairwise evaluations of a kernel function arise naturally in machine learning and statistics. Previous work in constructing sparse approximate inverse Cholesky factors of such matrices by minimizing…

Computation · Statistics 2025-05-12 Stephen Huan , Joseph Guinness , Matthias Katzfuss , Houman Owhadi , Florian Schäfer

We introduce a parallel algorithm to construct a preconditioner for solving a large, sparse linear system where the coefficient matrix is a Laplacian matrix (a.k.a., graph Laplacian). Such a linear system arises from applications such as…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-30 Tianyu Liang , Chao Chen , Yotam Yaniv , Hengrui Luo , David Tench , Xiaoye S. Li , Aydin Buluc , James Demmel

Inversion of sparse matrices with standard direct solve schemes is robust, but computationally expensive. Iterative solvers, on the other hand, demonstrate better scalability; but, need to be used with an appropriate preconditioner (e.g.,…

Numerical Analysis · Mathematics 2017-09-28 Hadi Pouransari , Pieter Coulier , Eric Darve

We classify a family of matrices of shift operators that can be factorised in a computationally tractable manner with the Cholesky algorithm. Such matrices arise in the linear quadratic regulator problem, and related areas. We use the…

Optimization and Control · Mathematics 2026-02-04 Julia Adlercreutz , Richard Pates

In this paper, we present a simple combinatorial algorithm that solves symmetric diagonally dominant (SDD) linear systems in nearly-linear time. It uses very little of the machinery that previously appeared to be necessary for a such an…

Data Structures and Algorithms · Computer Science 2013-01-29 Jonathan A. Kelner , Lorenzo Orecchia , Aaron Sidford , Zeyuan Allen Zhu

Dense kernel matrices $\Theta \in \mathbb{R}^{N \times N}$ obtained from point evaluations of a covariance function $G$ at locations $\{ x_{i} \}_{1 \leq i \leq N} \subset \mathbb{R}^{d}$ arise in statistics, machine learning, and numerical…

Numerical Analysis · Mathematics 2020-11-03 Florian Schäfer , T. J. Sullivan , Houman Owhadi

We study \emph{sublinear} algorithms that solve linear systems locally. In the classical version of this problem the input is a matrix $S\in \mathbb{R}^{n\times n}$ and a vector $b\in\mathbb{R}^n$ in the range of $S$, and the goal is to…

Data Structures and Algorithms · Computer Science 2026-02-23 Alexandr Andoni , Robert Krauthgamer , Yosef Pogrow

Sparse linear algebra routines are fundamental building blocks of a large variety of scientific applications. Direct solvers, which are methods for solving linear systems via the factorization of matrices into products of triangular…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-02-21 Valentin Le Fèvre , Tetsuzo Usui , Marc Casas

Many of today's problems require techniques that involve the solution of arbitrarily large systems $A\mathbf{x}=\mathbf{b}$. A popular numerical approach is the so-called Greedy Rank-One Update Algorithm, based on a particular tensor…

Numerical Analysis · Mathematics 2022-09-07 J. A. Conejero , A. Falcó , M. Mora-Jiménez

We introduce a new approach to spectral sparsification that approximates the quadratic form of the pseudoinverse of a graph Laplacian restricted to a subspace. We show that sparsifiers with a near-linear number of edges in the dimension of…

Data Structures and Algorithms · Computer Science 2018-10-09 Huan Li , Aaron Schild

We introduce a randomized algorithm, namely RCHOL, to construct an approximate Cholesky factorization for a given Laplacian matrix (a.k.a., graph Laplacian). From a graph perspective, the exact Cholesky factorization introduces a clique in…

Numerical Analysis · Mathematics 2021-09-06 Chao Chen , Tianyu Liang , George Biros