English
Related papers

Related papers: Sparsified Cholesky and Multigrid Solvers for Conn…

200 papers

In geometry processing, numerical optimization methods often involve solving sparse linear systems of equations. These linear systems have a structure that strongly resembles to adjacency graphs of the underlying mesh. We observe how…

Numerical Analysis · Computer Science 2015-10-06 Nicolas Ray , Sokolov Dmitry

We review strategies for differentiating matrix-based computations, and derive symbolic and algorithmic update rules for differentiating expressions containing the Cholesky decomposition. We recommend new `blocked' algorithms, based on…

Computation · Statistics 2016-02-25 Iain Murray

Preconditioning techniques are crucial for enhancing the efficiency of solving large-scale linear equation systems that arise from partial differential equation (PDE) discretization. These techniques, such as Incomplete Cholesky…

Machine Learning · Computer Science 2024-12-11 Rui Li , Song Wang , Chen Wang

We present a matrix-factorization algorithm that scales to input matrices with both huge number of rows and columns. Learned factors may be sparse or dense and/or non-negative, which makes our algorithm suitable for dictionary learning,…

Machine Learning · Statistics 2017-11-15 Arthur Mensch , Julien Mairal , Bertrand Thirion , Gael Varoquaux

We propose a solution strategy for linear systems arising in interior method optimization, which is suitable for implementation on hardware accelerators such as graphical processing units (GPUs). The current gold standard for solving these…

Optimization and Control · Mathematics 2026-03-09 Shaked Regev , Nai-Yuan Chiang , Eric Darve , Cosmin G. Petra , Michael A. Saunders , Kasia Świrydowicz , Slaven Peleš

In inverse problems, it is widely recognized that the incorporation of a sparsity prior yields a regularization effect on the solution. This approach is grounded on the a priori assumption that the unknown can be appropriately represented…

Machine Learning · Statistics 2025-06-13 Giovanni S. Alberti , Luca Ratti , Matteo Santacesaria , Silvia Sciutto

In this paper, we propose a fast spectral-Galerkin method for solving PDEs involving integral fractional Laplacian in $\mathbb{R}^d$, which is built upon two essential components: (i) the Dunford-Taylor formulation of the fractional…

Numerical Analysis · Mathematics 2019-08-28 Changtao Sheng , Jie Shen , Tao Tang , Li-Lian Wang , Huifang Yuan

Recovering low-rank and sparse matrices from incomplete or corrupted observations is an important problem in machine learning, statistics, bioinformatics, computer vision, as well as signal and image processing. In theory, this problem can…

Machine Learning · Computer Science 2014-09-04 Fanhua Shang , Yuanyuan Liu , Hanghang Tong , James Cheng , Hong Cheng

In this paper, we bring the main tools of the Laplacian paradigm to the Broadcast Congested Clique. We introduce an algorithm to compute spectral sparsifiers in a polylogarithmic number of rounds, which directly leads to an efficient…

Data Structures and Algorithms · Computer Science 2022-05-25 Sebastian Forster , Tijn de Vos

Large linear systems with sparse, non-symmetric matrices arise in the modeling of Markov chains or in the discretization of convection-diffusion problems. Due to their potential to solve sparse linear systems with an effort that is linear…

Numerical Analysis · Mathematics 2023-08-17 Benjamin Seibold

Solving systems of linear equations is a problem occuring frequently in water engineering applications. Usually the size of the problem is too large to be solved via direct factorization. One can resort to iterative approaches, in…

Machine Learning · Computer Science 2019-06-18 Johannes Sappl , Laurent Seiler , Matthias Harders , Wolfgang Rauch

We analyze two algorithms for computing the symplectic $LL^T$ factorization $A=LL^T$ of a given symmetric positive definite symplectic matrix $A$. The first algorithm $W_1$ is an implementation of the $HH^T$ factorization from [Dopico et…

Numerical Analysis · Mathematics 2022-04-11 Maksymilian Bujok , Alicja Smoktunowicz , Grzegorz Borowik

Efficient numerical solvers for sparse linear systems are crucial in science and engineering. One of the fastest methods for solving large-scale sparse linear systems is algebraic multigrid (AMG). The main challenge in the construction of…

Machine Learning · Computer Science 2020-09-25 Ilay Luz , Meirav Galun , Haggai Maron , Ronen Basri , Irad Yavneh

Many models for undirected graphs are based on factorizing the graph's adjacency matrix; these models find a vector representation of each node such that the predicted probability of a link between two nodes increases with the similarity…

Machine Learning · Computer Science 2022-10-04 Sudhanshu Chanpuriya , Ryan A. Rossi , Anup Rao , Tung Mai , Nedim Lipka , Zhao Song , Cameron Musco

This paper tackles the challenging problem of jointly inferring time-varying network topologies and imputing missing data from partially observed graph signals. We propose a unified non-convex optimization framework to simultaneously…

Machine Learning · Statistics 2026-05-07 Chuansen Peng , Xiaojing Shen

Linear reversible circuits represent a subclass of reversible circuits with many applications in quantum computing. These circuits can be efficiently simulated by classical computers and their size is polynomially bounded by the number of…

The emergence of low precision floating-point arithmetic in computer hardware has led to a resurgence of interest in the use of mixed precision numerical linear algebra. For linear systems of equations, there has been renewed enthusiasm for…

Numerical Analysis · Mathematics 2024-02-22 Jennifer Scott , Miroslav Tůma

We consider the problem of matrix completion with side information (\textit{inductive matrix completion}). In real-world applications many side-channel features are typically non-informative making feature selection an important part of the…

Machine Learning · Statistics 2018-10-09 Ivan Nazarov , Boris Shirokikh , Maria Burkina , Gennady Fedonin , Maxim Panov

Algebraic multigrid (AMG) is an $\mathcal{O}(n)$ solution process for many large sparse linear systems. A hierarchy of progressively coarser grids is constructed that utilize complementary relaxation and interpolation operators. High-energy…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-12-16 Amanda Bienz , Robert D. Falgout William Gropp , Luke N. Olson , Jacob B. Schroder

Presented in this paper is a new sparse linear solver methodology motivated by multigrid principles and based around general local transformations that diagonalize a matrix while maintaining its sparsity. These transformations are…

Numerical Analysis · Mathematics 2007-05-23 Jonathan E. Moussa