English
Related papers

Related papers: Learning incomplete factorization preconditioners …

200 papers

Large linear systems are ubiquitous in modern computational science and engineering. The main recipe for solving them is the use of Krylov subspace iterative methods with well-designed preconditioners. Recently, GNNs have been shown to be a…

Machine Learning · Computer Science 2025-02-04 Vladislav Trifonov , Alexander Rudikov , Oleg Iliev , Yuri M. Laevsky , Ivan Oseledets , Ekaterina Muravleva

Preconditioning is a key component of MCMC algorithms that improves sampling efficiency by facilitating exploration of geometrically complex target distributions through an invertible map. While linear preconditioners are often sufficient…

Machine Learning · Computer Science 2025-11-05 David Nabergoj , Erik Štrumbelj

Preconditioning techniques are crucial for enhancing the efficiency of solving large-scale linear equation systems that arise from partial differential equation (PDE) discretization. These techniques, such as Incomplete Cholesky…

Machine Learning · Computer Science 2024-12-11 Rui Li , Song Wang , Chen Wang

We propose fast O(N) preconditioning, where N is the number of gridpoints on the prediction horizon, for iterative solution of (non)-linear systems appearing in model predictive control methods such as forward-difference Newton-Krylov…

Optimization and Control · Mathematics 2016-10-20 Andrew Knyazev , Alexander Malyshev

To precondition a large and sparse linear system, two direct methods for approximate factoring of the inverse are devised. The algorithms are fully parallelizable and appear to be more robust than the iterative methods suggested for the…

Numerical Analysis · Mathematics 2012-08-20 Mikko Byckling , Marko Huhtanen

This paper presents a sequential randomized lowrank matrix factorization approach for incrementally predicting values of an unknown function at test points using the Gaussian Processes framework. It is well-known that in the Gaussian…

Machine Learning · Computer Science 2017-11-21 Shaunak D. Bopardikar , George S. Eskander Ekladious

We propose a geometry-aware strategy for training neural preconditioners tailored to parametrized linear systems arising from the discretization of mixed-dimensional partial differential equations (PDEs). These systems are typically…

Numerical Analysis · Mathematics 2025-07-22 Nunzio Dimola , Alessandro Coclite , Paolo Zunino

Sparse matrix reordering can significantly reduce the fill-in during matrix factorization, thereby decreasing the computational and storage requirements in sparse matrix computations. Finding a minimal fill-in ordering is known to be an…

Machine Learning · Computer Science 2026-05-19 Ziwei Li , Tao Yuan , Shuzi Niu , Huiyuan Li

Nonnegative matrix factorization is a powerful technique to realize dimension reduction and pattern recognition through single-layer data representation learning. Deep learning, however, with its carefully designed hierarchical structure,…

Computer Vision and Pattern Recognition · Computer Science 2017-07-31 Zhenxing Guo , Shihua Zhang

The solution of sparse symmetric positive definite linear systems is an important computational kernel in large-scale scientific and engineering modeling and simulation. We will solve the linear systems using a direct method, in which a…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-02-13 M. Ozan Karsavuran , Esmond G. Ng , Barry W. Peyton

While preconditioning is a long-standing concept to accelerate iterative methods for linear systems, generalizations to matrix functions are still in their infancy. We go a further step in this direction, introducing polynomial…

Numerical Analysis · Mathematics 2024-01-15 Andreas Frommer , Gustavo Ramirez-Hidalgo , Marcel Schweitzer , Manuel Tsolakis

In this paper, a method via sparse-sparse iteration for computing a sparse incomplete factorization of the inverse of a symmetric positive definite matrix is proposed. The resulting factorized sparse approximate inverse is used as a…

Numerical Analysis · Mathematics 2008-08-03 Davod Khojasteh Salkuyeh , Faezeh Toutounian

Incomplete factorization is a widely used preconditioning technique for Krylov subspace methods for solving large-scale sparse linear systems. Its multilevel variants, such as ILUPACK, are more robust for many symmetric or unsymmetric…

Numerical Analysis · Mathematics 2021-05-31 Qiao Chen , Aditi Ghai , Xiangmin Jiao

Nonnegative matrix factorization (NMF) under the separability assumption can provably be solved efficiently, even in the presence of noise, and has been shown to be a powerful technique in document classification and hyperspectral unmixing.…

Machine Learning · Statistics 2015-04-02 Nicolas Gillis , Stephen A. Vavasis

This paper introduces a preconditioned method designed to comprehensively address the saddle point system with the aim of improving convergence efficiency. In the preprocessor construction phase, a technical approach for solving the…

Numerical Analysis · Mathematics 2024-04-10 Juan Zhang , Yiyi Luo

This work proposes a new class of preconditioners for the low rank Generalized Minimal Residual Method (GMRES) for multiterm matrix equations arising from implicit timestepping of linear matrix differential equations. We are interested in…

Numerical Analysis · Mathematics 2024-10-11 Shixu Meng , Daniel Appelo , Yingda Cheng

Sparse matrix factorization is a popular tool to obtain interpretable data decompositions, which are also effective to perform data completion or denoising. Its applicability to large datasets has been addressed with online and randomized…

Machine Learning · Statistics 2017-11-15 Arthur Mensch , Julien Mairal , Bertrand Thirion , Gaël Varoquaux

A factored Nonlinear Program (Factored-NLP) explicitly models the dependencies between a set of continuous variables and nonlinear constraints, providing an expressive formulation for relevant robotics problems such as manipulation planning…

Robotics · Computer Science 2023-05-24 Joaquim Ortiz-Haro , Jung-Su Ha , Danny Driess , Erez Karpas , Marc Toussaint

Multistep matrix splitting iterations serve as preconditioning for Krylov subspace methods for solving singular linear systems. The preconditioner is applied to the generalized minimal residual (GMRES) method and the flexible GMRES (FGMRES)…

Numerical Analysis · Mathematics 2021-11-09 Keiichi Morikuni

A technique for computing an ILU preconditioner based on the FAPINV algorithm is presented. We show that this algorithm is well-defined for H-matrices. Moreover, when used in conjunction with Krylov-subspace-based iterative solvers such as…

Numerical Analysis · Mathematics 2010-10-15 Davod Khojasteh Salkuyeh , Amin Rafiei , Hadi Roohani