English
Related papers

Related papers: Neural incomplete factorization: learning precondi…

200 papers

In light of recent data science trends, new interest has fallen in alternative matrix factorizations. By this, we mean various ways of factorizing particular data matrices so that the factors have special properties and reveal insights into…

Optimization and Control · Mathematics 2023-02-21 Andries Steenkamp

This Paper conducts a thorough simulation study to assess the effectiveness of various acceleration techniques designed to enhance the conjugate gradient algorithm, which is used for solving large linear systems to accelerate Bayesian…

Computation · Statistics 2025-05-06 Zhihao Zhou

Linear systems arise in generating samples and in calculating observables in lattice quantum chromodynamics~(QCD). Solving the Hermitian positive definite systems, which are sparse but ill-conditioned, involves using iterative methods, such…

High Energy Physics - Lattice · Physics 2025-09-15 Yixuan Sun , Srinivas Eswar , Yin Lin , William Detmold , Phiala Shanahan , Xiaoye Li , Yang Liu , Prasanna Balaprakash

We consider using the preconditioned-Krylov subspace method to solve the system of linear equations with a three-by-three block structure. By making use of the three-by-three block structure, eight inexact block factorization…

Numerical Analysis · Mathematics 2022-11-18 Sheng-Zhong Song , Zheng-Da Huang

In this note we exploit polynomial preconditioners for the Conjugate Gradient method to solve large symmetric positive definite linear systems in a parallel environment. We put in connection a specialized Newton method to solve the matrix…

Numerical Analysis · Mathematics 2020-11-30 Luca Bergamaschi , Angeles Martinez

The recent low-rank prior based models solve the tensor completion problem efficiently. However, these models fail to exploit the local patterns of tensors, which compromises the performance of tensor completion. In this paper, we propose a…

Numerical Analysis · Mathematics 2021-04-13 Liyu Su

Optimization over low rank matrices has broad applications in machine learning. For large scale problems, an attractive heuristic is to factorize the low rank matrix to a product of two much smaller matrices. In this paper, we study the…

Numerical Analysis · Mathematics 2019-03-19 Huan Li , Zhouchen Lin

CANDECOMP/PARAFAC (CP) tensor factorization of incomplete data is a powerful technique for tensor completion through explicitly capturing the multilinear latent factors. The existing CP algorithms require the tensor rank to be manually…

Machine Learning · Computer Science 2015-01-22 Qibin Zhao , Liqing Zhang , Andrzej Cichocki

Non-negative matrix factorization (NMF) is widely used in many applications for dimensionality reduction. Inferring an appropriate number of factors for NMF is a challenging problem, and several approaches based on information criteria or…

Methodology · Statistics 2025-02-18 Alessandro Zito , Jeffrey W. Miller

We present a novel method for graph partitioning, based on reinforcement learning and graph convolutional neural networks. Our approach is to recursively partition coarser representations of a given graph. The neural network is implemented…

Machine Learning · Computer Science 2021-06-30 Alice Gatti , Zhixiong Hu , Tess Smidt , Esmond G. Ng , Pieter Ghysels

We develop a simple algorithmic framework to solve large-scale symmetric positive definite linear systems. At its core, the framework relies on two components: (1) a norm-convergent iterative method (i.e. smoother) and (2) a preconditioner.…

Numerical Analysis · Mathematics 2013-02-18 Xiaozhe Hu , Shuhong Wu , Xiao-Hui Wu , Jinchao Xu , Chen-Song Zhang , Shiquan Zhang , Ludmil Zikatanov

We describe a second-order accurate approach to sparsifying the off-diagonal blocks in the hierarchical approximate factorizations of sparse symmetric positive definite matrices. The norm of the error made by the new approach depends…

Numerical Analysis · Mathematics 2020-08-05 Bazyli Klockiewicz , Léopold Cambier , Ryan Humble , Hamdi Tchelepi , Eric Darve

This paper examines a general class of noisy matrix completion tasks where the goal is to estimate a matrix from observations obtained at a subset of its entries, each of which is subject to random noise or corruption. Our specific focus is…

Machine Learning · Statistics 2016-11-18 Akshay Soni , Swayambhoo Jain , Jarvis Haupt , Stefano Gonella

We present a fast sparse matrix permutation algorithm tailored to linear systems arising from triangle meshes. Our approach produces nested-dissection-style permutations while significantly reducing permutation runtime overhead. Rather than…

We propose a Newton-based scheme, initialized by neural operator predictions, to accelerate the parametric solution of nonlinear problems in computational solid mechanics. First, a physics informed conditional neural field is trained to…

Machine Learning · Computer Science 2025-11-11 Kianoosh Taghikhani , Yusuke Yamazaki , Jerry Paul Varghese , Markus Apel , Reza Najian Asl , Shahed Rezaei

We introduce a unified framework for computing approximately-optimal preconditioners for solving linear and non-linear systems of equations. We demonstrate that the condition number minimization problem, under structured transformations…

Optimization and Control · Mathematics 2025-12-09 M. Levent Doğan , Alperen Ergür , Elias Tsigaridas

Several complex tasks that arise in organizations can be simplified by mapping them into a matrix completion problem. In this paper, we address a key challenge faced by our company: predicting the efficiency of artists in rendering visual…

Machine Learning · Computer Science 2020-05-19 Emanuele Bugliarello , Swayambhoo Jain , Vineeth Rakesh

Various Non-negative Matrix factorization (NMF) based methods add new terms to the cost function to adapt the model to specific tasks, such as clustering, or to preserve some structural properties in the reduced space (e.g., local…

We present a general class of compressed sensing matrices which are then demonstrated to have associated sublinear-time sparse approximation algorithms. We then develop methods for constructing specialized matrices from this class which are…

Numerical Analysis · Mathematics 2011-06-01 J. Bailey , M. A. Iwen , C. V. Spencer

Incomplete factorization is a powerful preconditioner for Krylov subspace methods for solving large-scale sparse linear systems. Existing incomplete factorization techniques, including incomplete Cholesky and incomplete LU factorizations,…

Numerical Analysis · Mathematics 2024-12-20 Aditi Ghai , Xiangmin Jiao