English

Fast Linear Solvers via AI-Tuned Markov Chain Monte Carlo-based Matrix Inversion

Machine Learning 2025-09-24 v1 Numerical Analysis Numerical Analysis Machine Learning

Abstract

Large, sparse linear systems are pervasive in modern science and engineering, and Krylov subspace solvers are an established means of solving them. Yet convergence can be slow for ill-conditioned matrices, so practical deployments usually require preconditioners. Markov chain Monte Carlo (MCMC)-based matrix inversion can generate such preconditioners and accelerate Krylov iterations, but its effectiveness depends on parameters whose optima vary across matrices; manual or grid search is costly. We present an AI-driven framework recommending MCMC parameters for a given linear system. A graph neural surrogate predicts preconditioning speed from AA and MCMC parameters. A Bayesian acquisition function then chooses the parameter sets most likely to minimise iterations. On a previously unseen ill-conditioned system, the framework achieves better preconditioning with 50\% of the search budget of conventional methods, yielding about a 10\% reduction in iterations to convergence. These results suggest a route for incorporating MCMC-based preconditioners into large-scale systems.

Keywords

Cite

@article{arxiv.2509.18452,
  title  = {Fast Linear Solvers via AI-Tuned Markov Chain Monte Carlo-based Matrix Inversion},
  author = {Anton Lebedev and Won Kyung Lee and Soumyadip Ghosh and Olha I. Yaman and Vassilis Kalantzis and Yingdong Lu and Tomasz Nowicki and Shashanka Ubaru and Lior Horesh and Vassil Alexandrov},
  journal= {arXiv preprint arXiv:2509.18452},
  year   = {2025}
}

Comments

8 pages, 3 figures, 1 algorithm, 1 table of experiment cases

R2 v1 2026-07-01T05:51:01.974Z