English
Related papers

Related papers: Towards understanding CG and GMRES through example…

200 papers

We analyse the calibration of BayesCG under the Krylov prior, a probabilistic numeric extension of the Conjugate Gradient (CG) method for solving systems of linear equations with symmetric positive definite coefficient matrix. Calibration…

Numerical Analysis · Mathematics 2022-08-09 Tim W. Reid , Ilse C. F. Ipsen , Jon Cockayne , Chris J. Oates

Convex clustering is a well-regarded clustering method, resembling the similar centroid-based approach of Lloyd's $k$-means, without requiring a predefined cluster count. It starts with each data point as its centroid and iteratively merges…

Machine Learning · Statistics 2026-05-15 Shubhayan Pan , Kushal Bose , Debolina Paul , Saptarshi Chakraborty , Swagatam Das

Lagrangian Coherent Structures (LCS) are flow features which are defined to objectively characterize complex fluid behavior over a finite time regardless of the orientation of the observer. Fluidic applications of LCS include geophysical,…

Fluid Dynamics · Physics 2023-10-18 Tanner D. Harms , Steven L. Brunton , Beverley J. McKeon

This paper concerns models and convergence principles for dealing with stochasticity in a wide range of algorithms arising in nonlinear analysis and optimization in Hilbert spaces. It proposes a flexible geometric framework within which…

Optimization and Control · Mathematics 2026-02-17 Patrick L. Combettes , Javier I. Madariaga

This work proposes a new class of preconditioners for the low rank Generalized Minimal Residual Method (GMRES) for multiterm matrix equations arising from implicit timestepping of linear matrix differential equations. We are interested in…

Numerical Analysis · Mathematics 2024-10-11 Shixu Meng , Daniel Appelo , Yingda Cheng

Due to their flexibility, Gaussian processes (GPs) have been widely used in nonparametric function estimation. A prior information about the underlying function is often available. For instance, the physical system (computer model output)…

Methodology · Statistics 2017-11-21 Hassan Maatouk

Gravity inversion is the problem of estimating subsurface density distributions from observed gravitational field data. We consider the two-dimensional (2D) case, in which recovering density models from one-dimensional (1D) measurements…

The convergence of GMRES for solving linear systems can be influenced heavily by the structure of the right hand side. Within the solution of eigenvalue problems via inverse iteration or subspace iteration, the right hand side is generally…

Numerical Analysis · Mathematics 2017-05-31 Melina Freitag , Patrick Kürschner , Jennifer Pestana

Gaussian processes are notorious for scaling cubically with the size of the training set, preventing application to very large regression problems. Computation-aware Gaussian processes (CAGPs) tackle this scaling issue by exploiting…

Machine Learning · Statistics 2025-03-24 Disha Hegde , Mohamed Adil , Jon Cockayne

It is well known that as a famous type of iterative methods in numerical linear algebra, Gauss-Seidel iterative methods are convergent for linear systems with strictly or irreducibly diagonally dominant matrices, invertible $H-$matrices…

Numerical Analysis · Mathematics 2014-10-14 Cheng-yi Zhang , Dan Ye , Cong-lei Zhong , Shuanghua Luo

This paper presents a brief historical survey of iterative methods for solving linear systems of equations. The journey begins with Gauss who developed the first known method that can be termed iterative. The early 20th century saw good…

History and Overview · Mathematics 2019-08-06 Yousef Saad

Granger causality (GC) is often considered not an actual form of causality. Still, it is arguably the most widely used method to assess the predictability of a time series from another one. Granger causality has been widely used in many…

Machine Learning · Computer Science 2023-07-21 Víctor Elvira , Émilie Chouzenoux , Jordi Cerdà , Gustau Camps-Valls

Restarted GMRES is a robust and widely used iterative solver for linear systems. The control of the restart parameter is a key task to accelerate convergence and to prevent the well-known stagnation phenomenon. We focus on the…

Numerical Analysis · Mathematics 2026-02-19 Lennart Duvenbeck , Cedric Riethmüller , Christian Rohde

Support for lower precision computation is becoming more common in accelerator hardware due to lower power usage, reduced data movement and increased computational performance. However, computational science and engineering (CSE) problems…

Numerical Analysis · Mathematics 2021-05-18 Jennifer A. Loe , Christian A. Glusa , Ichitaro Yamazaki , Erik G. Boman , Sivasankaran Rajamanickam

This paper develops a new class of algorithms for general linear systems and eigenvalue problems. These algorithms apply fast randomized sketching to accelerate subspace projection methods, such as GMRES and Rayleigh--Ritz. This approach…

Numerical Analysis · Mathematics 2022-02-17 Yuji Nakatsukasa , Joel A. Tropp

The article mainly introduces preprocessing algorithms for solving linear equation systems. This algorithm uses three algorithms as inner iterations, namely RPCG algorithm, ADI algorithm, and Kaczmarz algorithm. Then, it uses BA-GMRES as an…

Numerical Analysis · Mathematics 2024-04-10 Juan Zhang , Yiyi Luo

When an iterative method is applied to solve the linear equation system in interior point methods (IPMs), the attention is usually placed on accelerating their convergence by designing appropriate preconditioners, but the linear solver is…

Optimization and Control · Mathematics 2023-04-28 Filippo Zanetti , Jacek Gondzio

In this paper we first identify a basic limitation in gradient descent-based optimization methods when used in conjunctions with smooth kernels. An analysis based on the spectral properties of the kernel demonstrates that only a vanishingly…

Machine Learning · Statistics 2017-06-20 Siyuan Ma , Mikhail Belkin

A new iterative method for solving large scale symmetric nonlinear eigenvalue problems is presented. We firstly derive an infinite dimensional symmetric linearization of the nonlinear eigenvalue problem, then we apply the indefinite Lanczos…

Numerical Analysis · Mathematics 2019-10-11 Giampaolo Mele

We show that most arithmetic circuit lower bounds and relations between lower bounds naturally fit into the representation-theoretic framework suggested by geometric complexity theory (GCT), including: the partial derivatives technique…

Computational Complexity · Computer Science 2017-09-07 Joshua A. Grochow