English
Related papers

Related papers: Preconditioned Conjugate Gradient methods for the …

200 papers

We consider the preconditioned conjugate gradient method (PCG) with optimal preconditioner in the frame of the boundary element method (BEM) for elliptic first-kind integral equations. Our adaptive algorithm steers the termination of PCG as…

Numerical Analysis · Mathematics 2019-03-21 Thomas Führer , Alexander Haberl , Dirk Praetorius , Stefan Schimanko

Due to its optimal complexity, the multigrid (MG) method is one of the most popular approaches for solving large-scale linear systems arising from the discretization of partial differential equations. However, the parallel implementation of…

Numerical Analysis · Mathematics 2025-02-27 Hardik Kothari , Maria Giuseppina Chiara Nestola , Marco Favino , Rolf Krause

In this paper, we propose a new estimation methodology based on a projected non-linear conjugate gradient (PNCG) algorithm with an efficient line search technique. We develop a general PNCG algorithm for a survival model incorporating a…

Statistics Theory · Mathematics 2020-07-07 Suvra Pal , Souvik Roy

This work proposes a new class of preconditioners for the low rank Generalized Minimal Residual Method (GMRES) for multiterm matrix equations arising from implicit timestepping of linear matrix differential equations. We are interested in…

Numerical Analysis · Mathematics 2024-10-11 Shixu Meng , Daniel Appelo , Yingda Cheng

A new iteration bound for the preconditioned conjugate gradient (PCG) method is presented that more accurately captures convergence for systems with clustered eigenspectra, where the classical condition number-based bound is too…

Numerical Analysis · Mathematics 2025-11-18 Philip Soliman , Filipe Cumaru , Alexander Heinlein

Linear solvers are key components in any software platform for scientific and engineering computing. The solution of large and sparse linear systems lies at the core of physics-driven numerical simulations relying on partial differential…

Numerical Analysis · Mathematics 2026-04-16 Massimo Bernaschi , Mauro G. Carrozzo , Alessandro Celestini , Giacomo Piperno , Pasqua D'Ambra

Connections of the conjugate gradient (CG) method with other methods in computational mathematics are surveyed, including the connections with the conjugate direction method, the subspace optimization method and the quasi-Newton method BFGS…

Numerical Analysis · Mathematics 2019-12-17 Xuping Zhang , Jiefei Yang , Ziying Liu

We investigate iterative methods with randomized preconditioners for solving overdetermined least-squares problems, where the preconditioners are based on a random embedding of the data matrix. We consider two distinct approaches: the…

Numerical Analysis · Mathematics 2021-04-15 Jonathan Lacotte , Mert Pilanci

An iteratively reweighted least squares (IRLS) method is proposed for estimating polyserial and polychoric correlation coefficients in this paper. It iteratively calculates the slopes in a series of weighted linear regression models fitting…

Methodology · Statistics 2022-10-21 Peng Zhang , Ben Liu , Jingjing Pan

The generalized least square (GLS) is one of the most basic tools in regression analyses. A major issue in implementing the GLS is estimation of the conditional variance function of the error term, which typically requires a restrictive…

Econometrics · Economics 2024-01-24 Yoichi Arai , Taisuke Otsu , Mengshan Xu

We analyze the conjugate gradient (CG) method with variable preconditioning for solving a linear system with a real symmetric positive definite (SPD) matrix of coefficients $A$. We assume that the preconditioner is SPD on each step, and…

Numerical Analysis · Mathematics 2007-12-24 Andrew V. Knyazev , Ilya Lashuk

Estimation of actual errors from the residue in iterative solutions is necessary for efficient solution of large problems when their condition number is much larger than one. Such estimators for conjugate gradient algorithms used to solve…

Numerical Analysis · Mathematics 2014-06-27 Aashish Vishwakarma , Murugesan Venkatapathi

Latent structure methods, specifically linear continuous latent structure methods, are a type of fundamental statistical learning strategy. They are widely used for dimension reduction, regression and prediction, in the fields of…

Methodology · Statistics 2025-08-07 Clara Grazian , Qian Jin , Pierre Lafaye De Micheaux

With the recent emergence of mixed precision hardware, there has been a renewed interest in its use for solving numerical linear algebra problems fast and accurately. The solution of total least squares problems, i.e., solving $\min_{E,r}…

Numerical Analysis · Mathematics 2023-09-14 Eda Oktay , Erin Carson

We propose a novel method to model nonlinear regression problems by adapting the principle of penalization to Partial Least Squares (PLS). Starting with a generalized additive model, we expand the additive component of each variable in…

Statistics Theory · Mathematics 2010-08-13 Nicole Kraemer , Anne-Laure Boulesteix , Gerhard Tutz

The efficient solution of large-scale multiterm linear matrix equations is a challenging task in numerical linear algebra, and it is a largely open problem. We propose a new iterative scheme for symmetric and positive definite operators,…

Numerical Analysis · Mathematics 2025-05-27 Davide Palitta , Martina Iannacito , Valeria Simoncini

Parameter estimation problems of mathematical models can often be formulated as nonlinear least squares problems. Typically these problems are solved numerically using iterative methods. The local minimiserobtained using these iterative…

Numerical Analysis · Mathematics 2020-04-07 Yasunori Aoki , Ken Hayami , Kota Toshimoto , Yuichi Sugiyama

In simulations of fluid motion time accuracy has proven to be elusive. We seek highly accurate methods with strong enough stability properties to deal with the richness of scales of many flows. These methods must also be easy to implement…

Numerical Analysis · Mathematics 2020-10-14 Victor DeCaria , Sigal Gottlieb , Zachary J. Grant , William J. Layton

Consider a regression model with infinitely many parameters and time series errors. We are interested in choosing weights for averaging across generalized least squares (GLS) estimators obtained from a set of approximating models. However,…

Statistics Theory · Mathematics 2016-10-05 Tzu-Chang F. Cheng , Ching-Kang Ing , Shu-Hui Yu

A non-Bayesian, regression-based or generalized least squares (GLS)-based approach is formally proposed to estimate a class of time-varying AR parameter models. This approach has partly been used by Ito et al. (2014, 2016a,b), and is proven…

Methodology · Statistics 2017-12-22 Mikio Ito , Akihiko Noda , Tatsuma Wada