English
Related papers

Related papers: Preconditioned nonlinear conjugate gradient method…

200 papers

In micromagnetic simulations, the demagnetization field is by far the computationally most expensive field component and often a limiting factor in large multilayer systems. We present an exact method to calculate the demagnetization field…

Computational Physics · Physics 2020-03-18 Paul Heistracher , Florian Bruckner , Claas Abert , Christoph Vogler , Dieter Suess

The aim of this paper is to develop stable and accurate numerical schemes for boundary integral formulations of the heat equation with Dirichlet boundary conditions. The accuracy of Galerkin discretisations for the resulting boundary…

Numerical Analysis · Mathematics 2018-05-01 Alexey Chernov , Anne Reinarz

We propose a lower bound on the log marginal likelihood of Gaussian process regression models that can be computed without matrix factorisation of the full kernel matrix. We show that approximate maximum likelihood learning of model…

Machine Learning · Statistics 2021-02-17 Artem Artemev , David R. Burt , Mark van der Wilk

This work aims to accelerate the convergence of proximal gradient methods used to solve regularized linear inverse problems. This is achieved by designing a polynomial-based preconditioner that targets the eigenvalue spectrum of the normal…

Dynamic relaxation for nonlinear magnetization excitation is analyzed. For direct processes, such as magnon-electron scattering and two-magnon scattering, the relaxation rate is determined from the linear case simply by utilizing the…

Materials Science · Physics 2009-11-07 Vladimir L. Safonov , H. Neal Bertram

We study first-order methods with preconditioning for solving structured nonlinear convex optimization problems. We propose a new family of preconditioners generated by symmetric polynomials. They provide first-order optimization methods…

Optimization and Control · Mathematics 2023-01-31 Nikita Doikov , Anton Rodomanov

Large linear systems are ubiquitous in modern computational science and engineering. The main recipe for solving them is the use of Krylov subspace iterative methods with well-designed preconditioners. Recently, GNNs have been shown to be a…

Machine Learning · Computer Science 2025-02-04 Vladislav Trifonov , Alexander Rudikov , Oleg Iliev , Yuri M. Laevsky , Ivan Oseledets , Ekaterina Muravleva

Generally, discretization of partial differential equations (PDEs) creates a sequence of linear systems $A_k x_k = b_k, k = 0, 1, 2, ..., N$ with well-known and structured sparsity patterns. Preconditioners are often necessary to achieve…

Numerical Analysis · Mathematics 2024-06-26 Rishad Islam , Arielle Carr , Colin Jacobs

We develop a simple algorithmic framework to solve large-scale symmetric positive definite linear systems. At its core, the framework relies on two components: (1) a norm-convergent iterative method (i.e. smoother) and (2) a preconditioner.…

Numerical Analysis · Mathematics 2013-02-18 Xiaozhe Hu , Shuhong Wu , Xiao-Hui Wu , Jinchao Xu , Chen-Song Zhang , Shiquan Zhang , Ludmil Zikatanov

Inversion of sparse matrices with standard direct solve schemes is robust, but computationally expensive. Iterative solvers, on the other hand, demonstrate better scalability; but, need to be used with an appropriate preconditioner (e.g.,…

Numerical Analysis · Mathematics 2017-09-28 Hadi Pouransari , Pieter Coulier , Eric Darve

In this research, to solve the large indefinite least squares problem, we firstly transform its normal equation into a sparse block three-by-three linear systems, then use GMRES method with an accelerated preconditioner to solve it. The…

Numerical Analysis · Mathematics 2025-05-26 Jun Li , Lingsheng Meng

Trimming is a ubiquitous operation in computer-aided-design whereby parts of a geometry are merged, intersected, or simply discarded. While it grants virtually unlimited flexibility in geometric design, it introduces a plethora of other…

Numerical Analysis · Mathematics 2026-04-15 Yannis Voet , Matthias Möller , Pablo Antolin , Cornelis Vuik

The conjugate gradient method (CG) is typically used with a preconditioner which improves efficiency and robustness of the method. Many preconditioners include parameters and a proper choice of a preconditioner and its parameters is often…

Numerical Analysis · Mathematics 2019-06-04 Alexandr Katrutsa , Mike Botchev , George Ovchinnikov , Ivan Oseledets

Nonlinear conjugate gradient (NLCG) based optimizers have shown superior loss convergence properties compared to gradient descent based optimizers for traditional optimization problems. However, in Deep Neural Network (DNN) training, the…

Machine Learning · Computer Science 2019-11-21 Saurabh Adya , Vinay Palakkode , Oncel Tuzel

Algorithms for Gaussian process, marginal likelihood methods or restricted maximum likelihood methods often require derivatives of log determinant terms. These log determinants are usually parametric with variance parameters of the…

Computation · Statistics 2019-11-05 Shengxin Zhu , Andrew J Wathen

Model-based iterative reconstruction plays a key role in solving inverse problems. However, the associated minimization problems are generally large-scale, nonsmooth, and sometimes even nonconvex, which present challenges in designing…

Image and Video Processing · Electrical Eng. & Systems 2025-10-21 Tao Hong , Zhaoyi Xu , Jason Hu , Jeffrey A. Fessler

Single-spin quantum sensors, for example based on nitrogen-vacancy centres in diamond, provide nanoscale mapping of magnetic fields. In applications where the magnetic field may be changing rapidly, total sensing time is crucial and must be…

Quantum Physics · Physics 2021-05-26 K. Craigie , E. M. Gauger , Y. Altmann , C. Bonato

We present a practical algorithm for partially relaxing multiwell energy densities such as pertain to materials undergoing martensitic phase transitions. The algorithm is based on sequential lamination, but the evolution of the…

Materials Science · Physics 2015-06-24 S. Aubry , M. Fago , M. Ortiz

Uni- and bivariate data smoothing with spline functions is a well established method in nonparametric regression analysis. The extension to multivariate data is straightforward, but suffers from exponentially increasing memory and…

Numerical Analysis · Mathematics 2024-12-20 Martin Siebenborn , Julian Wagner

The development of permanent magnets containing less or no rare-earth elements is linked to profound knowledge of the coercivity mechanism. Prerequisites for a promising permanent magnet material are a high spontaneous magnetization and a…