English
Related papers

Related papers: Compact Quasi-Newton preconditioners for SPD linea…

200 papers

The computational efficiency and rapid convergence of fast Fourier transform (FFT)-based solvers render them a powerful numerical tool for periodic cell problems in multiscale modeling. On regular grids, they tend to outperform traditional…

Numerical Analysis · Mathematics 2026-02-18 Martin Ladecký , Ivana Pultarová , François Bignonnet , Indre Jödicke , Jan Zeman , Lars Pastewka

Numerical simulation of fracture contact poromechanics is essential for various applications, including CO2 sequestration, geothermal energy production and underground gas storage. Modeling this problem accurately presents significant…

Numerical Analysis · Mathematics 2025-01-14 Yury Zabegaev , Inga Berre , Eirik Keilegavlen , Kundan Kumar

We study the solution of large symmetric positive-definite linear systems in a matrix-free setting with a limited iteration budget. We focus on the preconditioned conjugate gradient (PCG) method with spectral preconditioning. Spectral…

Numerical Analysis · Mathematics 2026-04-01 Youssef Diouane , Selime Gürol , Oussama Mouhtal , Dominique Orban

In this paper, we present a structured solver based on the preconditioned conjugate gradient method (PCGM) for solving the linear quadratic (LQ) optimal control problem for $K \times N$ sub-systems connected in a two-dimensional (2D) grid…

Optimization and Control · Mathematics 2023-04-18 Armaghan Zafar , Ian R. Manchester

In this report, we present a versatile and efficient preconditioned Anderson acceleration (PAA) method for fixed-point iterations. The proposed framework offers flexibility in balancing convergence rates (linear, super-linear, or quadratic)…

Numerical Analysis · Mathematics 2023-10-09 Kewang Chen , Ye Ji , Matthias Möller , Cornelis Vuik

The classic method for computing the spectral decomposition of a real symmetric matrix, the Jacobi algorithm, can be accelerated by using mixed precision arithmetic. The Jacobi algorithm is aiming to reduce the off-diagonal entries…

Numerical Analysis · Mathematics 2025-09-03 Zhengbo Zhou

In this paper, we introduce a quasi-Newton method optimized for efficiently solving quasi-linear elliptic equations and systems, with a specific focus on GPU-based computation. By approximating the Jacobian matrix with a combination of…

Numerical Analysis · Mathematics 2025-03-25 Wenrui Hao , Sun Lee , Xiangxiong Zhang

The quasi-Newton equation is the very basis of a variety of the quasi-Newton methods. By using a relationship formula between nonlinear polynomial equations and the corresponding Jacobian matrix. presented recently by the present author, we…

Numerical Analysis · Mathematics 2025-10-20 W. Chen

Recently a new algorithm for model reduction of second order linear dynamical systems with proportional damping, the Adaptive Iterative Rational Global Arnoldi (AIRGA) algorithm, has been proposed. The main computational cost of the AIRGA…

Numerical Analysis · Mathematics 2017-02-15 Navneet Pratap Singh , Kapil Ahuja , Heike Fassbender

We discuss the close connection between eigenvalue computation and optimization using the Newton method and subspace methods. From the connection we derive a new class of Newton updates. The new update formulation is similar to the…

Numerical Analysis · Mathematics 2025-10-20 Yunkai Zhou

The numerical solution of partial differential equations on high-dimensional domains gives rise to computationally challenging linear systems. When using standard discretization techniques, the size of the linear system grows exponentially…

Numerical Analysis · Mathematics 2015-08-13 Daniel Kressner , Michael Steinlechner , Bart Vandereycken

Solving symmetric positive semidefinite linear systems is an essential task in many scientific computing problems. While Jacobi-type methods, including the classical Jacobi method and the weighted Jacobi method, exhibit simplicity in their…

Optimization and Control · Mathematics 2025-10-16 Ling Liang , Qiyuan Pang , Kim-Chuan Toh , Haizhao Yang

The Newton's method for solving stationary Navier-Stokes equations (NSE) is known to convergent fast, however, may fail due to a bad initial guess. This work presents a simple-to-implement nonlinear preconditioning of Newton's iteration,…

Numerical Analysis · Mathematics 2025-08-01 Muhammad Mohebujjaman , Mengying Xiao , Cheng Zhang

We describe novel subgradient methods for a broad class of matrix optimization problems involving nuclear norm regularization. Unlike existing approaches, our method executes very cheap iterations by combining low-rank stochastic…

Machine Learning · Computer Science 2012-07-03 Haim Avron , Satyen Kale , Shiva Kasiviswanathan , Vikas Sindhwani

The goal of this paper is to study approaches to bridge the gap between first-order and second-order type methods for composite convex programs. Our key observations are: i) Many well-known operator splitting methods, such as…

Optimization and Control · Mathematics 2016-09-27 Xiantao Xiao , Yongfeng Li , Zaiwen Wen , Liwei Zhang

We discuss techniques for accelerating the self consistent field (SCF) iteration for solving the Kohn-Sham equations. These techniques are all based on constructing approximations to the inverse of the Jacobian associated with a fixed point…

Computational Physics · Physics 2015-03-20 Lin Lin , Chao Yang

This article is concerned with the question of constructing effcient multigrid preconditioners for the linear systems arising when applying semismooth Newton methods to large-scale linear-quadratic optimization problems constrained by…

Numerical Analysis · Mathematics 2013-11-08 Andrei Draganescu

The main computational cost of algorithms for computing reduced-order models of parametric dynamical systems is in solving sequences of very large and sparse linear systems. We focus on efficiently solving these linear systems, arising…

Numerical Analysis · Mathematics 2018-09-19 Navneet Pratap Singh , Kapil Ahuja

We study a semismooth Newton-type method for the nearest doubly stochastic matrix problem where both differentiability and nonsingularity of the Jacobian can fail. The optimality conditions for this problem are formulated as a system of…

Optimization and Control · Mathematics 2021-07-21 Hao Hu , Haesol Im , Xinxin Li , Henry Wolkowicz

We develop a simple algorithmic framework to solve large-scale symmetric positive definite linear systems. At its core, the framework relies on two components: (1) a norm-convergent iterative method (i.e. smoother) and (2) a preconditioner.…

Numerical Analysis · Mathematics 2013-02-18 Xiaozhe Hu , Shuhong Wu , Xiao-Hui Wu , Jinchao Xu , Chen-Song Zhang , Shiquan Zhang , Ludmil Zikatanov