English
Related papers

Related papers: A parallel preconditioner for the all-at-once line…

200 papers

Preconditioners are generally essential for fast convergence in the iterative solution of linear systems of equations. However, the computation of a good preconditioner can be expensive. So, while solving a sequence of many linear systems,…

Numerical Analysis · Mathematics 2020-12-21 Arielle Grim-McNally , Eric de Sturler , Serkan Gugercin

In this paper we consider the composite self-concordant (CSC) minimization problem, which minimizes the sum of a self-concordant function $f$ and a (possibly nonsmooth) proper closed convex function $g$. The CSC minimization is the…

Optimization and Control · Mathematics 2016-07-04 Zhaosong Lu

The PMCHWT integral equation enables the modelling of scattering of time-harmonic fields by penetrable, piecewise homogeneous, systems. They have been generalised to include the modelling of composite systems that may contain junctions,…

Computational Engineering, Finance, and Science · Computer Science 2025-06-23 Kristof Cools

Phase-field fracture models lead to variational problems that can be written as a coupled variational equality and inequality system. Numerically, such problems can be treated with Galerkin finite elements and primal-dual active set…

Numerical Analysis · Mathematics 2020-05-04 Daniel Jodlbauer , Ulrich Langer , Thomas Wick

Multiphysics problems such as multicomponent diffusion, phase transformations in multiphase systems and alloy solidification involve numerical solution of a coupled system of nonlinear partial differential equations (PDEs). Numerical…

Materials Science · Physics 2022-11-24 Vir Karan , A. Maruthi Indresh , Saswata Bhattacharyya

We study preconditioned gradient-based optimization methods where the preconditioning matrix has block-diagonal form. Such a structural constraint comes with the advantage that the update computation is block-separable and can be…

Machine Learning · Computer Science 2020-12-08 Celestine Mendler-Dünner , Aurelien Lucchi

Preconditioning of a linear system obtained from spectral discretization of time-dependent PDEs often results in a full matrix which is expensive to compute and store specially when the problem size increases. A matrix-free implementation…

Statistics Theory · Mathematics 2016-06-09 A. Ghasemi , L. K. Taylor

This paper addresses the efficient solution of linear systems arising from curl-conforming finite element discretizations of $H(\mathrm{curl})$ elliptic problems with heterogeneous coefficients. We first employ the discrete form of a…

Numerical Analysis · Mathematics 2025-06-10 Chupeng Ma , Yongwei Zhang

Ensemble Kalman Inversion (EKI) has been proposed as an efficient method for the approximate solution of Bayesian inverse problems with expensive forward models. However, when applied to the Bayesian inverse problem EKI is only exact in the…

Computation · Statistics 2024-11-19 Richard D. P. Grumitt , Minas Karamanis , Uroš Seljak

The discretization of robust quadratic optimal control problems under uncertainty using the finite element method and the stochastic collocation method leads to large saddle-point systems, which are fully coupled across the random…

Numerical Analysis · Mathematics 2021-10-15 Fabio Nobile , Tommaso Vanzan

In this paper, we focus on solving a sequence of linear systems with an identical (or similar) coefficient matrix. For this type of problems, we investigate the subspace correction and deflation methods, which use an auxiliary matrix…

Numerical Analysis · Mathematics 2022-03-17 Takeshi Iwashita , Kota Ikehara , Takeshi Fukaya , Takeshi Mifune

We investigate non-overlapping Schwarz preconditioners for the algebraic systems stemming from high-order discretizations of the coupled monodomain and Barreto-Cressman models, with applications to brain electrophysiology. The spatial…

Numerical Analysis · Mathematics 2025-12-25 Caterina B. Leimer Saglio , Stefano Pagani , Paola F. Antonietti

This paper deals with balanced domain decomposition by constraints (BDDC) method for solving large-scale linear systems of algebraic equations arising from the space-time finite element discretization of parabolic initial-boundary value…

Numerical Analysis · Mathematics 2018-10-30 Ulrich Langer , Huidong Yang

The recent years have witnessed advances in parallel algorithms for large scale optimization problems. Notwithstanding demonstrated success, existing algorithms that parallelize over features are usually limited by divergence issues under…

Machine Learning · Computer Science 2017-12-08 An Bian , Xiong Li , Yuncai Liu , Ming-Hsuan Yang

We propose using greedy and randomized Kaczmarz inner-iterations as preconditioners for the right-preconditioned flexible GMRES method to solve consistent linear systems, with a parameter tuning strategy for adjusting the number of inner…

Numerical Analysis · Mathematics 2021-02-25 Yi-Shu Du , Ken Hayami , Ning Zheng , Keiichi Morikuni , Jun-Feng Yin

Explicit step-truncation tensor methods have recently proven successful in integrating initial value problems for high-dimensional partial differential equations (PDEs). However, the combination of non-linearity and stiffness may introduce…

Numerical Analysis · Mathematics 2023-03-21 Abram Rodgers , Daniele Venturi

A novel decomposition scheme to solve parametric non-convex programs as they arise in Nonlinear Model Predictive Control (NMPC) is presented. It consists of a fixed number of alternating proximal gradient steps and a dual update per time…

Optimization and Control · Mathematics 2014-12-25 Jean-Hubert Hours , Colin N. Jones

Numerical techniques for solving partial differential equations (PDEs) are integral for many fields across science and engineering. Such techniques usually involve solving large, sparse linear systems, where preconditioning methods are…

Machine Learning · Computer Science 2026-01-30 Alexander Benanti , Xi Han , Hong Qin

In this work, the matrix-free solution of quasi-static phase-field fracture problems is further investigated. More specifically, we consider a quasi-monolithic formulation in which the irreversibility constraint is imposed with a…

Numerical Analysis · Mathematics 2024-08-27 Leon Maximilian Kolditz , Thomas Wick

Adaptive regularization methods pre-multiply a descent direction by a preconditioning matrix. Due to the large number of parameters of machine learning problems, full-matrix preconditioning methods are prohibitively expensive. We show how…

Machine Learning · Computer Science 2020-11-19 Naman Agarwal , Brian Bullins , Xinyi Chen , Elad Hazan , Karan Singh , Cyril Zhang , Yi Zhang