English
Related papers

Related papers: A universal matrix-free split preconditioner for t…

200 papers

The convergence rates of iterative methods for solving a linear system $\mathbf{A} x = b$ typically depend on the condition number of the matrix $\mathbf{A}$. Preconditioning is a common way of speeding up these methods by reducing that…

Optimization and Control · Mathematics 2021-11-04 Arun Jambulapati , Jerry Li , Christopher Musco , Aaron Sidford , Kevin Tian

A hierarchical solver is proposed for solving sparse ill-conditioned linear systems in parallel. The solver is based on a modification of the LoRaSp method, but employs a deferred-compression technique, which provably reduces the…

Numerical Analysis · Mathematics 2019-09-04 Chao Chen , Leopold Cambier , Erik G. Boman , Sivasankaran Rajamanickam , Raymond S. Tuminaro , Eric Darve

Layer-wise preconditioning methods are a family of memory-efficient optimization algorithms that introduce preconditioners per axis of each layer's weight tensors. These methods have seen a recent resurgence, demonstrating impressive…

Machine Learning · Computer Science 2025-02-05 Thomas T. Zhang , Behrad Moniri , Ansh Nagwekar , Faraz Rahman , Anton Xue , Hamed Hassani , Nikolai Matni

In this work, we propose a novel preconditioned Krylov subspace method for solving an optimal control problem of wave equations, after explicitly identifying the asymptotic spectral distribution of the involved sequence of linear…

Numerical Analysis · Mathematics 2023-07-25 Sean Hon , Jiamei Dong , Stefano Serra-Capizzano

We study frugal splitting algorithms with minimal lifting for solving monotone inclusion problems involving sums of maximal monotone and cocoercive operators. Building on a foundational result by Ryu, we fully characterize all methods that…

Optimization and Control · Mathematics 2025-04-16 Anton Åkerman , Enis Chenchene , Pontus Giselsson , Emanuele Naldi

Efficient and suitably preconditioned iterative solvers for elliptic partial differential equations (PDEs) of the convection-diffusion type are used in all fields of science and engineering. To achieve optimal performance, solvers have to…

Numerical Analysis · Mathematics 2019-07-24 Peter Bastian , Eike Hermann Müller , Steffen Müthing , Marian Piatkowski

In this paper, we study a fast and linearized finite difference method to solve the nonlinear time-fractional wave equation with multi fractional orders. We first propose a discretization to the multi-term Caputo derivative based on the…

Numerical Analysis · Mathematics 2019-02-22 Pin Lyu , Yuxiang Liang , Zhibo Wang

The split feasibility problem is to find an element in the intersection of a closed set $C$ and the linear preimage of another closed set $D$, assuming the projections onto $C$ and $D$ are easy to compute. This class of problems arises…

Optimization and Control · Mathematics 2020-11-05 Chen Chen , Ting Kei Pong , Lulin Tan , Liaoyuan Zeng

In this paper, we consider a class of nonconvex and nonsmooth fractional programming problems, that involve the sum of a convex, possibly nonsmooth function composed with a linear operator and a differentiable, possibly nonconvex function…

Optimization and Control · Mathematics 2025-03-18 Radu Ioan Boţ , Guoyin Li , Min Tao

We investigate the use of piecewise linear systems, whose coefficient matrix is a piecewise constant function of the solution itself. Such systems arise, for example, from the numerical solution of linear complementarity problems and in the…

Numerical Analysis · Mathematics 2012-06-21 Luigi Brugnano , Alessandra Sestini

In this article, we propose and study a stochastic and relaxed preconditioned Douglas--Rachford splitting method to solve saddle-point problems that have separable dual variables. We prove the almost sure convergence of the iteration…

Optimization and Control · Mathematics 2024-10-01 Yakun Dong , Kristian Bredies , Hongpeng Sun

The paper describes an improved parallel MPI-based implementation of VBARMS, a variable block variant of the pARMS preconditioner proposed by Li,~Saad and Sosonkina [NLAA, 2003] for solving general nonsymmetric linear systems. The parallel…

Numerical Analysis · Mathematics 2015-08-11 Bruno Carpentieri , Jia Liao , Masha Sosonkina , Aldo Bonfiglioli

This paper provides a new way of developing the splitting method which is used to solve the problem of finding the resolvent of the sum of maximal monotone operators in Hilbert spaces. By employing accelerated techniques developed by Davis…

Optimization and Control · Mathematics 2018-09-13 Shin-ya Matsushita

In this paper, we study the robust linearization of nonlinear poromechanics of unsaturated materials. The model of interest couples the Richards equation with linear elasticity equations, employing the equivalent pore pressure. In practice…

Numerical Analysis · Mathematics 2021-05-24 Jakub Wiktor Both , Kundan Kumar , Jan Martin Nordbotten , Florin Adrian Radu

In this paper, we derive a practical, general framework for creating adaptive iterative (linearization or splitting) algorithms to solve multi-physics problems. This means that, given an iterative method, we derive \textit{a posteriori}…

Numerical Analysis · Mathematics 2026-01-26 Jakob S. Stokke , Kundan Kumar , Florin A. Radu

This work presents a universal accelerated first-order primal-dual method for affinely constrained convex optimization problems. It can handle both Lipschitz and H\"{o}lder gradients but does not need to know the smoothness level of the…

Optimization and Control · Mathematics 2022-11-09 Hao Luo

We propose an adaptive multigrid preconditioning technology for solving linear systems arising from Discontinuous Petrov-Galerkin (DPG) discretizations. Unlike standard multigrid techniques, this preconditioner involves only trace spaces…

Numerical Analysis · Mathematics 2020-10-15 Socratis Petrides , Leszek Demkowicz

In this paper we provide an algorithm for solving constrained composite primal-dual monotone inclusions, i.e., monotone inclusions in which a priori information on primal-dual solutions is represented via closed convex sets. The proposed…

Optimization and Control · Mathematics 2018-05-31 Luis Briceño-Arias , Sergio López Rivera

We study first-order methods with preconditioning for solving structured nonlinear convex optimization problems. We propose a new family of preconditioners generated by symmetric polynomials. They provide first-order optimization methods…

Optimization and Control · Mathematics 2023-01-31 Nikita Doikov , Anton Rodomanov

In this paper, the generalized shift-splitting preconditioner is implemented for saddle point problems with symmetric positive definite (1,1)-block and symmetric positive semidefinite (2,2)-block. The proposed preconditioner is extracted…

Numerical Analysis · Mathematics 2015-03-03 Davod Khojasteh Salkuyeh , Mohsen Masoudi , Davod Hezari