English
Related papers

Related papers: Structured preconditioning of conjugate gradients …

200 papers

This work presents a GPU-accelerated solver for the unit commitment (UC) problem in large-scale power grids. The solver uses the Primal-Dual Hybrid Gradient (PDHG) algorithm to efficiently solve the relaxed linear subproblem, achieving…

Optimization and Control · Mathematics 2025-12-09 Hussein Sharadga , Javad Mohammadi

We address the solution of the distributed control problem for the steady, incompressible Navier--Stokes equations. We propose an inexact Newton linearization of the optimality conditions. Upon discretization by a finite element scheme, we…

Numerical Analysis · Mathematics 2025-04-16 Santolo Leveque , Michele Benzi , Patrick E. Farrell

The Strong Constraint 4D Variational (SC-4DVAR) data assimilation method is widely used in climate and weather applications. SC-4DVAR involves solving a minimization problem to compute the maximum a posteriori estimate, which we tackle…

Numerical Analysis · Mathematics 2025-06-16 Amit N. Subrahmanya , Vishwas Rao , Arvind K. Saibaba

In this paper we study proximal conditional-gradient (CG) and proximal gradient-projection type algorithms for a block-structured constrained nonconvex optimization model, which arises naturally from tensor data analysis. First, we…

Optimization and Control · Mathematics 2014-10-16 Bo Jiang , Shuzhong Zhang

Despite hundreds of papers on preconditioned linear systems of equations, there remains a significant lack of comprehensive performance benchmarks comparing various preconditioners for solving symmetric positive definite (SPD) systems. In…

Numerical Analysis · Mathematics 2025-05-28 Marc A. Tunnell , David F. Gleich

A new polynomial preconditioner for symmetric complex linear systems based on Hermitian and skew-Hermitian splitting (HSS) for complex symmetric linear systems is herein presented. It applies to Conjugate Orthogonal Conjugate Gradient…

Numerical Analysis · Mathematics 2016-04-18 Enrico Bertolazzi , Marco Frego

This paper investigates a combinatorial optimization problem motived from a secure power network design application in [D\'{a}n and Sandberg 2010]. Two equivalent graph optimization formulations are derived. One of the formulations is a…

Optimization and Control · Mathematics 2017-02-28 Kin Cheong Sou , Jie Lu

In this paper, we consider solving a composite optimization problem with coupling constraints in a multi-agent network based on proximal gradient method. In this problem, all the agents jointly minimize the sum of individual cost functions…

Optimization and Control · Mathematics 2021-08-30 Jianzheng Wang , Guoqiang Hu

This work studies a composite minimization problem involving a differentiable function q and a nonsmooth function h, both of which may be nonconvex. This problem is ubiquitous in signal processing and machine learning yet remains…

Signal Processing · Electrical Eng. & Systems 2025-09-22 Yiming Zhou , Wei Dai

The performance of eigenvalue problem solvers (eigensolvers) depends on various factors such as preconditioning and eigenvalue distribution. Developing stable and rapidly converging vectorwise eigensolvers is a crucial step in improving the…

Numerical Analysis · Mathematics 2026-01-09 Ming Zhou , Klaus Neymeyr

We consider the setting of distributed empirical risk minimization where multiple machines compute the gradients in parallel and a centralized server updates the model parameters. In order to reduce the number of communications required to…

Optimization and Control · Mathematics 2020-02-26 Hadrien Hendrikx , Lin Xiao , Sebastien Bubeck , Francis Bach , Laurent Massoulie

In this paper, we present a conditional gradient type (CGT) method for solving a class of composite optimization problems where the objective function consists of a (weakly) smooth term and a (strongly) convex regularization term. While…

Optimization and Control · Mathematics 2018-01-03 Saeed Ghadimi

In practical computations, the (preconditioned) conjugate gradient (P)CG method is the iterative method of choice for solving systems of linear algebraic equations $Ax=b$ with a real symmetric positive definite matrix $A$. During the…

Numerical Analysis · Mathematics 2021-01-12 Gérard Meurant , Jan Papež , Petr Tichý

This paper provides the first provable $\mathcal{O}(N \log N)$ algorithms for the linear system arising from the direct finite element discretization of the fourth-order equation with different boundary conditions on unstructured grids of…

Numerical Analysis · Mathematics 2012-03-06 Shuo Zhang , Jinchao Xu

We propose an adaptive multigrid preconditioning technology for solving linear systems arising from Discontinuous Petrov-Galerkin (DPG) discretizations. Unlike standard multigrid techniques, this preconditioner involves only trace spaces…

Numerical Analysis · Mathematics 2020-10-15 Socratis Petrides , Leszek Demkowicz

The projected gradient descent (PGD) method has shown to be effective in recovering compressed signals described in a data-driven way by a generative model, i.e., a generator which has learned the data distribution. Further reconstruction…

Machine Learning · Computer Science 2021-09-03 Muhammad Fadli Damara , Gregor Kornhardt , Peter Jung

This paper studies the distributed model predictive control (DMPC) problem for distributed discrete-time linear systems with both local and global constraints over directed communication networks. We establish an optimization problem to…

Optimization and Control · Mathematics 2025-11-06 Pengbiao Wang , Xuemei Ren , Dongdong Zheng

This paper considers the problem of multi-agent distributed optimization. In this problem, there are multiple agents in the system, and each agent only knows its local cost function. The objective for the agents is to collectively compute a…

Optimization and Control · Mathematics 2020-03-31 Kushal Chakrabarti , Nirupam Gupta , Nikhil Chopra

This paper presents a $C^0$ weak Galerkin ($C^0$-WG) method combined with an additive Schwarz preconditioner for solving optimal control problems (OCPs) governed by partial differential equations with general tracking cost functionals and…

Numerical Analysis · Mathematics 2026-04-02 SeongHee Jeong , Seulip Lee , Kening Wang

The Projected Gradient Descent (PGD) algorithm is a widely used and efficient first-order method for solving constrained optimization problems due to its simplicity and scalability in large design spaces. Building on recent advancements in…

Optimization and Control · Mathematics 2025-06-18 Lucka Barbeau , Marc-Étienne Lamarche-Gagnon , Florin Ilinca