English
Related papers

Related papers: Efficient Preconditioners for Interior Point Metho…

200 papers

We consider a class of optimization problems for sparse signal reconstruction which arise in the field of Compressed Sensing (CS). A plethora of approaches and solvers exist for such problems, for example GPSR, FPC AS, SPGL1, NestA,…

Optimization and Control · Mathematics 2013-11-19 Kimon Fountoulakis , Jacek Gondzio , Pavel Zhlobich

We derive novel, fast, and parameter-robust preconditioned iterative methods for steady and time-dependent Navier--Stokes control problems. Our approach may be applied to time-dependent problems which are discretized using backward Euler or…

Numerical Analysis · Mathematics 2021-08-03 Santolo Leveque , John W. Pearson

We study the computational complexity certification of inexact gradient augmented Lagrangian methods for solving convex optimization problems with complicated constraints. We solve the augmented Lagrangian dual problem that arises from the…

Optimization and Control · Mathematics 2013-02-19 Valentin Nedelcu , Ion Necoara , Quoc Tran Dinh

We develop a simple algorithmic framework to solve large-scale symmetric positive definite linear systems. At its core, the framework relies on two components: (1) a norm-convergent iterative method (i.e. smoother) and (2) a preconditioner.…

Numerical Analysis · Mathematics 2013-02-18 Xiaozhe Hu , Shuhong Wu , Xiao-Hui Wu , Jinchao Xu , Chen-Song Zhang , Shiquan Zhang , Ludmil Zikatanov

This work proposes a new class of preconditioners for the low rank Generalized Minimal Residual Method (GMRES) for multiterm matrix equations arising from implicit timestepping of linear matrix differential equations. We are interested in…

Numerical Analysis · Mathematics 2024-10-11 Shixu Meng , Daniel Appelo , Yingda Cheng

The use of the Preconditioned Conjugate Gradient (PCG) method for computing the Generalized Least Squares (GLS) estimator of the General Linear Model (GLM) is considered. The GLS estimator is expressed in terms of the solution of an…

Numerical Analysis · Mathematics 2025-10-17 Paolo Foschi

This paper introduces a new sweeping preconditioner for the iterative solution of the variable coefficient Helmholtz equation in two and three dimensions. The algorithms follow the general structure of constructing an approximate $LDL^t$…

Numerical Analysis · Mathematics 2010-08-03 Björn Engquist , Lexing Ying

In this work, we develop proximal preconditioned gradient methods with a focus on spectral gradient methods providing a proximal extension to the Muon and Scion optimizers. We introduce a family of stochastic algorithms that can handle a…

The PMCHWT integral equation enables the modelling of scattering of time-harmonic fields by penetrable, piecewise homogeneous, systems. They have been generalised to include the modelling of composite systems that may contain junctions,…

Computational Engineering, Finance, and Science · Computer Science 2025-06-23 Kristof Cools

The discretization of constrained nonlinear optimization problems arising in the field of topology optimization yields algebraic systems which are challenging to solve in practice, due to pathological ill-conditioning, strong nonlinearity…

Optimization and Control · Mathematics 2016-10-31 Michal Kocvara , Daniel Loghin , James Turner

We present a short step interior point method for solving a class of nonlinear programming problems with quadratic objective function. Convex quadratic programming problems can be reformulated as problems in this class. The method is shown…

Optimization and Control · Mathematics 2018-05-14 Martin Neuenhofen , Stefania Bellavia

Large-scale optimization problems that seek sparse solutions have become ubiquitous. They are routinely solved with various specialized first-order methods. Although such methods are often fast, they usually struggle with not-so-well…

Optimization and Control · Mathematics 2021-11-29 Valentina De Simone , Daniela di Serafino , Jacek Gondzio , Spyridon Pougkakiotis , Marco Viola

Adaptive regularization methods pre-multiply a descent direction by a preconditioning matrix. Due to the large number of parameters of machine learning problems, full-matrix preconditioning methods are prohibitively expensive. We show how…

Machine Learning · Computer Science 2020-11-19 Naman Agarwal , Brian Bullins , Xinyi Chen , Elad Hazan , Karan Singh , Cyril Zhang , Yi Zhang

The importance of Schur complement based preconditioners are well-established for classical saddle point problems in $\mathbb{R}^N \times \mathbb{R}^M$. In this paper we extend these results to multiple saddle point problems in Hilbert…

Numerical Analysis · Mathematics 2020-12-25 Jarle Sogn , Walter Zulehner

We present an adaptive grid matrix-free operator approximation scheme based on a "product-convolution" interpolation of convolution operators. This scheme is appropriate for operators that are locally translation-invariant, even if these…

Numerical Analysis · Mathematics 2019-02-07 Nick Alger , Vishwas Rao , Aaron Myers , Tan Bui-Thanh , Omar Ghattas

The treatment of the differential PDE constraint poses a key challenge in computing the numerical solution of the Serre-Green-Naghdi (SGN) equations. In this work, we introduce a constant coefficient preconditioner for the SGN constraint…

Numerical Analysis · Mathematics 2025-06-23 Linwan Feng , David Shirokoff , Wooyoung Choi

In this paper, we proposed an interior point method for constrained optimization, which is characterized by the using of quasi-tangential subproblem. This algorithm follows the main ideas of primal dual interior point methods and…

Optimization and Control · Mathematics 2015-09-10 Songqiang Qiu , Zhongwen Chen

The goal of this work is to construct and study hybrid and multiplicative two-level overlapping Schwarz algorithms with standard coarse spaces for the almost incompressible linear elasticity and Stokes systems, discretized by mixed finite…

Numerical Analysis · Mathematics 2016-11-03 Mingchao Cai , Luca F. Pavarino

A structured preconditioned conjugate gradient (PCG) solver is developed for the Newton steps in second-order methods for a class of constrained network optimal control problems. Of specific interest are problems with discrete-time dynamics…

Systems and Control · Electrical Eng. & Systems 2020-10-13 Armaghan Zafar , Michael Cantoni , Farhad Farokhi

State-of-the-art classical optimization solvers set a high bar for quantum computers to deliver utility in this domain. Here, we introduce a quantum preconditioning approach based on the quantum approximate optimization algorithm. It…

Quantum Physics · Physics 2025-10-08 Maxime Dupont , Tina Oberoi , Bhuvanesh Sundar