English
Related papers

Related papers: Exploiting block triangular submatrices in KKT sys…

200 papers

In this paper, we consider a class of nonsmooth sum-of-ratios fractional optimization problems with block structure. This model class is ubiquitous and encompasses several important nonsmooth optimization problems in the literature. We…

Optimization and Control · Mathematics 2023-05-22 Radu Ioan Boţ , Minh N. Dao , Guoyin Li

A trajectory-following primal--dual interior-point method solves nonlinear optimization problems with inequality and equality constraints by approximately finding points satisfying perturbed Karush--Kuhn--Tucker optimality conditions for a…

Optimization and Control · Mathematics 2025-07-03 Pim Heeman , Anders Forsgren

In this work, we develop an optimization framework for problems whose solutions are well-approximated by Hierarchical Tucker (HT) tensors, an efficient structured tensor format based on recursive subspace factorizations. By exploiting the…

Numerical Analysis · Mathematics 2014-05-12 Curt Da Silva , Felix J. Herrmann

Current state of the art preconditioners for the reduced Hessian and the Karush-Kuhn-Tucker (KKT) operator for large scale inverse problems are typically based on approximating the reduced Hessian with the regularization operator. However,…

Numerical Analysis · Mathematics 2017-08-03 Nick Alger , Umberto Villa , Tan Bui-Thanh , Omar Ghattas

Clustering is a hard discrete optimization problem. Nonconvex approaches such as low-rank semidefinite programming (SDP) have recently demonstrated promising statistical and local algorithmic guarantees for cluster recovery. Due to the…

Machine Learning · Computer Science 2026-03-05 Peng Xu , Chun-Ying Hou , Xiaohui Chen , Richard Y. Zhang

Some fast algorithms for computing the eigenvalues of a block companion matrix $A = U + XY^H$, where $U\in \mathbb C^{n\times n}$ is unitary block circulant and $X, Y \in\mathbb{C}^{n \times k}$, have recently appeared in the literature.…

Numerical Analysis · Mathematics 2019-08-30 Roberto Bevilacqua , Gianna M. Del Corso , Luca Gemignani

In a recent paper, a new method was proposed to find the common invariant subspaces of a set of matrices. This paper invstigates the more general problem of putting a set of matrices into block triangular or block-diagonal form…

General Mathematics · Mathematics 2024-08-29 Ahmad Y. Al-Dweik , Ryad Ghanam , Gerard Thompson , M. T. Mustafa

In this paper, we propose iterative inner/outer approximations based on a recent notion of block factor-width-two matrices for solving semidefinite programs (SDPs). Our inner/outer approximating algorithms generate a sequence of upper/lower…

Optimization and Control · Mathematics 2022-09-30 Feng-Yi Liao , Yang Zheng

In this paper, we further investigate and refine the subspace-constrained preconditioning technique to enhance the theoretical and numerical convergence properties of randomized iterative methods for solving linear systems. In particular,…

Numerical Analysis · Mathematics 2026-05-29 Yonghan Sun , Hou-Duo Qi , Deren Han , Jiaxin Xie

This work focuses on the iterative solution of sequences of KKT linear systems arising in interior point methods applied to large convex quadratic programming problems. This task is the computational core of the interior point procedure and…

Numerical Analysis · Mathematics 2015-09-22 S. Bellavia , V. De Simone , D. di Serafino , B. Morini

We propose a simple technique that, if combined with algorithms for computing functions of triangular matrices, can make them more efficient. Basically, such a technique consists in a specific scaling similarity transformation that reduces…

Numerical Analysis · Mathematics 2021-11-18 João R. Cardoso , Amir Sadeghi

Most linear algebra kernels in interior point methods for linear programming require the solution of linear systems of equation with the matrix $N = A^TD^{-1}A$ (or $AD^{-1}A^T$), where $A$ denotes the constraint matrix of the linear…

Numerical Analysis · Mathematics 2017-08-17 Robert Luce

We provide a computational framework for approximating a class of structured matrices; here, the term structure is very general, and may refer to a regular sparsity pattern (e.g., block-banded), or be more highly structured (e.g., symmetric…

Numerical Analysis · Mathematics 2021-05-05 Misha E. Kilmer , Arvind K. Saibaba

Block Krylov subspace methods (KSMs) comprise building blocks in many state-of-the-art solvers for large-scale matrix equations as they arise, e.g., from the discretization of partial differential equations. While extended and rational…

Numerical Analysis · Mathematics 2020-02-06 Daniel Kressner , Kathryn Lund , Stefano Massei , Davide Palitta

Numeric modeling of electromagnetics and acoustics frequently entails matrix-vector multiplication with block Toeplitz structure. When the corresponding block Toeplitz matrix is not highly sparse, e.g. when considering the electromagnetic…

Numerical Analysis · Mathematics 2024-06-27 Alexandre Siron , Sean Molesky

Complex valued systems with an indefinite matrix term arise in important applications such as for certain time-harmonic partial differential equations such as the Maxwell's equation and for the Helmholtz equation. Complex systems with…

Numerical Analysis · Mathematics 2021-10-04 Owe Axelsson , Maeddeh Pourbagher , Davod Khojasteh Salkuyeh

Solving optimization problems with transient PDE-constraints is computationally costly due to the number of nonlinear iterations and the cost of solving large-scale KKT matrices. These matrices scale with the size of the spatial…

Numerical Analysis · Mathematics 2023-05-09 Eric C. Cyr

The exponential of block triangular matrices arises in a wide range of scientific computing applications, including exponential integrators for solving systems of ordinary differential equations, Hamiltonian systems in control theory,…

Numerical Analysis · Mathematics 2025-05-27 Awad H. Al-Mohy

In this article, we propose an algorithm for approximating the action of $\varphi-$functions of matrices against vectors, which is a key operation in exponential time integrators. In particular, we consider matrices with Kronecker sum…

Numerical Analysis · Mathematics 2022-11-03 Matteo Croci , Judit Muñoz-Matute

Use of the stochastic Galerkin finite element methods leads to large systems of linear equations obtained by the discretization of tensor product solution spaces along their spatial and stochastic dimensions. These systems are typically…

Numerical Analysis · Mathematics 2014-07-17 Bedřich Sousedík , Roger G. Ghanem , Eric T. Phipps