English
Related papers

Related papers: Using incomplete indefinite $LDL^T$ preconditionin…

200 papers

The solution of systems of linear(ized) equations lies at the heart of many problems in Scientific Computing. In particular for systems of large dimension, iterative methods are a primary approach. Stationary iterative methods are generally…

Numerical Analysis · Mathematics 2025-04-08 Andy Wathen

Large-scale contact mechanics simulations are crucial in many engineering fields such as structural design and manufacturing. In the frictionless case, contact can be modeled by minimizing an energy functional; however, these problems are…

We present a new class of preconditioned iterative methods for solving linear systems of the form $Ax = b$. Our methods are based on constructing a low-rank Nystr\"om approximation to $A$ using sparse random matrix sketching. This…

Data Structures and Algorithms · Computer Science 2025-04-14 Michał Dereziński , Christopher Musco , Jiaming Yang

In these notes we propose and analyze an inertial type method for obtaining stable approximate solutions to nonlinear ill-posed operator equations. The method is based on the Levenberg-Marquardt (LM) iteration. The main obtained results…

Numerical Analysis · Mathematics 2024-06-12 Antonio Leitão , Joel C. Rabelo , Dirk A. Lorenz , Maximilian Winkler

In this paper, we present numerical methods suitable for solving convex quadratic Fractional Differential Equation (FDE) constrained optimization problems, with box constraints on the state and/or control variables. We develop an…

Optimization and Control · Mathematics 2021-02-01 Spyridon Pougkakiotis , John W. Pearson , Santolo Leveque , Jacek Gondzio

Generalizing earlier work characterizing the quantum query complexity of computing a function of an unknown classical ``black box'' function drawn from some set of such black box functions, we investigate a more general quantum query model…

Quantum Physics · Physics 2007-05-23 Howard N. Barnum

This paper proposes an arc-search interior-point algorithm for the nonlinear constrained optimization problem. The proposed algorithm uses the second-order derivatives to construct a search arc that approaches the optimizer. Because the arc…

Optimization and Control · Mathematics 2025-06-13 Yaguang Yang

Kernel logistic regression (KLR) is a conventional nonlinear classifier in machine learning. With the explosive growth of data size, the storage and computation of large dense kernel matrices is a major challenge in scaling KLR. Even the…

Machine Learning · Computer Science 2022-07-29 Junna Zhang , Shuisheng Zhou , Cui Fu , Feng Ye

Recent work in deep learning has opened new possibilities for solving classical algorithmic tasks using end-to-end learned models. In this work, we investigate the fundamental task of solving linear systems, particularly those that are…

Machine Learning · Computer Science 2025-11-19 Pietro Sittoni , Francesco Tudisco

We present a globally convergent SQP-type method with the least constraint violation for nonlinear semidefinite programming. The proposed algorithm employs a two-phase strategy coupled with a line search technique. In the first phase, a…

Optimization and Control · Mathematics 2024-06-03 Wenhao Fu , Zhongwen Chen

We develop a new interior-point method (IPM) for symmetric-cone optimization, a common generalization of linear, second-order-cone, and semidefinite programming. In contrast to classical IPMs, we update iterates with a geodesic of the cone…

Optimization and Control · Mathematics 2023-01-18 Frank Permenter

This paper presents a weakly intrusive strategy for computing a low-rank approximation of the solution of a system of nonlinear parameter-dependent equations. The proposed strategy relies on a Newton-like iterative solver which only…

Numerical Analysis · Mathematics 2020-05-06 Loic Giraldi , Anthony Nouy

We develop a general framework for finding approximately-optimal preconditioners for solving linear systems. Leveraging this framework we obtain improved runtimes for fundamental preconditioning and linear system solving problems including…

Data Structures and Algorithms · Computer Science 2023-10-30 Arun Jambulapati , Jerry Li , Christopher Musco , Kirankumar Shiragur , Aaron Sidford , Kevin Tian

This paper introduces a stratification framework for nonlinear semidefinite programming (NLSDP) that reveals and utilizes the geometry behind the nonsmooth KKT system. Based on the \emph{index stratification} of $\mathbb{S}^n$ and its lift…

Optimization and Control · Mathematics 2026-03-10 Chenglong Bao , Chao Ding , Fuxiaoyue Feng , Jingyu Li

We apply preconditioning, which is widely used in classical solvers for linear systems $A\textbf{x}=\textbf{b}$, to the variational quantum linear solver. By utilizing incomplete LU factorization as a preconditioner for linear equations…

Kernel-based learning algorithms are widely used in machine learning for problems that make use of the similarity between object pairs. Such algorithms first embed all data points into an alternative space, where the inner product between…

Machine Learning · Statistics 2017-09-21 Amir-Hossein Karimi

In this work, we study linear error-correcting codes against adversarial insertion-deletion (indel) errors. While most constructions for the indel model are nonlinear, linear codes offer compact representations, efficient encoding, and…

Information Theory · Computer Science 2025-10-01 Roee Gross , Roni Con , Eitan Yaakobi

We propose a method for solving Karush-Kuhn-Tucker (KKT) systems that exploits block triangular submatrices by first using a Schur complement decomposition to isolate the block triangular submatrices then performing a block backsolve where…

Optimization and Control · Mathematics 2026-02-23 Robert Parker , Manuel Garcia , Russell Bent

This paper describes the implementation of a new interior point solver for linear programming for the open-source optimization library HiGHS. The solver uses a direct factorisation to solve the Newton systems, choosing the best approach…

Optimization and Control · Mathematics 2025-08-07 Filippo Zanetti , Jacek Gondzio

We study first-order methods (FOMs) for solving \emph{composite nonconvex nonsmooth} optimization with linear constraints. Recently, the lower complexity bounds of FOMs on finding an ($\varepsilon,\varepsilon$)-KKT point of the considered…

Optimization and Control · Mathematics 2025-04-01 Wei Liu , Qihang Lin , Yangyang Xu