English
Related papers

Related papers: Using incomplete indefinite $LDL^T$ preconditionin…

200 papers

Large linear systems are ubiquitous in modern computational science and engineering. The main recipe for solving them is the use of Krylov subspace iterative methods with well-designed preconditioners. Recently, GNNs have been shown to be a…

Machine Learning · Computer Science 2025-02-04 Vladislav Trifonov , Alexander Rudikov , Oleg Iliev , Yuri M. Laevsky , Ivan Oseledets , Ekaterina Muravleva

The interior-point method (IPM) has become the workhorse method for nonlinear programming. The performance of IPM is directly related to the linear solver employed to factorize the Karush--Kuhn--Tucker (KKT) system at each iteration of the…

Optimization and Control · Mathematics 2022-03-23 François Pacaud , Sungho Shin , Michel Schanen , Daniel Adrian Maldonado , Mihai Anitescu

In this paper, an idea to solve nonlinear equations is presented. During the solution of any problem with Newton's Method, it might happen that some of the unknowns satisfy the convergence criteria where the others fail. The convergence…

Mathematical Software · Computer Science 2012-03-15 Erhan Turan , Ali Ecder

In this paper we provide an $\tilde{O}(nd+d^{3})$ time randomized algorithm for solving linear programs with $d$ variables and $n$ constraints with high probability. To obtain this result we provide a robust, primal-dual…

Data Structures and Algorithms · Computer Science 2021-08-24 Jan van den Brand , Yin Tat Lee , Aaron Sidford , Zhao Song

A linearly implicit conservative difference scheme is applied to discretize the attractive coupled nonlinear Schr\"odinger equations with fractional Laplacian. Complex symmetric linear systems can be obtained, and the system matrices are…

Numerical Analysis · Mathematics 2023-10-19 Yan Cheng , Xi Yang

Auxiliary variables are often used to model a convex piecewise linear function in the framework of linear optimization. This work shows that such variables yield a block diagonal plus low rank structure in the reduced KKT system of the dual…

Optimization and Control · Mathematics 2022-03-16 Bram L. Gorissen

In breakthrough work, Tardos (Oper. Res. '86) gave a proximity based framework for solving linear programming (LP) in time depending only on the constraint matrix in the bit complexity model. In Tardos's framework, one reduces solving the…

Optimization and Control · Mathematics 2020-09-11 Daniel Dadush , Bento Natura , László A. Végh

We introduce a new first-order method for solving general semidefinite programming problems, based on the alternating direction method of multipliers (ADMM) and a matrix-splitting technique. Our algorithm has an advantage over the…

Optimization and Control · Mathematics 2024-07-30 Qiushi Han , Chenxi Li , Zhenwei Lin , Caihua Chen , Qi Deng , Dongdong Ge , Huikang Liu , Yinyu Ye

Classifiers that are linear in their parameters, and trained by optimizing a convex loss function, have predictable behavior with respect to changes in the training data, initial conditions, and optimization. Such desirable properties are…

Machine Learning · Computer Science 2020-12-22 Alessandro Achille , Aditya Golatkar , Avinash Ravichandran , Marzia Polito , Stefano Soatto

We consider using the preconditioned-Krylov subspace method to solve the system of linear equations with a three-by-three block structure. By making use of the three-by-three block structure, eight inexact block factorization…

Numerical Analysis · Mathematics 2022-11-18 Sheng-Zhong Song , Zheng-Da Huang

We show that the effects of finite-precision arithmetic in forming and solving the linear system that arises at each iteration of primal-dual interior-point algorithms for nonlinear programming are benign, provided that the iterates satisfy…

Optimization and Control · Mathematics 2025-10-20 Stephen J. Wright

Interior point methods solve small to medium sized problems to high accuracy in a reasonable amount of time. However, for larger problems as well as stochastic problems, one needs to use first-order methods such as stochastic gradient…

Optimization and Control · Mathematics 2016-10-14 Reza Takapoui , Hamid Javadi

We address the problem of learning the parameters of a stable linear time invariant (LTI) system or linear dynamical system (LDS) with unknown latent space dimension, or order, from a single time--series of noisy input-output data. We focus…

Systems and Control · Computer Science 2020-04-09 Tuhin Sarkar , Alexander Rakhlin , Munther A. Dahleh

Linear Programming is now included in Algorithm undergraduate and postgraduate courses for Computer Science majors. It is possible to teach interior-point methods directly with just minimal knowledge of Algebra and Matrices.

Data Structures and Algorithms · Computer Science 2015-01-15 Sanjeev Saxena

Satisfiability Modulo Theories (SMT) solvers check the satisfiability of quantifier-free first-order logic formulas. We consider the theory of non-linear real arithmetic where the formulae are logical combinations of polynomial constraints.…

Symbolic Computation · Computer Science 2024-01-31 Jasper Nalbach , Erika Ábrahám , Philippe Specht , Christopher W. Brown , James H. Davenport , Matthew England

PDE-constrained optimization problems with control or state constraints are challenging from an analytical as well as numerical perspective. The combination of these constraints with a sparsity-promoting $\rm L^1$ term within the objective…

Optimization and Control · Mathematics 2019-02-13 John W. Pearson , Margherita Porcelli , Martin Stoll

Maximizing the Kullback-Leibler divergence (KLD) is a fundamental problem in waveform design for active sensing and hypothesis testing, as it directly relates to the error exponent of detection probability. However, the associated…

Signal Processing · Electrical Eng. & Systems 2026-01-05 Jeongwoo Park , Seongkyu Jung , Kaiming Shen , Jeonghun Park

We present a new algorithm for convex separable quadratic programming (QP) called Nys-IP-PMM, a regularized interior-point solver that uses low-rank structure to accelerate solution of the Newton system. The algorithm combines the interior…

Optimization and Control · Mathematics 2025-01-15 Ya-Chi Chu , Luiz-Rafael Santos , Madeleine Udell

We propose an interior point method (IPM) for solving semidefinite programming problems (SDPs). The standard interior point algorithms used to solve SDPs work in the space of positive semidefinite matrices. Contrary to that the proposed…

Optimization and Control · Mathematics 2023-01-18 Felix Kirschner , Etienne de Klerk

The growing demand for solving large-scale, data-intensive linear and conic optimization problems, particularly in applications such as artificial intelligence and machine learning, has highlighted the limitations of classical interior…