English
Related papers

Related papers: Efficient Interior-Point Methods for Hyperbolic Pr…

200 papers

We propose a novel methodology for solving a two-stage adjustable robust convex optimisation problem with a general (proximable) convex objective function and constraints defined by sum-of-squares (SOS) convex polynomials. These problems…

Optimization and Control · Mathematics 2026-02-17 Neil D. Dizon , Bethany I. Caldwell , Vaithilingam Jeyakumar , Guoyin Li

The rapid progress in GPU computing has revolutionized many fields, yet its potential in mathematical programming, such as linear programming (LP), has only recently begun to be realized. This survey aims to provide a comprehensive overview…

Optimization and Control · Mathematics 2025-06-04 Haihao Lu , Jinwen Yang

Second-order Newton-type algorithms that leverage the exact Hessian or its approximation are central to solve nonlinear optimization problems. However, their applications in solving large-scale nonconvex problems are hindered by three…

Optimization and Control · Mathematics 2026-04-08 Krishan Kumar , Ashutosh Sharma , Gauransh Dingwani , Nikhil Gupta , Vaishnavi Gupta , Ishan Bajaj

We propose an interior point method (IPM) for solving semidefinite programming problems (SDPs). The standard interior point algorithms used to solve SDPs work in the space of positive semidefinite matrices. Contrary to that the proposed…

Optimization and Control · Mathematics 2023-01-18 Felix Kirschner , Etienne de Klerk

We present differentially private (DP) algorithms for bilevel optimization, a problem class that received significant attention lately in various machine learning applications. These are the first algorithms for such problems under standard…

Machine Learning · Computer Science 2026-01-15 Guy Kornowski

We introduce a two-level direct solver for the Hierarchical Poincar\'e-Steklov (HPS) method for solving linear elliptic PDEs. HPS combines multidomain spectral collocation with a direct solver, enabling high-order discretizations for highly…

Numerical Analysis · Mathematics 2025-09-19 Joseph Kump , Anna Yesypenko , Per-Gunnar Martinsson

Solving high-dimensional parabolic partial differential equations (PDEs) with deep learning methods is often computationally and memory intensive, primarily due to the need for automatic differentiation (AD) to compute large Hessian…

Numerical Analysis · Mathematics 2026-01-13 Wei Cai , Shuixin Fang , Tao Zhou

We propose a fast second-order method that can be used as a drop-in replacement for current deep learning solvers. Compared to stochastic gradient descent (SGD), it only requires two additional forward-mode automatic differentiation…

Machine Learning · Computer Science 2018-05-22 João F. Henriques , Sebastien Ehrhardt , Samuel Albanie , Andrea Vedaldi

Estimation of nonlinear dynamic models from data poses many challenges, including model instability and non-convexity of long-term simulation fidelity. Recently Lagrangian relaxation has been proposed as a method to approximate simulation…

Systems and Control · Computer Science 2018-10-12 Jack Umenberger , Ian R. Manchester

While interior point methods have been the centerpiece of nonlinear programming tools used in science and engineering, their reliance on linear solvers that can tackle sparse symmetric indefinite and highly ill-conditioned problems made it…

Mathematical Software · Computer Science 2026-05-14 Slaven Peles , Kalyan S. Perumalla , Maksudul Alam , Asher J. Mancinelli , R. Cameron Rutherford , Jake Ryan , Cosmin G. Petra

Semidefinite programming (SDP) relaxation has emerged as a promising approach for neural network verification, offering tighter bounds than other convex relaxation methods for deep neural networks (DNNs) with ReLU activations. However, we…

Machine Learning · Computer Science 2025-06-13 Ryota Ueda , Takami Sato , Ken Kobayashi , Kazuhide Nakata

We introduce a novel method for handling endpoint constraints in constrained differential dynamic programming (DDP). Unlike existing approaches, our method guarantees quadratic convergence and is exact, effectively managing rank…

Optimization and Control · Mathematics 2025-03-07 Maria Parilli , Sergi Martinez , Carlos Mastalli

Despite major advancements in nonlinear programming (NLP) and convex relaxations, most system operators around the world still predominantly use some form of linear programming (LP) approximation of the AC power flow equations. This is…

Optimization and Control · Mathematics 2021-07-19 Sleiman , Mhanna , Pierluigi , Mancarella

In real-world applications, it is important for machine learning algorithms to be robust against data outliers or corruptions. In this paper, we focus on improving the robustness of a large class of learning algorithms that are formulated…

Machine Learning · Computer Science 2021-06-04 Quanming Yao , Hangsi Yang , En-Liang Hu , James Kwok

We have developed a new embedding method for solving scalar hyperbolic conservation laws on surfaces. The approach represents the interface implicitly by a signed distance function following the typical level set method and some embedding…

Numerical Analysis · Mathematics 2023-07-17 Chun Kit Hung , Shingyu Leung

We propose a new deep learning algorithm for solving high-dimensional parabolic integro-differential equations (PIDEs) and forward-backward stochastic differential equations with jumps (FBSDEJs). This novel algorithm can be viewed as an…

Numerical Analysis · Mathematics 2025-10-28 Wansheng Wang , Jiangtao Pan , Jie Wang , Zaijun Ye

In this paper we generalize the Interior Point-Proximal Method of Multipliers (IP-PMM) presented in [An Interior Point-Proximal Method of Multipliers for Convex Quadratic Programming, Computational Optimization and Applications, 78,…

Optimization and Control · Mathematics 2021-09-09 Spyridon Pougkakiotis , Jacek Gondzio

Differential Dynamic Programming (DDP) is one of the indirect methods for solving an optimal control problem. Several extensions to DDP have been proposed to add stagewise state and control constraints, which can mainly be classified as…

Optimization and Control · Mathematics 2024-09-19 Siddharth Prabhu , Srinivas Rangarajan , Mayuresh Kothare

In this work, we introduce an interior-point method that employs tensor decompositions to efficiently represent and manipulate the variables and constraints of semidefinite programs, targeting problems where the solutions may not be…

Optimization and Control · Mathematics 2025-09-16 Frederik Kelbel , Sergey Dolgov , Dante Kalise , Alessandra Russo

We introduce an extension of Stochastic Dual Dynamic Programming (SDDP) to solve stochastic convex dynamic programming equations. This extension applies when some or all primal and dual subproblems to be solved along the forward and…

Optimization and Control · Mathematics 2019-07-09 Vincent Guigues