English
Related papers

Related papers: Specialized Interior Point Algorithm for Stable No…

200 papers

Semidefinite programs (SDPs) are powerful theoretical tools that have been studied for over two decades, but their practical use remains limited due to computational difficulties in solving large-scale, realistic-sized problems. In this…

Optimization and Control · Mathematics 2018-05-15 Richard Y. Zhang , Javad Lavaei

Data-driven discovery of governing equations from data remains a fundamental challenge in nonlinear dynamics. Although sparse regression techniques have advanced system identification, they struggle with rational functions and noise…

Machine Learning · Computer Science 2025-11-17 Zitong Zhang , Hao Sun

The "exact subgraph" approach was recently introduced as a hierarchical scheme to get increasingly tight semidefinite programming relaxations of several NP-hard graph optimization problems. Solving these relaxations is a computational…

Optimization and Control · Mathematics 2020-06-09 Elisabeth Gaar , Franz Rendl

A new relaxed variant of interior point method for low-rank semidefinite programming problems is proposed in this paper. The method is a step outside of the usual interior point framework. In anticipation to converging to a low-rank primal…

Numerical Analysis · Mathematics 2021-03-26 Stefania Bellavia , Jacek Gondzio , Margherita Porcelli

A new framework for nonlinear system identification is presented in terms of optimal fitting of stable nonlinear state space equations to input/output/state data, with a performance objective defined as a measure of robustness of the…

Optimization and Control · Mathematics 2016-11-17 Mark M. Tobenkin , Ian R. Manchester , Jennifer Wang , Alexandre Megretski , Russ Tedrake

We present a numerical method for the local solution of nonlinear programming problems. The SUMT approach of Fiacco and McCormick results in a merit function with quadratic penalties and logarithmic barriers. Our NLP solver works by…

Numerical Analysis · Mathematics 2018-06-12 Martin Neuenhofen

We introduce a novel procedure that, given sparse data generated from a stationary deterministic nonlinear dynamical system, can characterize specific local and/or global dynamic behavior with rigorous probability guarantees. More…

Dynamical Systems · Mathematics 2023-09-19 Bogdan Batko , Marcio Gameiro , Ying Hung , William Kalies , Konstantin Mischaikow , Ewerton Vieira

Interior point methods for solving linearly constrained convex programming involve a variable projection matrix at each iteration to deal with the linear constraints. This matrix often becomes ill-conditioned near the boundary of the…

Optimization and Control · Mathematics 2024-12-31 Xun Qian , Li-Zhi Liao , Jie Sun

Semidefinite programming (SDP) relaxation has emerged as a promising approach for neural network verification, offering tighter bounds than other convex relaxation methods for deep neural networks (DNNs) with ReLU activations. However, we…

Machine Learning · Computer Science 2025-06-13 Ryota Ueda , Takami Sato , Ken Kobayashi , Kazuhide Nakata

The classical approach to linear system identification is given by parametric Prediction Error Methods (PEM). In this context, model complexity is often unknown so that a model order selection step is needed to suitably trade-off bias and…

Machine Learning · Statistics 2013-03-13 Aleksandr Y. Aravkin , James V. Burke , Gianluigi Pillonetto

Semidefinite programs (SDPs) are a fundamental class of optimization problems with important recent applications in approximation algorithms, quantum complexity, robust learning, algorithmic rounding, and adversarial deep learning. This…

Data Structures and Algorithms · Computer Science 2020-09-23 Haotian Jiang , Tarun Kathuria , Yin Tat Lee , Swati Padmanabhan , Zhao Song

In this work, we conduct the first systematic study of stochastic variational inequality (SVI) and stochastic saddle point (SSP) problems under the constraint of differential privacy (DP). We propose two algorithms: Noisy Stochastic…

Optimization and Control · Mathematics 2022-04-04 Digvijay Boob , Cristóbal Guzmán

In this paper we study a constraint-based representation of neural network architectures. We cast the learning problem in the Lagrangian framework and we investigate a simple optimization procedure that is well suited to fulfil the…

Machine Learning · Computer Science 2020-04-20 Giuseppe Marra , Matteo Tiezzi , Stefano Melacci , Alessandro Betti , Marco Maggini , Marco Gori

This paper proposes a general incremental policy iteration adaptive dynamic programming (ADP) algorithm for model-free robust optimal control of unknown nonlinear systems. The approach integrates recursive least squares estimation with…

Optimization and Control · Mathematics 2025-09-01 Qingkai Meng , Fenglan Wang , Lin Zhao

This paper introduces new techniques for using convex optimization to fit input-output data to a class of stable nonlinear dynamical models. We present an algorithm that guarantees consistent estimates of models in this class when a small…

Optimization and Control · Mathematics 2013-03-19 Mark M. Tobenkin , Ian R. Manchester , Alexandre Megretski

Recent focus on robustness to adversarial attacks for deep neural networks produced a large variety of algorithms for training robust models. Most of the effective algorithms involve solving the min-max optimization problem for training…

Machine Learning · Computer Science 2021-03-03 Yasaman Esfandiari , Aditya Balu , Keivan Ebrahimi , Umesh Vaidya , Nicola Elia , Soumik Sarkar

Primal-dual interior-point methods solve constrained convex optimization problems to tight tolerances with speed and robustness. Their solutions are also efficiently differentiable with respect to the problem data through the implicit…

Optimization and Control · Mathematics 2026-05-19 Jon Arrizabalaga , Kevin Tracy , Zachary Manchester

The sparse nonlinear programming (SNP) problem has wide applications in signal and image processing, machine learning, pattern recognition, finance and management, etc. However, the computational challenge posed by SNP has not yet been well…

Optimization and Control · Mathematics 2021-05-26 Chen Zhao , Naihua Xiu , Hou-Duo Qi , Ziyan Luo

In this paper, we propose a successive pseudo-convex approximation algorithm to efficiently compute stationary points for a large class of possibly nonconvex optimization problems. The stationary points are obtained by solving a sequence of…

Optimization and Control · Mathematics 2018-12-17 Yang Yang , Marius Pesavento

Designing a stabilizing controller for nonlinear systems is a challenging task, especially for high-dimensional problems with unknown dynamics. Traditional reinforcement learning algorithms applied to stabilization tasks tend to drive the…

Systems and Control · Electrical Eng. & Systems 2024-09-16 Thanin Quartz , Ruikun Zhou , Hans De Sterck , Jun Liu