English
Related papers

Related papers: Bounded Approximate Symbolic Dynamic Programming f…

200 papers

Decentralized optimization methods have been in the focus of optimization community due to their scalability, increasing popularity of parallel algorithms and many applications. In this work, we study saddle point problems of sum type,…

Optimization and Control · Mathematics 2021-10-26 Aleksandr Beznosikov , Alexander Rogozin , Dmitry Kovalev , Alexander Gasnikov

The framework of Integral Quadratic Constraints (IQC) reduces the computation of upper bounds on the convergence rate of several optimization algorithms to a semi-definite program (SDP). In the case of over-relaxed Alternating Direction…

Machine Learning · Statistics 2018-03-06 Guilherme França , José Bento

This work studies the linear approximation of high-dimensional dynamical systems using low-rank dynamic mode decomposition (DMD). Searching this approximation in a data-driven approach is formalised as attempting to solve a low-rank…

Machine Learning · Statistics 2021-08-23 Patrick Héas , Cédric Herzet

In this paper, we provide some analysis on the asymptotic escape of strict saddles in manifold optimization using the projected gradient descent (PGD) algorithm. One of our main contributions is that we extend the current analysis to…

Optimization and Control · Mathematics 2020-06-30 Thomas Y. Hou , Zhenzhen Li , Ziyun Zhang

Infinite-horizon optimal control of constrained piecewise affine (PWA) systems has been approximately addressed by hybrid model predictive control (MPC), which, however, has computational limitations, both in offline design and online…

Systems and Control · Electrical Eng. & Systems 2024-12-16 Kanghui He , Shengling Shi , Ton van den Boom , Bart De Schutter

We consider convex-concave saddle point problems, and more generally convex optimization problems we refer to as $\textit{saddle problems}$, which include the partial supremum or infimum of convex-concave saddle functions. Saddle problems…

Optimization and Control · Mathematics 2024-01-11 Philipp Schiele , Eric Luxenberg , Stephen Boyd

This paper is concerned with two-block separable convex minimization problems with linear constraints, for which it is either impossible or too expensive to obtain the exact solutions of the subproblems involved in the proximal ADMM…

Optimization and Control · Mathematics 2015-07-30 Li Shen , Shaohua Pan

The "exact subgraph" approach was recently introduced as a hierarchical scheme to get increasingly tight semidefinite programming relaxations of several NP-hard graph optimization problems. Solving these relaxations is a computational…

Optimization and Control · Mathematics 2020-06-09 Elisabeth Gaar , Franz Rendl

We present a novel, practical, and provable approach for solving diagonally constrained semi-definite programming (SDP) problems at scale using accelerated non-convex programming. Our algorithm non-trivially combines acceleration motions…

Optimization and Control · Mathematics 2023-02-07 Junhyung Lyle Kim , JA Lara Benitez , Mohammad Taha Toghani , Cameron Wolfe , Zhiwei Zhang , Anastasios Kyrillidis

We study a class of misspecified saddle point (SP) problems, where the optimization objective depends on an unknown parameter that must be learned concurrently from data. Unlike existing studies that assume parameters are fully known or…

Machine Learning · Computer Science 2025-10-08 Mohammad Mahdi Ahmadi , Erfan Yazdandoost Hamedani

The saddle-point problems (SPPs) with nonlinear coupling operators frequently arise in various control systems, such as dynamic programming optimization, H-infinity control, and Lyapunov stability analysis. However, traditional primal-dual…

Optimization and Control · Mathematics 2025-03-21 Sai Wang , Yi Gong

We propose an inexact Uzawa algorithm with two variable relaxation parameters for solving the generalized saddle-point system. The saddle-point problems can be found in a wide class of applications, such as the augmented Lagrangian…

Numerical Analysis · Mathematics 2014-08-26 Kazufumi Ito , Hua Xiang , Jun Zou

We extend a primal-dual fixed point algorithm (PDFP) proposed in [5] to solve two kinds of separable multi-block minimization problems, arising in signal processing and imaging science. This work shows the flexibility of applying PDFP…

Optimization and Control · Mathematics 2016-02-02 Peijun Chen , Jianguo Huang , Xiaoqun Zhang

We consider strongly-convex-strongly-concave saddle point problems assuming we have access to unbiased stochastic estimates of the gradients. We propose a stochastic accelerated primal-dual (SAPD) algorithm and show that SAPD sequence,…

Optimization and Control · Mathematics 2024-09-04 Xuan Zhang , Necdet Serhat Aybat , Mert Gürbüzbalaban

In this paper, we propose a new primal-dual algorithmic framework for a class of convex-concave saddle point problems frequently arising from image processing and machine learning. Our algorithmic framework updates the primal variable…

Optimization and Control · Mathematics 2025-06-03 Hongjin He , Kai Wang , Jintao Yu

We present a simple way to discretize and precondition mixed variational formulations. Our theory connects with, and takes advantage of, the classical theory of symmetric saddle point problems and the theory of preconditioning symmetric…

Numerical Analysis · Mathematics 2018-05-18 Constantin Bacuta , Jacob Jacavage

This paper presents a rigorous numerical framework for computing multiple solutions of semilinear elliptic problems by spatiotemporal high-index saddle dynamics (HiSD), which extends the traditional HiSD to the continuous-in-space setting,…

Numerical Analysis · Mathematics 2026-01-14 Lei Zhang , Xiangcheng Zheng , Shangqin Zhu

In this paper, we will develop a systematic approach to deriving guaranteed bounds for approximate dynamic programming (ADP) schemes in optimal control problems. Our approach is inspired by our recent results on bounding the performance of…

Optimization and Control · Mathematics 2014-03-31 Yajing Liu , Edwin K. P. Chong , Ali Pezeshki , Bill Moran

We propose a manifold optimization approach to solve linear semidefinite programs (SDP) with low-rank solutions, with an emphasis on SDP relaxations for polynomial optimization problems. This approach incorporates the inexact augmented…

Optimization and Control · Mathematics 2025-04-30 Jie Wang , Liangbing Hu

We propose a doubly stochastic primal-dual coordinate optimization algorithm for empirical risk minimization, which can be formulated as a bilinear saddle-point problem. In each iteration, our method randomly samples a block of coordinates…

Machine Learning · Computer Science 2017-04-13 Adams Wei Yu , Qihang Lin , Tianbao Yang