English
Related papers

Related papers: Doubly Stochastic Primal-Dual Coordinate Method fo…

200 papers

Multi-block separable convex problems recently received considerable attention. This class of optimization problems minimizes a separable convex objective function with linear constraints. The algorithmic challenges come from the fact that…

Optimization and Control · Mathematics 2016-08-18 Qia Li , Yuesheng Xu , Na Zhang

We study the online estimation of the optimal policy of a Markov decision process (MDP). We propose a class of Stochastic Primal-Dual (SPD) methods which exploit the inherent minimax duality of Bellman equations. The SPD methods update a…

Machine Learning · Statistics 2016-12-09 Yichen Chen , Mengdi Wang

In this paper, we consider the optimal coordination of automated vehicles at intersections under fixed crossing orders. We formulate the problem using direct optimal control and exploit the structure to construct a semi-distributed…

Systems and Control · Electrical Eng. & Systems 2021-11-22 Robert Hult , Mario Zanon , Sebastien Gros , Paolo Falcone

We present a new deep primal-dual backward stochastic differential equation framework based on stopping time iteration to solve optimal stopping problems. A novel loss function is proposed to learn the conditional expectation, which…

Computational Finance · Quantitative Finance 2024-09-12 Jiefei Yang , Guanglian Li

We study a class of convex-concave min-max problems in which the coupled component of the objective is linear in at least one of the two decision vectors. We identify such problem structure as interpolating between the bilinearly and…

Optimization and Control · Mathematics 2025-07-10 Ronak Mehta , Jelena Diakonikolas , Zaid Harchaoui

In this paper we consider a class of optimization problems with a strongly convex objective function and the feasible set given by an intersection of a simple convex set with a set given by a number of linear equality and inequality…

Optimization and Control · Mathematics 2016-05-11 Alexey Chernov , Pavel Dvurechensky , Alexander Gasnikov

This paper studies the distributed optimization problem when the objective functions might be nondifferentiable and subject to heterogeneous set constraints. Unlike existing subgradient methods, we focus on the case when the exact…

Optimization and Control · Mathematics 2021-11-23 Kui Zhu , Yutao Tang

We consider the convex-concave saddle point problem $\min_{\mathbf{x}}\max_{\mathbf{y}}\Phi(\mathbf{x},\mathbf{y})$, where the decision variables $\mathbf{x}$ and/or $\mathbf{y}$ subject to a multi-block structure and affine coupling…

Optimization and Control · Mathematics 2023-03-17 Junyu Zhang , Mengdi Wang , Mingyi Hong , Shuzhong Zhang

We study the problem of differentially-private (DP) stochastic (convex-concave) saddle-points in the $\ell_1$ setting. We propose $(\varepsilon, \delta)$-DP algorithms based on stochastic mirror descent that attain nearly…

Optimization and Control · Mathematics 2025-11-17 Tomás González , Cristóbal Guzmán , Courtney Paquette

We propose stochastic variance reduced algorithms for solving convex-concave saddle point problems, monotone variational inequalities, and monotone inclusions. Our framework applies to extragradient, forward-backward-forward, and…

Optimization and Control · Mathematics 2022-06-14 Ahmet Alacaoglu , Yura Malitsky

The aim of this manuscript is to approach by means of first order differential equations/inclusions convex programming problems with two-block separable linear constraints and objectives, whereby (at least) one of the components of the…

Optimization and Control · Mathematics 2020-05-21 Sandy Bitterlich , Ernö Robert Csetnek , Gert Wanka

We present a new class of decentralized first-order methods for nonsmooth and stochastic optimization problems defined over multiagent networks. Considering that communication is a major bottleneck in decentralized optimization, our main…

Optimization and Control · Mathematics 2017-02-07 Guanghui Lan , Soomin Lee , Yi Zhou

In the paper, we introduce several accelerate iterative algorithms for solving the multiple-set split common fixed-point problem of quasi-nonexpansive operators in real Hilbert space. Based on primal-dual method, we construct several…

Optimization and Control · Mathematics 2023-06-08 Chenzheng Guo , Jing Zhao

This paper is devoted to the study of an inertial accelerated primal-dual algorithm, which is based on a second-order differential system with time scaling, for solving a non-smooth convex optimization problem with linear equality…

Optimization and Control · Mathematics 2026-04-30 Huan Zhang , Xiangkai Sun , Shengjie Li , Kok Lay Teo

In this paper, we introduce an inertial proximal method for solving a bilevel problem involving two monotone equilibrium bifunctions in Hilbert spaces. Under suitable conditions and without any restrictive assumption on the trajectories,…

Optimization and Control · Mathematics 2022-10-20 AÏcha Balhag , Zakaria Mazgouri , Michel Théra

Binary optimization is a powerful tool for modeling combinatorial problems, yet scalable and theoretically sound solution methods remain elusive. Conventional solvers often rely on heuristic strategies with weak guarantees or struggle with…

Optimization and Control · Mathematics 2026-05-12 Wenbo Liu , Akang Wang , Dun Ma , Hongyi Jiang , Jianghua Wu , Wenguo Yang

In this paper, we develop a new accelerated stochastic gradient method for efficiently solving the convex regularized empirical risk minimization problem in mini-batch settings. The use of mini-batches is becoming a golden standard in the…

Optimization and Control · Mathematics 2017-09-20 Tomoya Murata , Taiji Suzuki

In this work, we consider solving optimization problems with a stochastic objective and deterministic equality constraints. We propose a Trust-Region Sequential Quadratic Programming method to find both first- and second-order stationary…

Optimization and Control · Mathematics 2024-09-27 Yuchen Fang , Sen Na , Michael W. Mahoney , Mladen Kolar

We analyse the asymptotic properties of a continuous-time, two-timescale stochastic approximation algorithm designed for stochastic bilevel optimisation problems in continuous-time models. We obtain the weak convergence rate of this…

Optimization and Control · Mathematics 2022-07-08 Louis Sharrock

We propose and analyze several inexact regularized Newton-type methods for finding a global saddle point of convex-concave unconstrained min-max optimization problems. Compared to first-order methods, our understanding of second-order…

Optimization and Control · Mathematics 2026-05-27 Tianyi Lin , Panayotis Mertikopoulos , Michael I. Jordan