English
Related papers

Related papers: Addressing Discrete Dynamic Optimization via a Log…

200 papers

In this paper, we study zeroth-order algorithms for minimax optimization problems that are nonconvex in one variable and strongly-concave in the other variable. Such minimax optimization problems have attracted significant attention lately…

Machine Learning · Statistics 2022-04-06 Zhongruo Wang , Krishnakumar Balasubramanian , Shiqian Ma , Meisam Razaviyayn

In this paper we present a dynamic programing approach to stochastic optimal control problems with dynamic, time-consistent risk constraints. Constrained stochastic optimal control problems, which naturally arise when one has to consider…

Optimization and Control · Mathematics 2015-11-24 Yin-Lam Chow , Marco Pavone

We develop a tractable and flexible approach for incorporating side information into dynamic optimization under uncertainty. The proposed framework uses predictive machine learning methods (such as $k$-nearest neighbors, kernel regression,…

Optimization and Control · Mathematics 2020-07-23 Dimitris Bertsimas , Christopher McCord , Bradley Sturt

This paper presents an algorithmic study and complexity analysis for solving distributionally robust multistage convex optimization (DR-MCO). We generalize the usual consecutive dual dynamic programming (DDP) algorithm to DR-MCO and propose…

Optimization and Control · Mathematics 2024-01-05 Shixuan Zhang , Xu Andy Sun

This paper studies the stochastic optimal control problem for systems with unknown dynamics. A novel decoupled data based control (D2C) approach is proposed, which solves the problem in a decoupled "open loop-closed loop" fashion that is…

Systems and Control · Computer Science 2018-09-11 Dan Yu , Mohammandhussen Rafieisakhaei , Suman Chakravorty

Several widely-used first-order saddle-point optimization methods yield an identical continuous-time ordinary differential equation (ODE) that is identical to that of the Gradient Descent Ascent (GDA) method when derived naively. However,…

Optimization and Control · Mathematics 2023-08-01 Tatjana Chavdarova , Michael I. Jordan , Manolis Zampetakis

This paper focuses on the distributed optimization of stochastic saddle point problems. The first part of the paper is devoted to lower bounds for the centralized and decentralized distributed methods for smooth (strongly) convex-(strongly)…

Machine Learning · Computer Science 2025-04-28 Aleksandr Beznosikov , Valentin Samokhin , Alexander Gasnikov

Dynamic environments pose great challenges for expensive optimization problems, as the objective functions of these problems change over time and thus require remarkable computational resources to track the optimal solutions. Although…

Neural and Evolutionary Computing · Computer Science 2024-08-14 Huan Zhang , Jinliang Ding , Liang Feng , Kay Chen Tan , Ke Li

The Downhill Simplex Method (DSM) is a fast-converging derivative-free optimization technique for nonlinear systems. However, the optimization process is often subject to premature convergence due to degenerated simplices or noise-induced…

Optimization and Control · Mathematics 2025-09-09 Tianyu Wang , Xiaozhou He , Bernd R. Noack

The difference-of-convex algorithm (DCA) is a well-established nonlinear programming technique that solves successive convex optimization problems. These sub-problems are obtained from the difference-of-convex~(DC) decompositions of the…

Optimization and Control · Mathematics 2026-02-20 Hadi Abbaszadehpeivasti , Etienne de Klerk , Adrien Taylor

This paper proposes a data-driven framework to solve time-varying optimization problems associated with unknown linear dynamical systems. Making online control decisions to regulate a dynamical system to the solution of an optimization…

Optimization and Control · Mathematics 2021-09-08 Gianluca Bianchin , Miguel Vaquero , Jorge Cortes , Emiliano Dall'Anese

We introduce a variant of Multicut Decomposition Algorithms (MuDA), called CuSMuDA (Cut Selection for Multicut Decomposition Algorithms), for solving multistage stochastic linear programs that incorporates a class of cut selection…

Optimization and Control · Mathematics 2019-07-23 Vincent Guigues , Michelle Bandarra

Machine learning models can leak information about the data used to train them. To mitigate this issue, Differentially Private (DP) variants of optimization algorithms like Stochastic Gradient Descent (DP-SGD) have been designed to…

Machine Learning · Computer Science 2022-10-24 Paul Mangold , Aurélien Bellet , Joseph Salmon , Marc Tommasi

In this paper, we propose to solve a regularized distributionally robust learning problem in the decentralized setting, taking into account the data distribution shift. By adding a Kullback-Liebler regularization function to the robust…

Machine Learning · Computer Science 2022-09-13 Chaouki Ben Issaid , Anis Elgabli , Mehdi Bennis

Difference of Convex (DC) optimization problems have objective functions that are differences between two convex functions. Representative ways of solving these problems are the proximal DC algorithms, which require that the convex part of…

Optimization and Control · Mathematics 2022-09-27 Shota Takahashi , Mituhiro Fukuda , Mirai Tanaka

The Difference of Convex functions Algorithm (DCA) is widely used for minimizing the difference of two convex functions. A recently proposed accelerated version, termed BDCA for Boosted DC Algorithm, incorporates a line search step to…

Optimization and Control · Mathematics 2020-02-13 Francisco J. Aragón Artacho , Rubén Campoy , Phan T. Vuong

Gradient methods are among the simplest yet most widely used algorithms for unconstrained optimization. Motivated by a geometric property of the steepest descent (SD) method that can alleviate the zigzag behavior in quadratic problems, we…

Optimization and Control · Mathematics 2025-10-21 Ya Shen , Qing-Na Li , Yu-Hong Dai

Conventional learning methods simplify the bilinear model by regarding two intrinsically coupled factors independently, which degrades the optimization procedure. One reason lies in the insufficient training due to the asynchronous gradient…

Computer Vision and Pattern Recognition · Computer Science 2020-06-17 Li'an Zhuo , Baochang Zhang , Linlin Yang , Hanlin Chen , Qixiang Ye , David Doermann , Guodong Guo , Rongrong Ji

Motivated by a class of applied problems arising from physical layer based security in a digital communication system, in particular, by a secrecy sum-rate maximization problem, this paper studies a nonsmooth, difference-of-convex (dc)…

Optimization and Control · Mathematics 2015-11-06 Jong-Shi Pang , Meisam Razaviyayn , Alberth Alvarado

Robust optimization is a popular paradigm for modeling and solving two- and multi-stage decision-making problems affected by uncertainty. In many real-world applications, the time of information discovery is decision-dependent and the…

Optimization and Control · Mathematics 2022-08-24 Phebe Vayanos , Angelos Georghiou , Han Yu