English
Related papers

Related papers: Method of Successive Approximations for Stochastic…

200 papers

We derive first-order Pontryagin optimality conditions for stochastic optimal control with deterministic controls for systems modeled by rough differential equations (RDE) driven by Gaussian rough paths. This Pontryagin Maximum Principle…

Optimization and Control · Mathematics 2025-10-07 Thomas Lew

This paper presents a stochastic approximation proximal subgradient (SAPS) method for stochastic convex-concave minimax optimization. By accessing unbiased and variance bounded approximate subgradients, we show that this algorithm exhibits…

Optimization and Control · Mathematics 2024-04-01 Yu-Hong Dai , Jiani Wang , Liwei Zhang

This paper proposes a constrained stochastic successive convex approximation (CSSCA) algorithm to find a stationary point for a general non-convex stochastic optimization problem, whose objective and constraint functions are non-convex and…

Information Theory · Computer Science 2019-09-04 An Liu , Vincent Lau , Borna Kananian

In this paper, further extensions of the result of the paper "A successive approximation method in functional spaces for hierarchical optimal control problems and its application to learning, arXiv:2410.20617 [math.OC], 2024" concerning a…

Optimization and Control · Mathematics 2024-11-26 Getachew K. Befekadu

The paper addresses an optimal ensemble control problem for nonlocal continuity equations on the space of probability measures. We admit the general nonlinear cost functional, and an option to directly control the nonlocal terms of the…

Optimization and Control · Mathematics 2023-10-09 Roman Chertovskih , Nikolay Pogodaev , Maxim Staritsyn

In this paper, we focus on a method based on optimal control to address the optimization problem. The objective is to find the optimal solution that minimizes the objective function. We transform the optimization problem into optimal…

Optimization and Control · Mathematics 2023-09-12 Yeming Xu , Ziyuan Guo , Hongxia Wang , Huanshui Zhang

Stochastic gradient descent type methods are ubiquitous in machine learning, but they are only applicable to the optimization of differentiable functions. Proximal algorithms are more general and applicable to nonsmooth functions. We…

Optimization and Control · Mathematics 2025-05-20 Laurent Condat , Elnur Gasanov , Peter Richtárik

Robotic systems must be able to quickly and robustly make decisions when operating in uncertain and dynamic environments. While Reinforcement Learning (RL) can be used to compute optimal policies with little prior knowledge about the…

Robotics · Computer Science 2016-09-13 Yunpeng Pan , Xinyan Yan , Evangelos Theodorou , Byron Boots

In this paper we present a dynamic programing approach to stochastic optimal control problems with dynamic, time-consistent risk constraints. Constrained stochastic optimal control problems, which naturally arise when one has to consider…

Optimization and Control · Mathematics 2015-11-24 Yin-Lam Chow , Marco Pavone

We propose a nonlinear model predictive control (NMPC) framework based on a direct optimal control method that ensures continuous-time constraint satisfaction and accurate evaluation of the running cost, without compromising computational…

Optimization and Control · Mathematics 2024-05-02 Samet Uzun , Purnanand Elango , Abhinav G. Kamath , Taewan Kim , Behcet Acikmese

Model Predictive Control (MPC) has established itself as the primary methodology for constrained control, enabling autonomy across diverse applications. While model fidelity is crucial in MPC, solving the corresponding optimization problem…

Systems and Control · Electrical Eng. & Systems 2026-04-23 Lukas Schroth , Daniel Morton , Amon Lahr , Daniele Gammelli , Andrea Carron , Marco Pavone

Suboptimal model predictive control is a technique that can reduce the computational cost of model predictive control (MPC) by exploiting its robustness to incomplete optimization. Instead of solving the optimal control problem exactly,…

Systems and Control · Computer Science 2019-05-08 Dominic Liao-McPherson , Marco Nicotra , Ilya Kolmanovsky

Stochastic gradient descent with momentum (SGDM) is the dominant algorithm in many optimization scenarios, including convex optimization instances and non-convex neural network training. Yet, in the stochastic setting, momentum interferes…

Optimization and Control · Mathematics 2023-06-28 Junhyung Lyle Kim , Panos Toulis , Anastasios Kyrillidis

This paper considers the stochastic convex composite optimization problem and presents multi-cut stochastic approximation (SA) methods for solving it, whose models in expectation overestimate its objective function. The multi-cut model…

Optimization and Control · Mathematics 2026-03-03 Jiaming Liang , Renato D. C. Monteiro , Honghao Zhang

This paper presents a comprehensive analysis of a broad range of variations of the stochastic proximal point method (SPPM). Proximal point methods have attracted considerable interest owing to their numerical stability and robustness…

Optimization and Control · Mathematics 2024-05-28 Peter Richtárik , Abdurakhmon Sadiev , Yury Demidovich

We introduce a new method, stepwise method for solving optimal con- trol problems. Our first motivation for new approach emanate from limi- tations on continuous time control functions in PMP. Practically in most of the real world models,…

Optimization and Control · Mathematics 2015-06-26 Mehdi Afshar , Farshad Merrikhbayat , Mohammad Reza Razvan

This article considers the stochastic optimal control of discrete-time linear systems subject to (possibly) unbounded stochastic disturbances, hard constraints on the manipulated variables, and joint chance constraints on the states. A…

Optimization and Control · Mathematics 2017-06-23 Joel A. Paulson , Edward A. Buehler , Richard D. Braatz , Ali Mesbah

In this paper, we consider multi-stage stochastic optimization problems with convex objectives and conic constraints at each stage. We present a new stochastic first-order method, namely the dynamic stochastic approximation (DSA) algorithm,…

Optimization and Control · Mathematics 2019-08-22 Guanghui Lan , Zhiqiang Zhou

We propose a novel reformulation of the stochastic optimal control problem as an approximate inference problem, demonstrating, that such a interpretation leads to new practical methods for the original problem. In particular we characterise…

Machine Learning · Computer Science 2010-09-22 Konrad Rawlik , Marc Toussaint , Sethu Vijayakumar

This paper is concerned with the stochastic recursive optimal control problem with mixed delay. The connection between Pontryagin's maximum principle and Bellman's dynamic programming principle is discussed. Without containing any…

Optimization and Control · Mathematics 2019-12-24 Weijun Meng , Jingtao Shi