English
Related papers

Related papers: A Convergence-Guaranteed Algorithm for Stochastic …

200 papers

Data-driven predictive control based on the fundamental lemma by Willems et al. is frequently considered for deterministic LTI systems subject to measurement noise. However, little has been done on data-driven stochastic control. In this…

Systems and Control · Electrical Eng. & Systems 2023-08-04 Guanru Pan , Ruchuan Ou , Timm Faulwasser

We provide a unifying approximate dynamic programming framework that applies to a broad variety of problems involving sequential estimation. We consider first the construction of surrogate cost functions for the purposes of optimization,…

Artificial Intelligence · Computer Science 2023-01-02 Dimitri Bertsekas

In this paper we study optimal advertising problems that models the introduction of a new product into the market in the presence of carryover effects of the advertisement and with memory effects in the level of goodwill. In particular, we…

Optimization and Control · Mathematics 2024-06-13 Giuseppina Guatteri , Federica Masiero

The considered optimal control problem of a stochastic power system, is to select the set of power supply vectors which infimizes the probability that the phase-angle differences of any power flow of the network, endangers the transient…

Optimization and Control · Mathematics 2024-01-31 Zhen Wang , Kaihua Xi , Aijie Cheng , Hai Xiang Lin , Jan H. van Schuppen

Our paper is devoted to the study of Peng's stochastic maximum principle (SMP) for a stochastic control problem composed of a controlled forward stochastic differential equation (SDE) as dynamics and a controlled backward SDE which defines…

Optimization and Control · Mathematics 2024-04-11 Rainer Buckdahn , Juan Li , Yanwei Li , Yi Wang

The continuous dynamical system approach to deep learning is explored in order to devise alternative frameworks for training algorithms. Training is recast as a control problem and this allows us to formulate necessary optimality conditions…

Machine Learning · Computer Science 2018-06-05 Qianxiao Li , Long Chen , Cheng Tai , Weinan E

The problem of synthesizing stochastic explicit model predictive control policies is known to be quickly intractable even for systems of modest complexity when using classical control-theoretic methods. To address this challenge, we present…

Machine Learning · Computer Science 2022-05-24 Ján Drgoňa , Sayak Mukherjee , Aaron Tuor , Mahantesh Halappanavar , Draguna Vrabie

We consider a stochastic control problem where the set of controls is not necessarily convex and the system is governed by a nonlinear backward stochastic differential equation. We establish necessary as well as sufficient conditions of…

Probability · Mathematics 2008-12-20 Seid Bahlali

In this paper we develop necessary conditions for optimality, in the form of the Pontryagin maximum principle, for the optimal control problem of a class of infinite dimensional evolution equations with delay in the state. In the cost…

Probability · Mathematics 2017-06-12 Giuseppina Guatteri , Federica Masiero , Carlo Orrieri

This paper is concerned with a stochastic recursive optimal control problem with time delay, where the controlled system is described by a stochastic differential delayed equation (SDDE) and the cost functional is formulated as the solution…

Optimization and Control · Mathematics 2014-08-26 Jingtao Shi , Huanshui Zhang

In this paper, we study the relationship between general maximum principle and dynamic programming principle for risk-sensitive stochastic optimal control problems, where the control domain is not necessarily convex. The original problem is…

Optimization and Control · Mathematics 2026-02-06 Huanqing Dong , Jingtao Shi

It is well-known that decision-making problems from stochastic control can be formulated by means of a forward-backward stochastic differential equation (FBSDE). Recently, the authors of Ji et al. 2022 proposed an efficient deep learning…

Optimization and Control · Mathematics 2024-08-01 Zhipeng Huang , Balint Negyesi , Cornelis W. Oosterlee

This paper focuses on optimal control problem for a class of discrete-time nonlinear systems. In practical applications, computation time is a crucial consideration when solving nonlinear optimal control problems, especially under real-time…

Optimization and Control · Mathematics 2025-04-01 Chuanzhi Lv , Xunmin Yin , Hongdan Li , Huanshui Zhang

We analyze a stochastic approximation algorithm for decision-dependent problems, wherein the data distribution used by the algorithm evolves along the iterate sequence. The primary examples of such problems appear in performative prediction…

Optimization and Control · Mathematics 2024-05-15 Joshua Cutler , Mateo Díaz , Dmitriy Drusvyatskiy

Robust control of complex engineered and biological systems hinges on the integration of feedforward and feedback mechanisms. This is exemplified in neural motor control, where feedforward muscle co-contraction complements sensory-driven…

Optimization and Control · Mathematics 2026-03-06 Bastien Berret , Frédéric Jean

We study a stochastic optimal control problem for fully coupled forward-backward stochastic control systems with a nonempty control domain. For our problem, the first-order and second-order variational equations are fully coupled linear…

Optimization and Control · Mathematics 2018-12-05 Mingshang Hu , Shaolin Ji , Xiaole Xue

A stochastic optimal control problem for incompressible Newtonian channel flow past a circular cylinder is used as a prototype optimal control problem for the stochastic Navier-Stokes equations. The inlet flow and the rotation speed of the…

Optimization and Control · Mathematics 2024-03-13 Liuhong Chen , Ju Ming , Max D. Gunzburger

Machine learning algorithms in high-dimensional settings are highly susceptible to the influence of even a small fraction of structured outliers, making robust optimization techniques essential. In particular, within the…

Machine Learning · Computer Science 2025-04-25 Changyu Gao , Andrew Lowy , Xingyu Zhou , Stephen J. Wright

We study a stochastic optimal control problem for forward-backward control systems with quadratic generators. In order to establish the first and second-order variational and adjoint equations, we obtain a new estimate for one-dimensional…

Optimization and Control · Mathematics 2021-07-06 Mingshang Hu , Shaolin Ji , Rundong Xu

We consider the utility maximization problem under convex constraints with regard to theoretical results which allow the formulation of algorithmic solvers which make use of deep learning techniques. In particular for the case of random…

Computational Finance · Quantitative Finance 2022-02-17 Kristof Wiedermann