English
Related papers

Related papers: On the dynamic programming principle for controlle…

200 papers

This paper investigates the relationship between Pontryagin's maximum principle and dynamic programming principle in the context of stochastic optimal control systems governed by stochastic evolution equations with random coefficients in…

Optimization and Control · Mathematics 2025-11-05 Dingqian Gao , Qi Lü

Of stochastic differential equations, diffusion processes have been adopted in numerous applications, as more relevant and flexible models. This paper studies diffusion processes in a different setting, where for a given stationary…

Probability · Mathematics 2024-12-31 Saber Jafarizadeh

This paper aims to study the relationship between the maximum principle and the dynamic programming principle for recursive optimal control problem of stochastic evolution equations, where the control domain is not necessarily convex and…

Optimization and Control · Mathematics 2025-12-19 Ying Hu , Guomin Liu , Shanjian Tang

In this paper, we consider the stochastic optimal control problem for the interacting particle system. We obtain the stochastic maximum principle of the optimal control system by introducing a generalized backward stochastic differential…

Probability · Mathematics 2025-05-14 Andrey A. Dorogovtsev , Yuecai Han , Kateryna Hlyniana , Yuhang Li

We consider a collection of weakly interacting diffusion processes moving in a two-scale locally periodic environment. We study the large deviations principle of the empirical distribution of the particles' positions in the combined limit…

Probability · Mathematics 2022-11-03 Zachary Bezemek , Konstantinos Spiliopoulos

In this paper, we consider stochastic optimal control of systems driven by stochastic differential equations with irregular drift coefficient. We establish a necessary and sufficient stochastic maximum principle. To achieve this, we first…

Optimization and Control · Mathematics 2021-01-18 Olivier Menoukeu-Pamen , Ludovic Tangpi

The aim of this paper is to address optimality of stochastic control strategies via dynamic programming subject to total variation distance ambiguity on the conditional distribution of the controlled process. We formulate the stochastic…

Optimization and Control · Mathematics 2014-02-06 Ioannis Tzortzis , Charalambos D. Charalambous , Themistoklis Charalambous

We consider an optimal stopping problem where a constraint is placed on the distribution of the stopping time. Reformulating the problem in terms of so-called measure-valued martingales allows us to transform the marginal constraint into an…

Optimization and Control · Mathematics 2017-03-27 Sigrid Källblad

In this paper, we introduce a mathematical apparatus that is relevant for understanding a dynamical system with small random perturbations and coupled with the so-called transmutation process -- where the latter jumps from one mode to…

Dynamical Systems · Mathematics 2017-09-15 Getachew K. Befekadu

The article is devoted to the problem of applying the maximum principle for finding optimal control parameters in simulation tasks of interest for a variety of engineering and industrial systems and processes. Especially important is the…

Optimization and Control · Mathematics 2018-03-28 Ivan V. Kazachkov

In this note, we propose two different approaches to rigorously justify a pseudo-Markov property for controlled diffusion processes which is often (explicitly or implicitly) used to prove the dynamic programming principle in the stochastic…

Probability · Mathematics 2015-01-19 Julien Claisse , Denis Talay , Xiaolu Tan

This paper considers the problem of designing time-dependent, real-time control policies for controllable nonlinear diffusion processes, with the goal of obtaining maximally-informative observations about parameters of interest. More…

Methodology · Statistics 2014-10-16 Giles Hooker , Kevin K. Lin , Bruce Rogers

This paper investigates the optimal control problem for a class of parabolic equations where the diffusion coefficient is influenced by a control function acting nonlocally. Specifically, we consider the optimization of a cost functional…

Optimization and Control · Mathematics 2025-03-11 Stefana-Lucia Anita , Luca Di Persio

We consider covariance control problems for nonlinear stochastic systems. Our objective is to find an optimal control strategy to steer the state from an initial distribution to a terminal one with specified mean and covariance. This…

Systems and Control · Electrical Eng. & Systems 2019-11-22 Zeji Yi , Zhefeng Cao , Evangelos Theodorou , Yongxin Chen

We establish a Pontryagin maximum principle for discrete time optimal control problems under the following three types of constraints: a) constraints on the states pointwise in time, b) constraints on the control actions pointwise in time,…

Optimization and Control · Mathematics 2019-05-27 Pradyumna Paruchuri , Debasish Chatterjee

A stochastic procedure is developed which allows one to express Pontryagin's maximum principle for dissipative quantum system solely in terms of stochastic wave functions. Time-optimal controls can be efficiently computed without computing…

Quantum Physics · Physics 2020-11-09 Chungwei Lin , Dries Sels , Yanting Ma , Yebin Wang

In this paper, we obtain the maximum principle for optimal controls of stochastic systems with jumps by introducing a new method of variation. The control is allowed to enter both diffusion and jump term and the control domain need not to…

Optimization and Control · Mathematics 2019-10-10 Yuanzhuo Song , Shanjian Tang , Zhen Wu

We study the optimal stopping problem of McKean-Vlasov diffusions when the criterion is a function of the law of the stopped process. A remarkable new feature in this setting is that the stopping time also impacts the dynamics of the…

Probability · Mathematics 2023-01-18 Mehdi Talbi , Nizar Touzi , Jianfeng Zhang

This paper considers an optimal impulse control problem of dynamical systems generated by a flow. The performance criteria are total costs over the infinite time horizon. Apart from the main performance to be minimized, there are multiple…

Optimization and Control · Mathematics 2020-10-27 Alexey Piunovskiy , Yi Zhang

We develop a discrete-time optimal control framework for systems evolving on Lie groups. Our work generalizes the original Differential Dynamic Programming method, by employing a coordinate-free, Lie-theoretic approach for its derivation. A…

Optimization and Control · Mathematics 2018-09-24 George I. Boutselis , Evangelos Theodorou