English
Related papers

Related papers: Randomized dynamic programming principle and Feynm…

200 papers

We analyze an optimal stopping problem with a constraint on the expected cost. When the reward function and cost function are Lipschitz continuous in state variable, we show that the value of such an optimal stopping problem is a continuous…

Optimization and Control · Mathematics 2017-08-08 Erhan Bayraktar , Song Yao

We study zero-sum stochastic differential games where the state dynamics of the two players is governed by a generalized McKean-Vlasov (or mean-field) stochastic differential equation in which the distribution of both state and controls of…

Probability · Mathematics 2018-03-21 Huyen Pham , Andrea Cosso

We study an optimal control problem of McKean--Vlasov branching diffusion processes, in which the interaction term is determined by the marginal measure induced by all alive particles in the system. Accordingly, the value function is…

Optimization and Control · Mathematics 2025-12-02 Julien Claisse , Jiazhi Kang , Tianxu Lan , Xiaolu Tan

This paper investigates the relationship between Pontryagin's maximum principle and dynamic programming principle in the context of stochastic optimal control systems governed by stochastic evolution equations with random coefficients in…

Optimization and Control · Mathematics 2025-11-05 Dingqian Gao , Qi Lü

In this paper, we consider a class of stochastic control problems for stochastic differential equations with random coefficients. The control domain need not to be convex but the control process is not allowed to enter in diffusion term.…

Optimization and Control · Mathematics 2020-08-06 Ishak Alia , Mohamed Sofiane Alia

We propose a decomposition method for solving a general class of linear-quadratic (LQ) McKean-Vlasov control problems involving conditional expectations and random coefficients, where the system dynamics are driven by two independent Wiener…

Optimization and Control · Mathematics 2026-04-15 Onésime Hounkpe , Dena Firoozi , Shuang Gao

We consider a general type of non-Markovian impulse control problems under adverse non-linear expectation or, more specifically, the zero-sum game problem where the adversary player decides the probability measure. We show that the upper…

Optimization and Control · Mathematics 2022-06-30 Magnus Perninge

Pontryagin type maximum principle and Bellman's dynamic programming principle serve as two of the most important tools in solving optimal control problems. There is a huge literature on the study of relationship between them. The main…

Optimization and Control · Mathematics 2021-12-30 Liangying Chen , Qi Lü

This paper mainly investigates reflected stochastic recursive control problems governed by jump-diffusion dynamics. The system's state evolution is described by a stochastic differential equation driven by both Brownian motion and Poisson…

Optimization and Control · Mathematics 2025-05-15 Lu Liu , Qingmeng Wei

We are concerned with the linear-quadratic optimal stochastic control problem with random coefficients. Under suitable conditions, we prove that the value field $V(t,x,\omega), (t,x,\omega)\in [0,T]\times R^n\times \Omega$, is quadratic in…

Optimization and Control · Mathematics 2014-07-21 Shanjian Tang

This paper studies the dynamic programming principle using the measurable selection method for stochastic control of continuous processes. The novelty of this work is to incorporate intermediate expectation constraints on the canonical…

Optimization and Control · Mathematics 2020-04-22 Yuk-Loong Chow , Xiang Yu , Chao Zhou

The solution to a stochastic optimal control problem can be determined by computing the value function from a discretization of the associated Hamilton-Jacobi-Bellman equation. Alternatively, the problem can be reformulated in terms of a…

Optimization and Control · Mathematics 2024-02-29 Sebastian Reich

In this paper we present a novel sampling-based numerical scheme designed to solve a certain class of stochastic optimal control problems, utilizing forward and backward stochastic differential equations (FBSDEs). By means of a nonlinear…

Systems and Control · Computer Science 2020-06-18 Ioannis Exarchos , Evangelos A. Theodorou

Within the framework of viscosity solution, we study the relationship between the maximum principle (MP) in [9] and the dynamic programming principle (DPP) in [10] for a fully coupled forward-backward stochastic controlled system (FBSCS)…

Optimization and Control · Mathematics 2018-05-17 Mingshang Hu , Shaolin Ji , Xiaole Xue

We extend the proof of the dynamic programming principle (DPP) for standard stochastic optimal control problems driven by general L\'{e}vy noises. Under appropriate assumptions, it is shown that the DPP still holds when the state process…

Optimization and Control · Mathematics 2016-03-25 Ben Goldys , Wei Wu

The purpose of this paper is to provide a detailed probabilistic analysis of the optimal control of nonlinear stochastic dynamical systems of the McKean Vlasov type. Motivated by the recent interest in mean field games, we highlight the…

Probability · Mathematics 2013-03-26 René Carmona , Francois Delarue

We study a combined optimal control/stopping problem under a nonlinear expectation ${\cal E}^f$ induced by a BSDE with jumps, in a Markovian framework. The terminal reward function is only supposed to be Borelian. The value function $u$…

Optimization and Control · Mathematics 2016-06-28 Roxana Dumitrescu , Marie-Claire Quenez , Agnès Sulem

In this paper, we first establish the dynamic programming principle for stochastic optimal control problems defined on compact Riemannian manifolds without boundary. Subsequently, we derive the associated Hamilton-Jacobi-Bellman (HJB)…

Optimization and Control · Mathematics 2025-07-03 Dingqian Gao , Qi Lü

This paper deals with a stochastic recursive optimal control problem, where the diffusion coefficient depends on the control variable and the control domain is not necessarily convex. We focus on the connection between the general maximum…

Optimization and Control · Mathematics 2016-12-21 Tianyang Nie , Jingtao Shi , Zhen Wu

We study an optimal control problem of generalized mean-field dynamics with open-loop controls, where the coefficients depend not only on the state processes and controls, but also on the joint law of them. The value function $V$ defined in…

Optimization and Control · Mathematics 2024-08-16 Rainer Buckdahn , Juan Li , Zhanxin Li