English
Related papers

Related papers: Dynamic programming principle for stochastic optim…

200 papers

Optimality conditions in the form of a variational inequality are proved for a class of constrained optimal control problems of stochastic differential equations. The cost function and the inequality constraints are functions of the…

Optimization and Control · Mathematics 2018-02-13 Laurent Pfeiffer

The classical Dynamic Programming (DP) approach to optimal control problems is based on the characterization of the value function as the unique viscosity solution of a Hamilton-Jacobi-Bellman (HJB) equation. The DP scheme for the numerical…

Numerical Analysis · Mathematics 2019-04-15 Alessandro Alla , Maurizio Falcone , Luca Saluzzi

We prove the dynamic programming principle for a class of diffusion processes controlled up to the time of exit from a cylindrical region $[0,T)\times G$. It is assumed that the functional to be maximized is in the Lagrange form with…

Optimization and Control · Mathematics 2012-12-11 Dmitry B. Rokhlin

We consider a general formulation of the Principal-Agent problem with a lump-sum payment on a finite horizon, providing a systematic method for solving such problems. Our approach is the following: we first find the contract that is optimal…

Optimization and Control · Mathematics 2017-01-10 Jakša Cvitanić , Dylan Possamaï , Nizar Touzi

We prove the dynamic programming principe for uniformly nondegenerate stochastic differential games in the framework of time-homogeneous diffusion processes considered up to the first exit time from a domain. The zeroth-order "coefficient"…

Optimization and Control · Mathematics 2012-07-17 N. V. Krylov

We deal with the convergence of the value function of an approximate control problem with uncertain dynamics to the value function of a nonlinear optimal control problem. The assumptions on the dynamics and the costs are rather general and…

Optimization and Control · Mathematics 2021-05-31 Andrea Pesare , Michele Palladino , Maurizio Falcone

In this paper we study an optimization problem in which the control is information, more precisely, the control is a $\sigma$-algebra or a filtration. In a dynamic setting, we establish the dynamic programming principle and the law…

Optimization and Control · Mathematics 2026-03-31 Zihao Gu , Jianfeng Zhang

This paper is devoted to studying an infinite time horizon stochastic recursive control problem with jumps, where infinite time horizon stochastic differential equation and backward stochastic differential equation with jumps describe the…

Optimization and Control · Mathematics 2024-08-15 Sheng Luo , Xun Li , Qingmeng Wei

We consider the optimal dividend problem in the so-called degenerate bivariate risk model under the assumption that the surplus of one branch may become negative. More specific, we solve the stochastic control problem of maximizing…

Probability · Mathematics 2022-08-02 Philipp Lukas Strietzel , Henriette Elisabeth Heinrich

We analyze a zero-sum stochastic differential game between two competing players who can choose unbounded controls. The payoffs of the game are defined through backward stochastic differential equations. We prove that each player's priority…

Probability · Mathematics 2013-03-14 Erhan Bayraktar , Song Yao

In this paper we study the optimal stochastic control problem for a path-dependent stochastic system under a recursive path-dependent cost functional, whose associated Bellman equation from dynamic programming principle is a path-dependent…

Optimization and Control · Mathematics 2013-03-06 Shanjian Tang , Fu Zhang

To tackle the difficulties faced by both stochastic dynamic programming and scenario tree methods, we present some variational approach for numerical solution of stochastic optimal control problems. We consider two different interpretations…

Optimization and Control · Mathematics 2009-07-28 Pierre Carpentier , Guy Cohen , Anes Dallagi

This paper studies the stochastic optimal control of jump-diffusion processes and the associated fully nonlinear backward stochastic Hamilton--Jacobi--Bellman (BSHJB) equations. We establish the dynamic programming principle (DPP) via…

Optimization and Control · Mathematics 2026-05-21 Dunxiang Liang , Qingxin Meng

Given a Brownian motion $W$ and a stationary Poisson point process $p$ with values in ${\mathbb R}^d$, we prove a Dynamic Programming Principle (DPP) in a strong formulation for a stochastic control problem involving controlled SDEs of the…

Probability · Mathematics 2024-09-12 Alessandro Bondi , Enrico Priola

In this paper, we study the relationship between maximum principle (MP) and dynamic programming principle (DPP) for stochastic recursive optimal control problem driven by $G$-Brownian motion. Under the smooth assumption for the value…

Optimization and Control · Mathematics 2022-10-12 Xiaojuan Li

In this paper, we propose a class of discrete-time approximation schemes for stochastic optimal control problems under the $G$-expectation framework. The proposed schemes are constructed recursively based on piecewise constant policy. We…

Optimization and Control · Mathematics 2021-10-05 Lianzi Jiang

We consider the problem of optimally controlling stochastic, Markovian systems subject to joint chance constraints over a finite-time horizon. For such problems, standard Dynamic Programming is inapplicable due to the time correlation of…

Optimization and Control · Mathematics 2024-11-22 Niklas Schmid , Marta Fochesato , Sarah H. Q. Li , Tobias Sutter , John Lygeros

In this paper we propose a dynamic model of Limit Order Book (LOB). The main feature of our model is that the shape of the LOB is determined endogenously by an expected utility function via a competitive equilibrium argument. Assuming zero…

Optimization and Control · Mathematics 2014-01-23 Jin Ma , Xinyang Wang , Jianfeng Zhang

In this work, we consider the local Cahn-Hilliard-Navier-Stokes equation with regular potential in two dimensional bounded domain. We formulate distributed optimal control problem as the minimization of a suitable cost functional subject to…

Analysis of PDEs · Mathematics 2024-03-08 Sheetal Dharmatti , Perisetti Lakshmi Naga Mahendranath

We study the stochastic control problem of maximizing expected utility from terminal wealth under a non-bankruptcy constraint. The wealth process is subject to shocks produced by a general marked point process. The problem of the agent is…

Optimization and Control · Mathematics 2010-08-31 Mohamed Mnif