English
Related papers

Related papers: Dynamic programming principle for one kind of stoc…

200 papers

This paper is concerned with a stochastic recursive optimal control problem with time delay, where the controlled system is described by a stochastic differential delayed equation (SDDE) and the cost functional is formulated as the solution…

Optimization and Control · Mathematics 2014-08-26 Jingtao Shi , Huanshui Zhang

In this manuscript we consider a class optimal control problem for stochastic differential delay equations. First, we rewrite the problem in a suitable infinite-dimensional Hilbert space. Then, using the dynamic programming approach, we…

Optimization and Control · Mathematics 2023-02-20 Filippo de Feo , Salvatore Federico , Andrzej Święch

This paper mainly investigates reflected stochastic recursive control problems governed by jump-diffusion dynamics. The system's state evolution is described by a stochastic differential equation driven by both Brownian motion and Poisson…

Optimization and Control · Mathematics 2025-05-15 Lu Liu , Qingmeng Wei

We consider stochastic impulse control problems when the impulses cost functions are arbitrary. We use the dynamic programming principle and viscosity solutions approach to show that the value function is a unique viscosity solution for the…

Optimization and Control · Mathematics 2019-01-17 Brahim El Asri , Sehail Mazid

We study the properties of the value function associated with an optimal control problem with uncertainties, known as average or Riemann-Stieltjes problem. Uncertainties are assumed to belong to a compact metric probability space, and…

Optimization and Control · Mathematics 2024-07-19 M. Soledad Aronna , Michele Palladino , Oscar Sierra

In this manuscript we consider optimal control problems of stochastic differential equations with delays in the state and in the control. First, we prove an equivalent Markovian reformulation on Hilbert spaces of the state equation. Then,…

Optimization and Control · Mathematics 2024-05-20 Filippo de Feo

In this paper, we aim to develop the theory of optimal stochastic control for branching diffusion processes where both the movement and the reproduction of the particles depend on the control. More precisely, we study the problem of…

Probability · Mathematics 2016-09-19 Julien Claisse

In this paper, we investigate a sparse optimal control of continuous-time stochastic systems. We adopt the dynamic programming approach and analyze the optimal control via the value function. Due to the non-smoothness of the $L^0$ cost…

Optimization and Control · Mathematics 2021-09-17 Kaito Ito , Takuya Ikeda , Kenji Kashima

We formulate a path-dependent stochastic optimal control problem under general conditions, for which weprove rigorously the dynamic programming principle and that the value function is the unique Crandall-Lions viscosity solution of the…

Probability · Mathematics 2023-08-04 Andrea Cosso , Fausto Gozzi , Mauro Rosestolato , Francesco Russo

In this manuscript, we study optimal control problems for stochastic delay differential equations using the dynamic programming approach in Hilbert spaces via viscosity solutions of the associated Hamilton-Jacobi-Bellman equations. We show…

Optimization and Control · Mathematics 2024-12-24 Filippo de Feo , Andrzej Święch

We show that the value function of a stochastic control problem is the unique solution of the associated Hamilton-Jacobi-Bellman (HJB) equation, completely avoiding the proof of the so-called dynamic programming principle (DPP). Using…

Probability · Mathematics 2013-09-25 Erhan Bayraktar , Mihai Sirbu

We characterize the value of swing contracts in continuous time as the unique viscosity solution of a Hamilton-Jacobi-Bellman equation with suitable boundary conditions. The case of contracts with penalties is straightforward, and in that…

Optimization and Control · Mathematics 2013-07-05 M. Basei , A. Cesaroni , T. Vargiolu

We study the optimal control of general stochastic McKean-Vlasov equation. Such problem is motivated originally from the asymptotic formulation of cooperative equilibrium for a large population of particles (players) in mean-field…

Probability · Mathematics 2017-01-06 Huyên Pham , Xiaoli Wei

A large number of recent studies consider a compartmental SIR model to study optimal control policies aimed at containing the diffusion of COVID-19 while minimizing the economic costs of preventive measures. Such problems are non-convex and…

Optimization and Control · Mathematics 2022-12-21 Alessandro Calvia , Fausto Gozzi , Francesco Lippi , Giovanni Zanco

We provide a dynamic programming principle for stochastic optimal control problems with expectation constraints. A weak formulation, using test functions and a probabilistic relaxation of the constraint, avoids restrictions related to a…

Optimization and Control · Mathematics 2012-12-21 Bruno Bouchard , Marcel Nutz

We study optimal control problems governed by abstract infinite dimensional stochastic differential equations using the dynamic programming approach. In the first part, we prove Lipschitz continuity, semiconcavity and semiconvexity of the…

Optimization and Control · Mathematics 2025-02-27 Filippo de Feo , Andrzej Święch , Lukas Wessels

We consider the problem of stochastic optimal control, where the state-feedback control policies take the form of a probability distribution and where a penalty on the entropy is added. By viewing the cost function as a Kullback- Leibler…

Optimization and Control · Mathematics 2024-12-12 Marc Lambert , Francis Bach , Silvère Bonnabel

We consider a general class of stochastic optimal control problems, where the state process lives in a real separable Hilbert space and is driven by a cylindrical Brownian motion and a Poisson random measure; no special structure is imposed…

Probability · Mathematics 2018-10-04 Elena Bandini , Fulvia Confortola , Andrea Cosso

In this paper we study the optimal stochastic control problem for a path-dependent stochastic system under a recursive path-dependent cost functional, whose associated Bellman equation from dynamic programming principle is a path-dependent…

Optimization and Control · Mathematics 2013-03-06 Shanjian Tang , Fu Zhang

We develop dynamical programming methods for the purpose of optimal control of quantum states with convex constraints and concave cost and bequest functions of the quantum state. We consider both open loop and feedback control schemes,…

Quantum Physics · Physics 2009-03-06 Viacheslav P. Belavkin , Antonio Negretti , Klaus Molmer