English
Related papers

Related papers: Hamilton-Jacobi-Bellman Equation for Control Syste…

200 papers

In this paper we investigate a kind of optimal control problem of coupled forward-backward stochastic system with jumps whose cost functional is defined through a coupled forward-backward stochastic differential equation with Brownian…

Probability · Mathematics 2020-09-15 Qian Lin

This paper studies an optimal stochastic impulse control problem in a finite horizon with a decision lag, by which we mean that after an impulse is made, a fixed number units of time has to be elapsed before the next impulse is allowed to…

Optimization and Control · Mathematics 2021-02-09 Chang Li , Jiongmin Yong

An abstract framework guaranteeing the continuous differentiability of local value functions on $H^1(\Omega)$ associated with optimal stabilization problems subject to abstract semilinear parabolic equations in the presence of norm…

Optimization and Control · Mathematics 2023-11-28 Karl Kunisch , Buddhika Priyasad

This paper deals with junction conditions for Hamilton-Jacobi-Bellman (HJB) equations for finite horizon control problems on multi-domains. We consider two different cases where the final cost is continuous or lower semi-continuous. In the…

Optimization and Control · Mathematics 2017-07-21 Daria Ghilli , Zhiping Rao , Hasnaa Zidani

We study a finite horizon optimal control problem for the continuity equation under a weighted integral state constraint on the mass outside a fixed set. The model is cast in a Hilbert framework for densities. On a suitable invariant…

Optimization and Control · Mathematics 2026-04-03 Fabio Bagagiolo , Ivan Romanò

For continuous systems modeled by dynamical equations such as ODEs and SDEs, Bellman's Principle of Optimality takes the form of the Hamilton-Jacobi-Bellman (HJB) equation, which provides the theoretical target of reinforcement learning…

Machine Learning · Computer Science 2025-10-28 Haruki Settai , Naoya Takeishi , Takehisa Yairi

We study the partial differential equation max{Lu - f, H(Du)}=0 where u is the unknown function, L is a second-order elliptic operator, f is a given smooth function and H is a convex function. This is a model equation for…

Analysis of PDEs · Mathematics 2015-03-18 Ryan Hynd

This paper is devoted to a viscosity solution theory of the stochastic Hamilton-Jacobi-Bellman equation in the Wasserstein spaces for the mean-field type control problem which allows for random coefficients and may thus be non-Markovian.…

Optimization and Control · Mathematics 2023-10-24 Hang Cheung , Jinniao Qiu , Alexandru Badescu

Optimal control and the associated second-order path-dependent Hamilton-Jacobi-Bellman (PHJB) equation are studied for unbounded functional stochastic evolution systems in Hilbert spaces. The notion of viscosity solution without…

Optimization and Control · Mathematics 2024-02-27 Shanjian Tang , Jianjun Zhou

This paper is devoted to the stochastic optimal control problem of infinite-dimensional differential systems allowing for both path-dependence and measurable randomness. As opposed to the deterministic path-dependent cases studied by…

Optimization and Control · Mathematics 2023-07-19 Jinniao Qiu , Yang Yang

We consider a stochastic optimal control problem where the controller can anticipate the evolution of the driving noise over some dynamically changing time window. The controlled state dynamics are understood as a rough differential…

Optimization and Control · Mathematics 2025-10-07 Peter Bank , Franziska Bielert

This paper is devoted to the study of fully nonlinear stochastic Hamilton-Jacobi (HJ) equations for the optimal stochastic control problem of ordinary differential equations with random coefficients. Under the standard Lipschitz continuity…

Optimization and Control · Mathematics 2019-03-28 Jinniao Qiu , Wenning Wei

We present a new formulation for the computation of solutions of a class of Hamilton Jacobi Bellman (HJB) equations on closed smooth surfaces of co-dimension one. For the class of equations considered in this paper, the viscosity solution…

Numerical Analysis · Mathematics 2020-08-06 Lindsay Martin , Richard Tsai

Stochastic optimal control problems for Hamiltonian dynamics on graphs have wide-ranging applications in mechanics and quantum field theory, particularly in systems with graph-based structures. In this paper, we establish the existence and…

Optimization and Control · Mathematics 2025-10-01 Jianbo Cui , Tonghe Dang

In this work, we consider the local Cahn-Hilliard-Navier-Stokes equation with regular potential in two dimensional bounded domain. We formulate distributed optimal control problem as the minimization of a suitable cost functional subject to…

Analysis of PDEs · Mathematics 2024-03-08 Sheetal Dharmatti , Perisetti Lakshmi Naga Mahendranath

In this paper, we propose Q-learning algorithms for continuous-time deterministic optimal control problems with Lipschitz continuous controls. Our method is based on a new class of Hamilton-Jacobi-Bellman (HJB) equations derived from…

Machine Learning · Computer Science 2020-10-28 Jeongho Kim , Jaeuk Shin , Insoon Yang

We consider a class of closed loop stochastic optimal control problems in finite time horizon, in which the cost is an expectation conditional on the event that the process has not exited a given bounded domain. An important difficulty is…

Optimization and Control · Mathematics 2019-12-19 Yves Achdou , Mathieu Laurière , Pierre-Louis Lions

We consider stochastic impulse control problems when the impulses cost functions are arbitrary. We use the dynamic programming principle and viscosity solutions approach to show that the value function is a unique viscosity solution for the…

Optimization and Control · Mathematics 2019-01-17 Brahim El Asri , Sehail Mazid

This article is a continuation of a previous work where we studied infinite horizon control problems for which the dynamic, running cost and control space may be different in two half-spaces of some euclidian space $\R^N$. In this article…

Analysis of PDEs · Mathematics 2014-01-27 Guy Barles , Ariela Briani , Emmanuel Chasseigne

We introduce a stochastic version of the optimal transport problem. We provide an analysis by means of the study of the associated Hamilton-Jacobi-Bellman equation, which is set on the set of probability measures. We introduce a new…

Analysis of PDEs · Mathematics 2024-05-22 Charles Bertucci