English
Related papers

Related papers: Regularity properties for general HJB equations. A…

200 papers

This paper develops a comparison theorem for viscosity solutions of a new class of Hamilton-Jacobi-Bellman (HJB) equations, which is used to solve the separated problem governed by the K-S equation in the Wasserstein space. A distinctive…

Analysis of PDEs · Mathematics 2025-03-05 Hexiang Wan , Jie Xiong

In this paper, we propose and study the stochastic path-dependent Hamilton-Jacobi-Bellman (SPHJB) equation that arises naturally from the optimal stochastic control problem of stochastic differential equations with path-dependence and…

Probability · Mathematics 2020-06-24 Jinniao Qiu

In this paper, we show that the value functions of mean field control problems with common noise are the unique viscosity solutions to fully second-order Hamilton-Jacobi-Bellman equations, in a Crandall-Lions-like framework. We allow the…

Optimization and Control · Mathematics 2025-01-06 Erhan Bayraktar , Hang Cheung , Ibrahim Ekren , Jinniao Qiu , Ho Man Tai , Xin Zhang

This paper introduces a new type of second order stochastic backward Hamilton-Jacobi-Bellman (HJB) equations for optimal stochastic control problems with a currently observable but non-predicable parameter process, in addition to the…

Optimization and Control · Mathematics 2020-03-04 Nikolai Dokuchaev

We solve in mild sense Hamilton Jacobi Bellman equations, both in an infinite dimensional Hilbert space and in a Banach space, with lipschitz Hamiltonian and lipschitz continuous final condition, and asking only a weak regularizing property…

Probability · Mathematics 2014-11-27 Federica Masiero

In this article, a notion of viscosity solutions is introduced for second order path-dependent Hamilton-Jacobi-Bellman (PHJB) equations associated with optimal control problems for path-dependent stochastic evolution equations in Hilbert…

Probability · Mathematics 2020-09-14 Jianjun Zhou

We consider the Hamilton-Jacobi equation \[{H}(x,Du)+\lambda(x)u=c,\quad x\in M, \] where $M$ is a connected, closed and smooth Riemannian manifold. The functions ${H}(x,p)$ and $\lambda(x)$ are continuous. ${H}(x,p)$ is convex, coercive…

Analysis of PDEs · Mathematics 2023-04-27 Panrui Ni , Lin Wang

In this article, a notion of viscosity solutions is introduced for first order path-dependent Hamilton-Jacobi-Bellman (HJB) equations associated with optimal control problems for path-dependent differential equations. We identify the value…

Analysis of PDEs · Mathematics 2020-09-11 Jianjun Zhou

Solutions of the Hamilton-Jacobi equation $H(x,-Du(x))=1$, with $H(\cdot,p)$ H\"older continuous and $H(x,\cdot)$ convex and positively homogeneous of degree 1, are shown to be locally semiconcave with a power-like modulus. An essential…

Optimization and Control · Mathematics 2012-12-20 Piermarco Cannarsa , Pierre Cardaliaguet

We establish that a viscosity solution to a multidimensional Hamilton-Jacobi equation with Bohr almost periodic initial data remains to be spatially almost periodic and the additive subgroup generated by its spectrum does not increase in…

Analysis of PDEs · Mathematics 2017-07-04 Evgeny Yu. Panov

For continuous systems modeled by dynamical equations such as ODEs and SDEs, Bellman's Principle of Optimality takes the form of the Hamilton-Jacobi-Bellman (HJB) equation, which provides the theoretical target of reinforcement learning…

Machine Learning · Computer Science 2025-10-28 Haruki Settai , Naoya Takeishi , Takehisa Yairi

Maximum entropy reinforcement learning (RL) methods have been successfully applied to a range of challenging sequential decision-making and control tasks. However, most of existing techniques are designed for discrete-time systems. As a…

Optimization and Control · Mathematics 2020-09-29 Jeongho Kim , Insoon Yang

This work investigates the optimal control problem for reflected McKean-Vlasov SDEs and the viscosity solutions to Hamilton-Jacobi-Bellman(HJB) equations on the Wasserstein space in terms of intrinsic derivative. It follows from the flow…

Probability · Mathematics 2023-09-18 Jinghai Shao

In this paper, we study a stochastic recursive optimal control problem in which the value functional is defined by the solution of a backward stochastic differential equation (BSDE) under $\tilde{G}$-expectation. Under standard assumptions,…

Optimization and Control · Mathematics 2021-06-08 Mingshang Hu , Shaolin Ji , Xiaojuan Li

We study the Hamilton-Jacobi equations $H(x,Du,u)=0$ in $M$ and $\partial u/\partial t +H(x,D_xu,u)=0$ in $M\times(0,\infty)$, where the Hamiltonian $H=H(x,p,u)$ depends Lipschitz continuously on the variable $u$. In the framework of the…

Analysis of PDEs · Mathematics 2021-08-26 Hitoshi Ishii , Kaizhi Wang , Lin Wang , Jun Yan

This paper is concerned with a stochastic recursive optimal control problem with time delay, where the controlled system is described by a stochastic differential delayed equation (SDDE) and the cost functional is formulated as the solution…

Optimization and Control · Mathematics 2014-08-26 Jingtao Shi , Huanshui Zhang

We provide Lipschitz regularity for solutions to viscous time-dependent Hamilton-Jacobi equations with right-hand side belonging to Lebesgue spaces. Our approach is based on a duality method, and relies on the analysis of the regularity of…

Analysis of PDEs · Mathematics 2020-01-28 Marco Cirant , Alessandro Goffi

In this paper, we study the regularity of the ergodic constants for the viscous Hamilton--Jacobi equations. We also estimate the convergent rate of the ergodic constant in the vanishing viscosity process.

Analysis of PDEs · Mathematics 2026-03-24 Son Tu , Jianlu Zhang

Regularity and singularity of the solutions according to the shape of domains is a challenging research theme in the Boltzmann theory (\cite{Kim11,GKTT1}). In this paper, we prove an H\"older regularity in $C^{0,\frac{1}{2}-}_{x,v}$ for the…

Analysis of PDEs · Mathematics 2022-10-20 Chanwoo Kim , Donghyun Lee

In this paper we provide a rate of convergence for periodic homogenization of Hamilton-Jacobi-Bellman equations with nonlocal diffusion. The result is based on the regularity of the associated effective problem, where the convexity plays a…

Analysis of PDEs · Mathematics 2020-12-08 Andrei Rodríguez-Paredes , Erwin Topp