English
Related papers

Related papers: Numerical Solution of the Dynamic Programming Equa…

200 papers

This paper presents an inverse optimality method to solve the Hamilton-Jacobi-Bellman equation for a class of nonlinear problems for which the cost is quadratic and the dynamics are affine in the input. The method is inverse optimal because…

Optimization and Control · Mathematics 2011-10-11 Luis Rodrigues , Didier Henrion , Mehdi Abedinpour Fallah

A general time-inconsistent optimal control problem is considered for stochastic differential equations with deterministic coefficients. Under suitable conditions, a Hamilton-Jacobi-Bellman type equation is derived for the equilibrium value…

Optimization and Control · Mathematics 2012-04-04 Jiongmin Yong

In this paper, we study a time-inconsistent stochastic optimal control problem with a recursive cost functional by a multi-person hierarchical differential game approach. An equilibrium strategy of this problem is constructed and a…

Optimization and Control · Mathematics 2016-06-13 Qingmeng Wei , Jiongmin Yong , Zhiyong Yu

Environmental management optimizing a long-run objective is an ergodic control problem whose resolution can be achieved by solving an associated non-local Hamilton-Jacobi-Bellman (HJB) equation having an effective Hamiltonian. Focusing on…

Optimization and Control · Mathematics 2022-05-11 Hidekazu Yoshioka , Motoh Tsujimura , Yuta Yaegashi

We study a stochastic optimal control problem with the state constrained to a smooth, compact domain. The control influences both the drift and a possibly degenerate, control-dependent dispersion matrix, leading to a fully nonlinear,…

Optimization and Control · Mathematics 2025-08-08 Anderson O. Calixto , Bernardo Freitas Paulo da Costa , Glauco Valle

A learning technique for finite horizon optimal control problems and its approximation based on polynomials is analyzed. It allows to circumvent, in part, the curse dimensionality which is involved when the feedback law is constructed by…

Optimization and Control · Mathematics 2023-02-21 Karl Kunisch , Donato Vásquez-Varas

We consider a singular control problem with regime switching that arises in problems of optimal investment decisions of cash-constrained firms. The value function is proved to be the unique viscosity solution of the associated…

Computational Finance · Quantitative Finance 2016-10-07 Erwan Pierre , Stéphane Villeneuve , Xavier Warin

The main goal of this paper is to establish existence, regularity and uniqueness results for the solution of a Hamilton-Jacobi-Bellman (HJB) equation, whose operator is an elliptic integro-differential operator. The HJB equation studied in…

Optimization and Control · Mathematics 2016-12-01 Harold A. Moreno-Franco

Stochastic optimal control problems governed by delay equations with delay in the control are usually more difficult to study than the the ones when the delay appears only in the state. This is particularly true when we look at the…

Probability · Mathematics 2015-06-22 Fausto Gozzi , Federica Masiero

In this paper, we propose a novel image restoration framework that integrates optimal control techniques with the Hamilton-Jacobi-Bellman (HJB) equation. Motivated by models from production planning, our method restores degraded images by…

Analysis of PDEs · Mathematics 2025-05-13 Dragos-Patru Covei

A procedure for the numerical approximation of high-dimensional Hamilton-Jacobi-Bellman (HJB) equations associated to optimal feedback control problems for semilinear parabolic equations is proposed. Its main ingredients are a…

Optimization and Control · Mathematics 2019-02-08 Dante Kalise , Karl Kunisch

Stochastic optimal control problems for Hamiltonian dynamics on graphs have wide-ranging applications in mechanics and quantum field theory, particularly in systems with graph-based structures. In this paper, we establish the existence and…

Optimization and Control · Mathematics 2025-10-01 Jianbo Cui , Tonghe Dang

The numerical realization of the dynamic programming principle for continuous-time optimal control leads to nonlinear Hamilton-Jacobi-Bellman equations which require the minimization of a nonlinear mapping over the set of admissible…

Optimization and Control · Mathematics 2015-02-26 Dante Kalise , Axel Kröner , Karl Kunisch

We develop dynamical programming methods for the purpose of optimal control of quantum states with convex constraints and concave cost and bequest functions of the quantum state. We consider both open loop and feedback control schemes,…

Quantum Physics · Physics 2009-03-06 Viacheslav P. Belavkin , Antonio Negretti , Klaus Molmer

We study the properties of the value function associated with an optimal control problem with uncertainties, known as average or Riemann-Stieltjes problem. Uncertainties are assumed to belong to a compact metric probability space, and…

Optimization and Control · Mathematics 2024-07-19 M. Soledad Aronna , Michele Palladino , Oscar Sierra

The framework of deep operator network (DeepONet) has been widely exploited thanks to its capability of solving high dimensional partial differential equations. In this paper, we incorporate DeepONet with a recently developed policy…

Optimization and Control · Mathematics 2024-06-18 Jae Yong Lee , Yeoneung Kim

We address finding the semi-global solutions to optimal feedback control and the Hamilton--Jacobi--Bellman (HJB) equation. Using the solution of an HJB equation, a feedback optimal control law can be implemented in real-time with minimum…

Optimization and Control · Mathematics 2016-06-17 Wei Kang , Lucas C. Wilcox

This paper presents a new methodology to craft navigation functions for nonlinear systems with stochastic uncertainty. The method relies on the transformation of the Hamilton-Jacobi-Bellman (HJB) equation into a linear partial differential…

Robotics · Computer Science 2014-09-23 Matanya B. Horowitz , Joel W. Burdick

In this article, a notion of viscosity solutions is introduced for first order path-dependent Hamilton-Jacobi-Bellman (PHJB) equations associated with optimal control problems for path-dependent evolution equations in Hilbert space. We…

Probability · Mathematics 2020-07-09 Jianjun Zhou

We explore the approximation of feedback control of integro-differential equations containing a fractional Laplacian term. To obtain feedback control for the state variable of this nonlocal equation we use the Hamilton--Jacobi--Bellman…

Optimization and Control · Mathematics 2022-10-19 Alessandro Alla , Marta D'Elia , Christian Glusa , Hugo Oliveira