English
Related papers

Related papers: A monotone piecewise constant control integration …

200 papers

We introduce a new numerical method to approximate the solution of a finite horizon deterministic optimal control problem. We exploit two Hamilton-Jacobi-Bellman PDE, arising by considering the dynamics in forward and backward time. This…

Optimization and Control · Mathematics 2023-04-21 Marianne Akian , Stéphane Gaubert , Shanqing Liu

We present a method for optimal coordination of multiple vehicle teams when multiple endpoint configurations are equally desirable, such as seen in the autonomous assembly of formation flight. The individual vehicles' positions in the…

Robotics · Computer Science 2021-04-20 Matthew R. Kirchner , Mark J. Debord , João P. Hespanha

In this paper, we propose and analyze both conforming and nonconforming virtual element methods (VEMs) for the fully nonlinear second-order elliptic Hamilton-Jacobi-Bellman (HJB) equations with Cordes coefficients. By incorporating…

Numerical Analysis · Mathematics 2024-08-15 Ying Cai , Hailong Guo , Zhimin Zhang

Optimal control problems driven by evolutionary partial differential equations arise in many industrial applications and their numerical solution is known to be a challenging problem. One approach to obtain an optimal feedback control is…

Numerical Analysis · Mathematics 2023-05-16 Gerhard Kirsten , Luca Saluzzi

Devising optimal interventions for diffusive systems often requires the solution of the Hamilton-Jacobi-Bellman (HJB) equation, a nonlinear backward partial differential equation (PDE), that is, in general, nontrivial to solve. Existing…

Statistical Mechanics · Physics 2022-10-18 Dimitra Maoutsa , Manfred Opper

In this paper, we are concerned with the classical solvability of a class of second-order Hamilton-Jacobi-Bellman equations (HJB equations) arising from stochastic optimal control problems with linear dynamics and uniformly convex cost…

Optimization and Control · Mathematics 2025-12-19 Jinghua Li , Zhiyong Yu

We present high-order compact schemes for a linear second-order parabolic partial differential equation (PDE) with mixed second-order derivative terms in two spatial dimensions. The schemes are applied to option pricing PDE for a family of…

Computational Finance · Quantitative Finance 2016-11-02 Bertram Düring , Christof Heuer

Path integral control solves a class of stochastic optimal control problems with a Monte Carlo (MC) method for an associated Hamilton-Jacobi-Bellman (HJB) equation. The MC approach avoids the need for a global grid of the domain of the HJB…

Optimization and Control · Mathematics 2014-08-26 Insoon Yang , Matthias Morzfeld , Claire J. Tomlin , Alexandre J. Chorin

Recent results in the study of the Hamilton Jacobi Bellman (HJB) equation have led to the discovery of a formulation of the value function as a linear Partial Differential Equation (PDE) for stochastic nonlinear systems with a mild…

Optimization and Control · Mathematics 2014-02-13 Matanya B. Horowitz , Joel W. Burdick

We study policy iteration (PI) for deterministic infinite-horizon discounted optimal control problems, whose value function is characterized by a stationary Hamilton--Jacobi--Bellman (HJB) equation. At the PDE level, PI is fundamentally…

Optimization and Control · Mathematics 2026-04-14 Namkyeong Cho , Yeoneung Kim

We consider the optimal dividend problem in the so-called degenerate bivariate risk model under the assumption that the surplus of one branch may become negative. More specific, we solve the stochastic control problem of maximizing…

Probability · Mathematics 2022-08-02 Philipp Lukas Strietzel , Henriette Elisabeth Heinrich

In this article we propose a $\alpha$-hypergeometric model with uncertain volatility (UV) where we derive a worst-case scenario for option pricing. The approach is based on the connexion between a certain class of nonlinear partial…

Pricing of Securities · Quantitative Finance 2021-08-17 Zaineb Mezdoud , Carsten Hartmann , Mohamed Riad Remita , Omar Kebiri

Environmental management optimizing a long-run objective is an ergodic control problem whose resolution can be achieved by solving an associated non-local Hamilton-Jacobi-Bellman (HJB) equation having an effective Hamiltonian. Focusing on…

Optimization and Control · Mathematics 2022-05-11 Hidekazu Yoshioka , Motoh Tsujimura , Yuta Yaegashi

We study optimal control problems in infinite horizon when the dynamics belong to a specific class of piecewise deterministic Markov processes constrained to star-shaped networks (inspired by traffic models). We adapt the results in [H. M.…

Optimization and Control · Mathematics 2015-10-06 Dan Goreac , Magdalena Kobylanski , Miguel Martinez

We treat infinite horizon optimal control problems by solving the associated stationary Hamilton-Jacobi-Bellman (HJB) equation numerically to compute the value function and an optimal feedback law. The dynamical systems under consideration…

Optimization and Control · Mathematics 2021-05-19 Mathias Oster , Leon Sallandt , Reinhold Schneider

This work proposes a novel numerical scheme for solving the high-dimensional Hamilton-Jacobi-Bellman equation with a functional hierarchical tensor ansatz. We consider the setting of stochastic control, whereby one applies control to a…

Numerical Analysis · Mathematics 2025-07-01 Xun Tang , Nan Sheng , Lexing Ying

In optimal control problems of control-affine systems, whose solutions are bang-bang or singular type, verification of optimality using the Hamilton-Jacobi-Bellman (HJB) equation involves the computation of partial derivatives of switching…

Optimization and Control · Mathematics 2020-09-15 Victor Riquelme

This paper is concerned with an optimal control problem for a forward-backward stochastic differential equation (FBSDE, for short) with a recursive cost functional determined by a backward stochastic Volterra integral equation (BSVIE, for…

Optimization and Control · Mathematics 2022-09-20 Hanxiao Wang , Jiongmin Yong , Chao Zhou

We consider an infinite horizon control problem for dynamics constrained to remain on a multidimensional junction with entry costs. We derive the associated system of Hamilton-Jacobi equations (HJ), prove the comparison principle and that…

Analysis of PDEs · Mathematics 2020-02-25 Manh-Khang Dao , Boualem Djehiche

A piecewise constant Mayer cost function is used to model optimal control problems in which the state space is partitioned into several regions, each having its own Mayer cost value. In such a context, the standard numerical methods used in…

Optimization and Control · Mathematics 2021-12-02 P. -Y. Bouchet , C. Audet , L. Bourdin