English
Related papers

Related papers: Koopman-based Policy Iteration for Robust Optimal …

200 papers

Optimal control problems are crucial in various domains, including path planning, robotics, and humanoid control, demonstrating their broad applicability. The connection between optimal control and Hamilton-Jacobi (HJ) partial differential…

Optimization and Control · Mathematics 2024-03-06 Tingwei Meng , Siting Liu , Wuchen Li , Stanley Osher

In this paper, we are concerned with the classical solvability of a class of second-order Hamilton-Jacobi-Bellman equations (HJB equations) arising from stochastic optimal control problems with linear dynamics and uniformly convex cost…

Optimization and Control · Mathematics 2025-12-19 Jinghua Li , Zhiyong Yu

Optimal control theory aims to find an optimal protocol to steer a system between assigned boundary conditions while minimizing a given cost functional in finite time. Equations arising from these types of problems are often non-linear and…

Optimization and Control · Mathematics 2025-02-21 Julia Sanders , Paolo Muratore-Ginanneschi

The aim of this work is to develop a deep learning method for solving high-dimensional stochastic control problems based on the Hamilton--Jacobi--Bellman (HJB) equation and physics-informed learning. Our approach is to parameterize the…

Optimization and Control · Mathematics 2025-06-23 Zhe Jiao , Wantao Jia , Weiqiu Zhu

This paper considers consumption and portfolio optimization problems with recursive preferences in both infinite and finite time regions. Specially, the financial market consists of a risk-free asset and a risky asset that follows a general…

Optimization and Control · Mathematics 2024-12-30 Jian-hao Kang , Zhun Gou , Nan-jing Huang

The purpose of this note is to propose a new approach for the probabilistic interpretation of Hamilton-Jacobi-Bellman equations associated with stochastic recursive optimal control problems, utilizing the representation theorem for…

Probability · Mathematics 2017-05-03 Lishun Xiao , Shengjun Fan , Dejian Tian

We introduce a new and efficient numerical method for multicriterion optimal control and single criterion optimal control under integral constraints. The approach is based on extending the state space to include information on a "budget"…

Optimization and Control · Mathematics 2016-01-06 Ajeet Kumar , Alexander Vladimirsky

In the context of optimal control, we consider the inverse problem of Lagrangian identification given system dynamics and optimal trajectories. Many of its theoretical and practical aspects are still open. Potential applications are very…

Optimization and Control · Mathematics 2014-03-21 Edouard Pauwels , Didier Henrion , Jean-Bernard Bernard Lasserre

This paper presents a study of the Koopman operator theory and its application to optimal control of a multi-robot system. The Koopman operator, while operating on a set of observation functions of the state vector of a nonlinear system,…

Systems and Control · Electrical Eng. & Systems 2023-05-09 Gang Tao , Qianhong Zhao

Presented is a new method for calculating the time-optimal guidance control for a multiple vehicle pursuit-evasion system. A joint differential game of k pursuing vehicles relative to the evader is constructed, and a Hamilton-Jacobi-Isaacs…

Optimization and Control · Mathematics 2018-02-07 Matthew R. Kirchner , Robert Mar , Gary Hewer , Jérôme Darbon , Stanley Osher , Y. T. Chow

Nonlinear optimal control is vital for numerous applications but remains challenging for unknown systems due to the difficulties in accurately modelling dynamics and handling computational demands, particularly in high-dimensional settings.…

Systems and Control · Electrical Eng. & Systems 2024-12-03 Zhexuan Zeng , Ruikun Zhou , Yiming Meng , Jun Liu

This work proposes a novel numerical scheme for solving the high-dimensional Hamilton-Jacobi-Bellman equation with a functional hierarchical tensor ansatz. We consider the setting of stochastic control, whereby one applies control to a…

Numerical Analysis · Mathematics 2025-07-01 Xun Tang , Nan Sheng , Lexing Ying

We consider the optimal control problem of stochastic evolution equations in a Hilbert space under a recursive utility, which is described as the solution of a backward stochastic differential equation (BSDE). A very general maximum…

Optimization and Control · Mathematics 2024-02-06 Guomin Liu , Shanjian Tang

The ergodic control problem for a non-degenerate controlled diffusion controlled through its drift is considered under a uniform stability condition that ensures the well-posedness of the associated Hamilton-Jacobi-Bellman (HJB) equation. A…

Optimization and Control · Mathematics 2019-03-20 Ari Arapostathis , Vivek S. Borkar

Many optimal control problems are formulated as two point boundary value problems (TPBVPs) with conditions of optimality derived from the Hamilton-Jacobi-Bellman (HJB) equations. In most cases, it is challenging to solve HJBs due to the…

Optimization and Control · Mathematics 2019-07-25 Sixiong You , Ran Dai , Ping Lu

In this paper we make a survey on the so called randomization method, a recent methodology to study stochastic optimization problems. It allows to represent the value function of an optimal control problem by a suitable backward stochastic…

Optimization and Control · Mathematics 2025-06-12 Marco Fuhrman

This paper focuses on zero-sum stochastic differential games in the framework of forward-backward stochastic differential equations on a finite time horizon with both players adopting impulse controls. By means of BSDE methods, in…

Optimization and Control · Mathematics 2021-04-08 Liangquan Zhang

In this manuscript we consider a class optimal control problem for stochastic differential delay equations. First, we rewrite the problem in a suitable infinite-dimensional Hilbert space. Then, using the dynamic programming approach, we…

Optimization and Control · Mathematics 2023-02-20 Filippo de Feo , Salvatore Federico , Andrzej Święch

We study a stochastic control problem on a bounded domain, which arises from a continuous-time optimal management model. Via the corresponding Hamilton-Jacobi-Bellman equation the value function is shown to be jointly continuous and to…

Probability · Mathematics 2017-10-24 Ruoting Gong , Christian Houdré

In this note, we study a class of indefinite stochastic McKean-Vlasov linear-quadratic (LQ in short) control problem under the control taking nonnegative values. In contrast to the conventional issue, both the classical dynamic programming…

Optimization and Control · Mathematics 2023-10-05 Xun Li , Liangquan Zhang