English
Related papers

Related papers: Optimal Control from a Fluid Dynamics Perspective

200 papers

The numerical realization of the dynamic programming principle for continuous-time optimal control leads to nonlinear Hamilton-Jacobi-Bellman equations which require the minimization of a nonlinear mapping over the set of admissible…

Optimization and Control · Mathematics 2015-02-26 Dante Kalise , Axel Kröner , Karl Kunisch

In this manuscript we consider a class optimal control problem for stochastic differential delay equations. First, we rewrite the problem in a suitable infinite-dimensional Hilbert space. Then, using the dynamic programming approach, we…

Optimization and Control · Mathematics 2023-02-20 Filippo de Feo , Salvatore Federico , Andrzej Święch

Hybrid dynamical systems are systems which posses both continuous and discrete transitions. Assuming that the discrete transitions (resets) occur a finite number of times, the optimal control problem can be solved by gluing together the…

Optimization and Control · Mathematics 2024-03-20 William Clark , Maria Oprea , Aden Shaw

The control of relaxation-type systems of ordinary differential equations is investigated using the Hamilton-Jacobi-Bellman equation. First, we recast the model as a singularly perturbed dynamics which we embed in a family of controlled…

Optimization and Control · Mathematics 2024-04-23 Michael Herty , Hicham Kouhkouh

This paper introduces a novel methodology that leverages the Hamilton-Jacobi solution to enhance non-linear model predictive control (MPC) in scenarios affected by navigational uncertainty. Using Hamilton-Jacobi-Theoretic approach, a…

Optimization and Control · Mathematics 2025-04-01 Amit Jain , Roshan T. Eapen , Puneet Singla

In this article, a notion of viscosity solutions is introduced for first order path-dependent Hamilton-Jacobi-Bellman (PHJB) equations associated with optimal control problems for path-dependent evolution equations in Hilbert space. We…

Probability · Mathematics 2020-07-09 Jianjun Zhou

A class of optimal control problems governed by linear fractional diffusion equation with control constraint is considered. We first establish some results on the existence of strong solution to the state equation and the existence of…

Optimization and Control · Mathematics 2022-11-24 Bui Trong Kien , Bui Ngoc Muoi , Ching-Feng Wen , Jen-Chih Yao

In a wide range of applications it is desirable to optimally control a dynamical system with respect to concurrent, potentially competing goals. This gives rise to a multiobjective optimal control problem where, instead of computing a…

Optimization and Control · Mathematics 2020-12-18 Sebastian Peitz , Sina Ober-Blöbaum , Michael Dellnitz

Maximum entropy reinforcement learning (RL) methods have been successfully applied to a range of challenging sequential decision-making and control tasks. However, most of existing techniques are designed for discrete-time systems. As a…

Optimization and Control · Mathematics 2020-09-29 Jeongho Kim , Insoon Yang

The convective Brinkman-Forchheimer (CBF) equations describe the motion of incompressible viscous fluid through a rigid, homogeneous, isotropic, porous medium. In this work, we consider some distributed optimal control problems like total…

Optimization and Control · Mathematics 2021-02-02 Manil T. Mohan

In this paper we propose and analyze a method based on the Riccati transformation for solving the evolutionary Hamilton-Jacobi-Bellman equation arising from the stochastic dynamic optimal allocation problem. We show how the fully nonlinear…

Portfolio Management · Quantitative Finance 2013-07-25 Sona Kilianova , Daniel Sevcovic

We exploit the separation of the filtering and control aspects of quantum feedback control to consider the optimal control as a classical stochastic problem on the space of quantum states. We derive the corresponding Hamilton-Jacobi-Bellman…

Quantum Physics · Physics 2007-05-23 J. Gough , V. P. Belavkin , O. G. Smolyanov

In this paper, we are concerned with the classical solvability of a class of second-order Hamilton-Jacobi-Bellman equations (HJB equations) arising from stochastic optimal control problems with linear dynamics and uniformly convex cost…

Optimization and Control · Mathematics 2025-12-19 Jinghua Li , Zhiyong Yu

We show that necessary and sufficient conditions of optimality in periodic optimization problems can be stated in terms of a solution of the corresponding HJB inequality, the latter being equivalent to a max-min type variational problem…

Optimization and Control · Mathematics 2013-09-10 Vladimir Gaitsgory , Ludmila Manic

In this paper we present a new algorithm for the solution of Hamilton-Jacobi-Bellman equations related to optimal control problems. The key idea is to divide the domain of computation into subdomains which are shaped by the optimal dynamics…

Numerical Analysis · Mathematics 2014-08-04 Simone Cacace , Emiliano Cristiani , Maurizio Falcone , Athena Picarelli

In this paper we study the existence of sufficiently regular representations of Hamilton-Jacobi equations in optimal control theory with the compact control set. We introduce a new method to construct representations for a wide class of…

Optimization and Control · Mathematics 2021-08-12 Arkadiusz Misztela

In this paper, we study a stochastic recursive optimal control problem in which the system is governed by a functional forward-backward stochastic differential equation. Under standard assumptions, we establish the dynamic programming…

Probability · Mathematics 2013-01-03 Shaolin Ji , Shuzhen Yang

In this article, the notion of viscosity solution is introduced for the path-dependent Hamilton-Jacobi-Bellman (PHJB) equations associated with the optimal control problems for path-dependent stochastic differential equations. We identify…

Optimization and Control · Mathematics 2020-04-07 Jianjun Zhou

We consider a class of exit time stochastic control problems for diffusion processes with discounted criterion, where the controller can utilize a given amount of resource, called "fuel". In contrast to the vast majority of existing…

Optimization and Control · Mathematics 2015-01-30 Dmitry B. Rokhlin , Georgii Mironenko

We introduce a new and efficient numerical method for multicriterion optimal control and single criterion optimal control under integral constraints. The approach is based on extending the state space to include information on a "budget"…

Optimization and Control · Mathematics 2016-01-06 Ajeet Kumar , Alexander Vladimirsky