English
Related papers

Related papers: Hamilton Jacobi Bellman equations in infinite dime…

200 papers

We study the well-posedness of Hamilton-Jacobi-Bellman equations on subsets of $\mathbb{R}^d$ in a context without boundary conditions. The Hamiltonian is given as the supremum over two parts: an internal Hamiltonian depending on an…

Analysis of PDEs · Mathematics 2021-04-05 Richard C. Kraaij , Mikola C. Schlottke

Policy iteration is a widely used technique to solve the Hamilton Jacobi Bellman (HJB) equation, which arises from nonlinear optimal feedback control theory. Its convergence analysis has attracted much attention in the unconstrained case.…

Optimization and Control · Mathematics 2020-05-19 Sudeep Kundu , Karl Kunisch

This article is concerned with analytic Hamiltonian dynamical systems in infinite dimension in a neighborhood of an elliptic fixed point. Given a quadratic Hamiltonian, we consider the set of its analytic higher order perturbations. We…

Dynamical Systems · Mathematics 2022-06-01 Michela Procesi , Laurent Stolovitch

We exploit the separation of the filtering and control aspects of quantum feedback control to consider the optimal control as a classical stochastic problem on the space of quantum states. We derive the corresponding Hamilton-Jacobi-Bellman…

Quantum Physics · Physics 2007-05-23 J. Gough , V. P. Belavkin , O. G. Smolyanov

Optimal control and the associated second-order path-dependent Hamilton-Jacobi-Bellman (PHJB) equation are studied for unbounded functional stochastic evolution systems in Hilbert spaces. The notion of viscosity solution without…

Optimization and Control · Mathematics 2024-02-27 Shanjian Tang , Jianjun Zhou

In this article, we provide a numerical method based on fitted finite volume method to approximate the Hamilton-Jacobi-Bellman (HJB) equation coming from stochastic optimal control problems. The computational challenge is due to the nature…

Numerical Analysis · Mathematics 2020-02-21 Christelle Dleuna Nyoumbi , Antoine Tambue

We consider an infinite horizon control problem for dynamics constrained to remain on a multidimensional junction with entry costs. We derive the associated system of Hamilton-Jacobi equations (HJ), prove the comparison principle and that…

Analysis of PDEs · Mathematics 2020-02-25 Manh-Khang Dao , Boualem Djehiche

A stochastic optimal control problem driven by an abstract evolution equation in a separable Hilbert space is considered. Thanks to the identification of the mild solution of the state equation as $\nu$-weak Dirichlet process, the value…

Probability · Mathematics 2017-08-21 Giorgio Fabbri , Francesco Russo

We treat infinite horizon optimal control problems by solving the associated stationary Hamilton-Jacobi-Bellman (HJB) equation numerically to compute the value function and an optimal feedback law. The dynamical systems under consideration…

Optimization and Control · Mathematics 2021-05-19 Mathias Oster , Leon Sallandt , Reinhold Schneider

In this paper, we propose Q-learning algorithms for continuous-time deterministic optimal control problems with Lipschitz continuous controls. Our method is based on a new class of Hamilton-Jacobi-Bellman (HJB) equations derived from…

Machine Learning · Computer Science 2020-10-28 Jeongho Kim , Jaeuk Shin , Insoon Yang

In the first part of this paper, we derive an infinite dimensional partial differential equation which describes an economic equilibrium in a model of storage which includes an infinite number of non-atomic agents. This equation has the…

Analysis of PDEs · Mathematics 2023-08-03 Charles Bertucci , Jean-Michel Lasry , Pierre Louis Lions

We treat control of several two-level atoms interacting with one mode of the electromagnetic field in a cavity. This provides a useful model to study pertinent aspects of quantum control in infinite dimensions via the emergence of…

Quantum Physics · Physics 2014-09-18 Michael Keyl , Robert Zeier , T. Schulte-Herbrueggen

This paper proposes a new framework to model control systems in which a dynamic friction occurs. The model consists in a controlled differential inclusion with a discontinuous right hand side, which still preserves existence and uniqueness…

Optimization and Control · Mathematics 2020-12-02 Fabio Tedone , Michele Palladino

We present methods for locally solving the Dynamic Programming Equations (DPE) and the Hamilton Jacobi Bellman (HJB) PDE that arise in the infinite horizon optimal control problem. The method for solving the DPE is the discrete time version…

Optimization and Control · Mathematics 2007-05-23 Carmeliza Luna Navasca

In this article, a notion of viscosity solutions is introduced for first order path-dependent Hamilton-Jacobi-Bellman (PHJB) equations associated with optimal control problems for path-dependent evolution equations in Hilbert space. We…

Probability · Mathematics 2020-07-09 Jianjun Zhou

A major challenge to the control of infinite dimensional quantum systems is the irreversibility which is often present in the system dynamics. Here we consider systems with discrete-spectrum Hamiltonians operating over a Schwartz space…

Quantum Physics · Physics 2014-03-13 Roger S. Bliss , Daniel Burgarth

This survey collects, within a unified framework, various results (primarily by the authors themselves) on the use of Deterministic Infinite-Dimensional Optimal Control Theory to address applied economic models. The main aim is to…

Optimization and Control · Mathematics 2025-09-25 Giorgio Fabbri , Silvia Faggian , Salvatore Federico , Fausto Gozzi

In this article, a notion of viscosity solutions is introduced for second order path-dependent Hamilton-Jacobi-Bellman (PHJB) equations associated with optimal control problems for path-dependent stochastic evolution equations in Hilbert…

Probability · Mathematics 2020-09-14 Jianjun Zhou

This paper mainly establishes the finite-horizon stochastic bounded real lemma, and then solves the $H_{\infty}$ control problem for discrete-time stochastic linear systems defined on the separable Hilbert spaces, thereby unifying the…

Optimization and Control · Mathematics 2026-01-12 Cheng'ao Li , Ting Hou , Weihai Zhang , Feiqi Deng

We prove Lieb-Robinson bounds for the dynamics of systems with an infinite dimensional Hilbert space and generated by unbounded Hamiltonians. In particular, we consider quantum harmonic and certain anharmonic lattice systems.

Mathematical Physics · Physics 2009-02-03 Bruno Nachtergaele , Hillel Raz , Benjamin Schlein , Robert Sims