English
Related papers

Related papers: Closed-loop Equilibrium for Time-Inconsistent McKe…

200 papers

We consider the optimal control problem for a linear conditional McKean-Vlasov equation with quadratic cost functional. The coefficients of the system and the weigh-ting matrices in the cost functional are allowed to be adapted processes…

Probability · Mathematics 2017-03-09 Huyên Pham

We study a time-optimal control problem of a two-peakon collision. First, we state the controllability. Next, we find the time-optimal strategy. This is done via the HamiltonJacobi-Bellman equation and the dynamic programming method. We…

Optimization and Control · Mathematics 2021-05-24 Tomasz Cieślak , Bidesh Das

The purpose of this paper is to describe the numerical solution of the Hamilton-Jacobi-Bellman (HJB) for an optimal control problem for quantum spin systems. This HJB equation is a first order nonlinear partial differential equation defined…

Quantum Physics · Physics 2011-10-05 Srinivas Sridharan , Matthew R. James

In this paper we study a first extension of the theory of mild solutions for HJB equations in Hilbert spaces to the case when the domain is not the whole space. More precisely, we consider a half-space as domain, and a semilinear…

Optimization and Control · Mathematics 2022-09-30 Alessandro Calvia , Gianluca Cappa , Fausto Gozzi , Enrico Priola

Continuous-time reinforcement learning offers an appealing formalism for describing control problems in which the passage of time is not naturally divided into discrete increments. Here we consider the problem of predicting the distribution…

Machine Learning · Computer Science 2022-06-20 Harley Wiltzer , David Meger , Marc G. Bellemare

This work concerns the optimal control problem for McKean-Vlasov SDEs. We provide explicit conditions to ensure the existence of optimal Markovian feedback controls. Moreover, based on the flow property of the McKean-Vlasov SDE, the dynamic…

Probability · Mathematics 2023-10-18 Jinghai Shao

This article is a continuation of a previous work where we studied infinite horizon control problems for which the dynamic, running cost and control space may be different in two half-spaces of some euclidian space $\R^N$. In this article…

Analysis of PDEs · Mathematics 2014-01-27 Guy Barles , Ariela Briani , Emmanuel Chasseigne

In this paper, we propose a novel equilibrium solution notion for the time-inconsistent stochastic linear-quadratic optimal control problem. This notion is called the mixed equilibrium solution, which consists of two parts: a…

Optimization and Control · Mathematics 2018-08-21 Yuan-Hua Ni , Xun Li , Ji-Feng Zhang , Miroslav Krstic

The objective of designing a control system is to steer a dynamical system with a control signal, guiding it to exhibit the desired behavior. The Hamilton-Jacobi-Bellman (HJB) partial differential equation offers a framework for optimal…

Machine Learning · Computer Science 2025-10-22 Jostein Barry-Straume , Adwait D. Verulkar , Arash Sarshar , Andrey A. Popov , Adrian Sandu

In this paper, we investigate a class of time-inconsistent discrete-time stochastic linear-quadratic optimal control problems, whose time-consistent solutions consist of an open-loop equilibrium control and a linear feedback equilibrium…

Optimization and Control · Mathematics 2017-03-07 Xun Li , Yuan-Hua Ni , Ji-Feng Zhang

We exploit the separation of the filtering and control aspects of quantum feedback control to consider the optimal control as a classical stochastic problem on the space of quantum states. We derive the corresponding Hamilton-Jacobi-Bellman…

Quantum Physics · Physics 2007-05-23 J. Gough , V. P. Belavkin , O. G. Smolyanov

In this paper we study the fully nonlinear stochastic Hamilton-Jacobi-Bellman (HJB) equation for the optimal stochastic control problem of stochastic differential equations with random coefficients. The notion of viscosity solution is…

Optimization and Control · Mathematics 2018-07-16 Jinniao Qiu

The control of relaxation-type systems of ordinary differential equations is investigated using the Hamilton-Jacobi-Bellman equation. First, we recast the model as a singularly perturbed dynamics which we embed in a family of controlled…

Optimization and Control · Mathematics 2024-04-23 Michael Herty , Hicham Kouhkouh

This paper investigates the convergence properties of the upwind difference scheme for the Hamilton--Jacobi--Bellman (HJB) equation, a central partial differential equation in optimal control theory. First, assuming the existence of a…

Numerical Analysis · Mathematics 2026-02-05 Daisuke Inoue , Yuji Ito , Takahito Kashiwabara , Norikazu Saito , Hiroaki Yoshida

In this paper, a class of time inconsistent linear quadratic optimal control problems of mean-field stochastic differential equations (SDEs) is considered under Markovian framework. Open-loop equilibrium controls and their particular…

Optimization and Control · Mathematics 2018-02-06 Tianxiao Wang

In this article we study a finite horizon optimal control problem with monotone controls. We consider the associated Hamilton-Jacobi-Bellman (HJB) equation which characterizes the value function. We consider the totally discretized problem…

Optimization and Control · Mathematics 2014-07-08 Eduardo A. Philipp , Laura S. Aragone , Lisandro A. Parente

We explore the approximation of feedback control of integro-differential equations containing a fractional Laplacian term. To obtain feedback control for the state variable of this nonlocal equation we use the Hamilton--Jacobi--Bellman…

Optimization and Control · Mathematics 2022-10-19 Alessandro Alla , Marta D'Elia , Christian Glusa , Hugo Oliveira

In this paper, we study a stochastic recursive optimal control problem in which the system is governed by a functional forward-backward stochastic differential equation. Under standard assumptions, we establish the dynamic programming…

Probability · Mathematics 2013-01-03 Shaolin Ji , Shuzhen Yang

This work investigates the optimal control problem for reflected McKean-Vlasov SDEs and the viscosity solutions to Hamilton-Jacobi-Bellman(HJB) equations on the Wasserstein space in terms of intrinsic derivative. It follows from the flow…

Probability · Mathematics 2023-09-18 Jinghai Shao

We consider a stochastic optimal control problem where the controller can anticipate the evolution of the driving noise over some dynamically changing time window. The controlled state dynamics are understood as a rough differential…

Optimization and Control · Mathematics 2025-10-07 Peter Bank , Franziska Bielert