English
Related papers

Related papers: Dynamic optimization and its relation to classical…

200 papers

We extend the work on optimal investment and consumption of a population considered in [2] to a general stochastic setting over a finite time horizon. We incorporate the Cobb-Douglas production function in the capital dynamics while the…

Analysis of PDEs · Mathematics 2024-08-15 Hao Liu , Suresh P. Sethi , Tak Kwong Wong , Sheung Chi Phillip Yam

Recent studies have extended the use of the stochastic Hamilton-Jacobi-Bellman (HJB) equation to include complex variables for deriving quantum mechanical equations. However, these studies often assume that it is valid to apply the HJB…

Quantum Physics · Physics 2024-10-14 Vasil Yordanov

We consider the problem of optimally controlling stochastic, Markovian systems subject to joint chance constraints over a finite-time horizon. For such problems, standard Dynamic Programming is inapplicable due to the time correlation of…

Optimization and Control · Mathematics 2024-11-22 Niklas Schmid , Marta Fochesato , Sarah H. Q. Li , Tobias Sutter , John Lygeros

A stochastic procedure is developed which allows one to express Pontryagin's maximum principle for dissipative quantum system solely in terms of stochastic wave functions. Time-optimal controls can be efficiently computed without computing…

Quantum Physics · Physics 2020-11-09 Chungwei Lin , Dries Sels , Yanting Ma , Yebin Wang

The Dirac equation, central to relativistic quantum mechanics, governs spin-$\frac{1}{2}$ particles and their antiparticles, with each spinor component satisfying the Klein-Gordon equation - the quantum counterpart of the relativistic mass…

Quantum Physics · Physics 2025-03-12 Vasil Yordanov

This paper investigates the relationship between Pontryagin's maximum principle and dynamic programming principle in the context of stochastic optimal control systems governed by stochastic evolution equations with random coefficients in…

Optimization and Control · Mathematics 2025-11-05 Dingqian Gao , Qi Lü

We study a time-optimal control problem of a two-peakon collision. First, we state the controllability. Next, we find the time-optimal strategy. This is done via the HamiltonJacobi-Bellman equation and the dynamic programming method. We…

Optimization and Control · Mathematics 2021-05-24 Tomasz Cieślak , Bidesh Das

In this paper we present a dynamic programing approach to stochastic optimal control problems with dynamic, time-consistent risk constraints. Constrained stochastic optimal control problems, which naturally arise when one has to consider…

Optimization and Control · Mathematics 2015-11-24 Yin-Lam Chow , Marco Pavone

Recent work linking deep neural networks and dynamical systems opened up new avenues to analyze deep learning. In particular, it is observed that new insights can be obtained by recasting deep learning as an optimal control problem on…

Optimization and Control · Mathematics 2020-07-21 Weinan E , Jiequn Han , Qianxiao Li

We study time-inconsistent recursive stochastic control problems, i.e., for which the Bellman principle of optimality does not hold. For this class of problems classical optimal controls may fail to exist, or to be relevant in practice, and…

Optimization and Control · Mathematics 2024-03-14 Elisa Mastrogiacomo , Marco Tarsia

Pontryagin type maximum principle and Bellman's dynamic programming principle serve as two of the most important tools in solving optimal control problems. There is a huge literature on the study of relationship between them. The main…

Optimization and Control · Mathematics 2021-12-30 Liangying Chen , Qi Lü

We consider optimal transport problems where the cost is optimized over controlled dynamics and the end time is free. Unlike the classical setting, the search for optimal transport plans also requires the identification of optimal "stopping…

Optimization and Control · Mathematics 2018-07-09 Nassif Ghoussoub , Young-Heon Kim , Aaron Zeff Palmer

We study a multiscale stochastic optimal control problem subject to state constraints on the slow variable. To address this class of problems, we develop a rigorous theoretical framework based on singular perturbation analysis, tailored to…

Optimization and Control · Mathematics 2025-08-12 Anderson O. Calixto , Bernardo Freitas Paulo da Costa , Glauco Valle

We consider a stochastic control problem with the assumption that the system is controlled until the state process breaks the fixed barrier. Assuming some general conditions, it is proved that the resulting Hamilton Jacobi Bellman equations…

Optimization and Control · Mathematics 2025-03-24 Dariusz Zawisza

In this paper, we propose novel learning frameworks to tackle optimal control problems by applying the Pontryagin maximum principle and then solving for a Hamiltonian dynamical system. Applying the Pontryagin maximum principle to the…

Optimization and Control · Mathematics 2024-08-13 Chandrajit Bajaj , Minh Nguyen

We exploit the separation of the filtering and control aspects of quantum feedback control to consider the optimal control as a classical stochastic problem on the space of quantum states. We derive the corresponding Hamilton-Jacobi-Bellman…

Quantum Physics · Physics 2007-05-23 J. Gough , V. P. Belavkin , O. G. Smolyanov

This paper considers linear-quadratic control of a non-linear dynamical system subject to arbitrary cost. I show that for this class of stochastic control problems the non-linear Hamilton-Jacobi-Bellman equation can be transformed into a…

General Physics · Physics 2009-11-11 H. J. Kappen

Recent work [Ran22] formulated a class of optimal control problems involving positive linear systems, linear stage costs, and elementwise constraints on control. It was shown that the problem admits linear optimal cost and the associated…

Optimization and Control · Mathematics 2023-09-27 Yuchao Li , Anders Rantzer

In this paper we propose a new way of proving the value of a firm that is currently producing a certain product and faces the option to exit the market. The problem of optimal exiting is an optimal stopping problem, that can be solved using…

Optimization and Control · Mathematics 2013-09-23 Manuel Guerra , Cláudia Nunes , Carlos Oliveira

Conservation principles like conservation of charge or energy provide a natural way to couple and constrain different physical variables. In this letter, we propose a dynamical system model that exploits these constraints for solving…

Optimization and Control · Mathematics 2017-07-24 Oindrila Chatterjee , Shantanu Chakrabartty