English
Related papers

Related papers: Stochastic Optimal Control with Delay in the Contr…

200 papers

In this paper we investigate a kind of optimal control problem of coupled forward-backward stochastic system with jumps whose cost functional is defined through a coupled forward-backward stochastic differential equation with Brownian…

Probability · Mathematics 2020-09-15 Qian Lin

In this article, a notion of viscosity solutions is introduced for first order path-dependent Hamilton-Jacobi-Bellman (HJB) equations associated with optimal control problems for path-dependent differential equations. We identify the value…

Analysis of PDEs · Mathematics 2020-09-11 Jianjun Zhou

In optimal control problems of control-affine systems, whose solutions are bang-bang or singular type, verification of optimality using the Hamilton-Jacobi-Bellman (HJB) equation involves the computation of partial derivatives of switching…

Optimization and Control · Mathematics 2020-09-15 Victor Riquelme

This work reformulates language generation as a stochastic optimal control problem, providing a unified theoretical perspective to analyze autoregressive and diffusion models and explain their limitations (Efficiency-Fidelity Paradox,…

Computation and Language · Computer Science 2026-05-18 ZiYi Dong , Yuliang Huang , Weijian Deng , Xiangyang Ji , Liang Lin , Pengxu Wei

The path-integral control, which stems from the stochastic Hamilton-Jacobi-Bellman equation, is one of the methods to control stochastic nonlinear systems. This paper gives a new insight into nonlinear stochastic optimal control problems…

Optimization and Control · Mathematics 2021-09-14 Jun Ohkubo

Controlling systems of ordinary differential equations (ODEs) is ubiquitous in science and engineering. For finding an optimal feedback controller, the value function and associated fundamental equations such as the Bellman equation and the…

Optimization and Control · Mathematics 2021-04-14 Mathias Oster , Leon Sallandt , Reinhold Schneider

Optimal control problems are crucial in various domains, including path planning, robotics, and humanoid control, demonstrating their broad applicability. The connection between optimal control and Hamilton-Jacobi (HJ) partial differential…

Optimization and Control · Mathematics 2024-03-06 Tingwei Meng , Siting Liu , Wuchen Li , Stanley Osher

We give answer to an open question by proving a sufficient optimality condition for state-linear optimal control problems with time delays in state and control variables. In the proof of our main result, we transform a delayed state-linear…

Optimization and Control · Mathematics 2019-04-03 Ana P. Lemos-Paiao , Cristiana J. Silva , Delfim F. M. Torres

In this paper, we study one kind of stochastic recursive optimal control problem with the obstacle constraints for the cost function where the cost function is described by the solution of one reflected backward stochastic differential…

Optimization and Control · Mathematics 2007-05-23 Zhen Wu , Zhiyong Yu

Optimizing the controls of quantum systems plays a crucial role in advancing quantum technologies. The time-varying noises in quantum systems and the widespread use of inhomogeneous quantum ensembles raise the need for high-quality quantum…

Quantum Physics · Physics 2025-05-06 Xinyu Fei , Lucas T. Brady , Jeffrey Larson , Sven Leyffer , Siqian Shen

For an optimal control problem of an It\^o's type stochastic differential equation, the control process could be taken as open-loop or closed-loop forms. In the standard literature, provided appropriate regularity, the value functions under…

Optimization and Control · Mathematics 2021-03-09 Jiongmin Yong , Jianfeng Zhang

We study a family of stationary Hamilton-Jacobi-Bellman (HJB) equations in Hilbert spaces arising from stochastic optimal control problems. The main difficulties to treat such problems are: the lack of smoothing properties of the linear…

Optimization and Control · Mathematics 2025-10-31 Gabriele Bolli , Fausto Gozzi

Stochastic optimal control problems for Hamiltonian dynamics on graphs have wide-ranging applications in mechanics and quantum field theory, particularly in systems with graph-based structures. In this paper, we establish the existence and…

Optimization and Control · Mathematics 2025-10-01 Jianbo Cui , Tonghe Dang

In the present work we employ, for the first time, backward stochastic differential equations (BSDEs) to study the optimal control of semi-Markov processes on finite horizon, with general state and action spaces. More precisely, we prove…

Optimization and Control · Mathematics 2015-05-27 Elena Bandini , Fulvia Confortola

In this paper, we adapt stochastic Perron's method to analyze a stochastic target problem with unbounded controls in a jump diffusion set-up. With this method, we construct a viscosity sub-solution and super-solution to the associated…

Optimization and Control · Mathematics 2016-05-18 Erhan Bayraktar , Jiaqi Li

We investigate feedback control for infinite horizon optimal control problems for partial differential equations. The method is based on the coupling between Hamilton-Jacobi-Bellman (HJB) equations and model reduction techniques. It is…

Optimization and Control · Mathematics 2016-07-11 Alessandro Alla , Andreas Schmidt , Bernard Haasdonk

We establish a connection between stochastic optimal control and generative models based on stochastic differential equations (SDEs), such as recently developed diffusion probabilistic models. In particular, we derive a…

Machine Learning · Computer Science 2024-03-27 Julius Berner , Lorenz Richter , Karen Ullrich

We consider a Bayesian adaptive optimal stochastic control problem where a hidden static signal has a non-separable influence on the drift of a noisy observation. Being allowed to control the specific form of this dependence, we aim at…

Optimization and Control · Mathematics 2025-12-22 Alexander M. G. Cox , Sigrid Källblad , Chaorui Wang

We solve explicitly a two-dimensional singular control problem of finite fuel type for infinite time horizon. The problem stems from the optimal liquidation of an asset position in a financial market with multiplicative and transient price…

Probability · Mathematics 2019-06-27 Dirk Becherer , Todor Bilarev , Peter Frentrup

We prove necessary optimality conditions of Euler-Lagrange type for a problem of the calculus of variations with time delays, where the delay in the unknown function is different from the delay in its derivative. Then, a more general…

Optimization and Control · Mathematics 2014-07-24 Mohammed Benharrat , Delfim F. M. Torres