English
Related papers

Related papers: Robust feedback switching control: dynamic program…

200 papers

This paper mainly investigates reflected stochastic recursive control problems governed by jump-diffusion dynamics. The system's state evolution is described by a stochastic differential equation driven by both Brownian motion and Poisson…

Optimization and Control · Mathematics 2025-05-15 Lu Liu , Qingmeng Wei

This paper studies the stochastic optimal control of jump-diffusion processes and the associated fully nonlinear backward stochastic Hamilton--Jacobi--Bellman (BSHJB) equations. We establish the dynamic programming principle (DPP) via…

Optimization and Control · Mathematics 2026-05-21 Dunxiang Liang , Qingxin Meng

We consider a zero-sum stochastic differential controller-and-stopper game in which the state process is a controlled diffusion evolving in a multi-dimensional Euclidean space. In this game, the controller affects both the drift and the…

Optimization and Control · Mathematics 2013-01-15 Erhan Bayraktar , Yu-Jui Huang

We apply stochastic Perron's method to a singular control problem where an individual targets at a given consumption rate, invests in a risky financial market in which trading is subject to proportional transaction costs, and seeks to…

Optimization and Control · Mathematics 2014-11-04 Erhan Bayraktar , Yuchong Zhang

Autonomous systems have witnessed a rapid increase in their capabilities, but it remains a challenge for them to perform tasks both effectively and safely. The fact that performance and safety can sometimes be competing objectives renders…

Systems and Control · Electrical Eng. & Systems 2024-12-04 Hao Wang , Adityaya Dhande , Somil Bansal

In this paper, we study one kind of stochastic recursive optimal control problem with the obstacle constraints for the cost function where the cost function is described by the solution of one reflected backward stochastic differential…

Optimization and Control · Mathematics 2007-05-23 Zhen Wu , Zhiyong Yu

Considering that the decision-making environment faced by reinforcement learning (RL) agents is full of Knightian uncertainty, this paper describes the exploratory state dynamics equation in Knightian uncertainty to study the…

Optimization and Control · Mathematics 2026-01-27 Ziyu Li , Chen Fei , Weiyin Fei

In this paper, a stochastic optimal control problem is investigated in which the system is governed by a stochastic functional differential equation. In the framework of functional It\^o calculus, we build the dynamic programming principle…

Optimization and Control · Mathematics 2013-01-03 Shaolin Ji , Shuzhen Yang

In this paper, we study a time-inconsistent stochastic optimal control problem with a recursive cost functional by a multi-person hierarchical differential game approach. An equilibrium strategy of this problem is constructed and a…

Optimization and Control · Mathematics 2016-06-13 Qingmeng Wei , Jiongmin Yong , Zhiyong Yu

We develop here the Stochastic Perron Method in the framework of two-player zero-sum differential games. We consider the formulation of the game where both players play, symmetrically, feed-back strategies (as in [CR09] or [PZ12]) as…

Optimization and Control · Mathematics 2014-02-20 Mihai Sîrbu

We develop dynamical programming methods for the purpose of optimal control of quantum states with convex constraints and concave cost and bequest functions of the quantum state. We consider both open loop and feedback control schemes,…

Quantum Physics · Physics 2009-03-06 Viacheslav P. Belavkin , Antonio Negretti , Klaus Molmer

We determine the optimal robust investment strategy of an individual who targets at a given rate of consumption and seeks to minimize the probability of lifetime ruin when she does not have perfect confidence in the drift of the risky…

Optimization and Control · Mathematics 2014-11-04 Erhan Bayraktar , Yuchong Zhang

In this article, a notion of viscosity solutions is introduced for second order path-dependent Hamilton-Jacobi-Bellman (PHJB) equations associated with optimal control problems for path-dependent stochastic differential equations. We…

Optimization and Control · Mathematics 2022-12-26 Jianjun Zhou

We address the crucial yet underexplored stability properties of the Hamilton--Jacobi--Bellman (HJB) equation in model-free reinforcement learning contexts, specifically for Lipschitz continuous optimal control problems. We bridge the gap…

Optimization and Control · Mathematics 2024-04-23 Namkyeong Cho , Yeoneung Kim

In this article, we study optimal feedback control synthesis of stochastic 2D Navier-Stokes equations perturbed Levy type noise with distributed stochastic control process acting on the state equation. We use the dynamic programming…

Analysis of PDEs · Mathematics 2022-04-19 Manil. T. Mohan , K. Sakthivel , Sivaguru S. Sritharan

Feedback controllers for port-Hamiltonian systems reveal an intrinsic inverse optimality property since each passivating state feedback controller is optimal with respect to some specific performance index. Due to the nonlinear…

Optimization and Control · Mathematics 2020-07-20 Lukas Kölsch , Pol Jané Soneira , Felix Strehle , Sören Hohmann

We study the approximation of parabolic Hamilton-Jacobi-Bellman (HJB) equations in bounded domains with strong Dirichlet boundary conditions. We work under the assumption of the existence of a sufficiently regular barrier function for the…

Numerical Analysis · Mathematics 2019-07-16 Athena Picarelli , Christoph Reisinger , Julen Rotaetxe Arto

In this article, the notion of viscosity solution is introduced for the path-dependent Hamilton-Jacobi-Bellman (PHJB) equations associated with the optimal control problems for path-dependent stochastic differential equations. We identify…

Optimization and Control · Mathematics 2020-04-07 Jianjun Zhou

This paper investigates the optimal control problems for the finite-horizon continuous-time Markov decision processes with delay-dependent control policies. We develop compactification methods in decision processes, and show that the…

Probability · Mathematics 2023-07-06 Zhong-Wei Liao , Jinghai Shao

We address finding the semi-global solutions to optimal feedback control and the Hamilton--Jacobi--Bellman (HJB) equation. Using the solution of an HJB equation, a feedback optimal control law can be implemented in real-time with minimum…

Optimization and Control · Mathematics 2016-06-17 Wei Kang , Lucas C. Wilcox