English
Related papers

Related papers: Path-Dependent Optimal Stochastic Control and Visc…

200 papers

We describe an algorithm to solve Bellman optimization that replaces a sum over paths determining the optimal cost-to-go by an analytic method localized in state space. Our approach follows from the established relation between stochastic…

Optimization and Control · Mathematics 2022-12-02 Michael D. Schneider , Caleb Miller , George F. Chapline , Jane Pratt , Dan Merl

We provide an overview of an optimal control problem within a stochastic model of tumor growth, which includes drug application. The model comprises two stochastic differential equations (SDE) representing the diffusion of nutrient and drug…

Optimization and Control · Mathematics 2024-11-12 Noelymar Farinacci

This paper studies the stochastic optimal control of jump-diffusion processes and the associated fully nonlinear backward stochastic Hamilton--Jacobi--Bellman (BSHJB) equations. We establish the dynamic programming principle (DPP) via…

Optimization and Control · Mathematics 2026-05-21 Dunxiang Liang , Qingxin Meng

We present a method for optimal path planning of human walking paths in mountainous terrain, using a control theoretic formulation and a Hamilton-Jacobi-Bellman equation. Previous models for human navigation were entirely deterministic,…

Optimization and Control · Mathematics 2020-05-08 Christian Parkinson , David Arnold , Andrea L. Bertozzi , Stanley Osher

We study an optimal control problem of generalized mean-field dynamics with open-loop controls, where the coefficients depend not only on the state processes and controls, but also on the joint law of them. The value function $V$ defined in…

Optimization and Control · Mathematics 2024-08-16 Rainer Buckdahn , Juan Li , Zhanxin Li

In this paper, we study a stochastic recursive optimal control problem in which the objective functional is described by the solution of a backward stochastic differential equation driven by G-Brownian motion. Under standard assumptions, we…

Optimization and Control · Mathematics 2013-06-07 Mingshang Hu , Shaolin Ji , Shuzhen Yang

In this paper, we study backward doubly stochastic recursive optimal control problem where the cost function is described by the solution of a backward doubly stochastic differential equation. We give the dynamical programming principle for…

Probability · Mathematics 2020-08-13 Yunhong Li , Anis. Matoussi , Lifeng Wei , Zhen Wu

In this paper, we study the optimal control problem for steering the state covariance of a discrete-time linear stochastic system over a finite time horizon. First, we establish the existence and uniqueness of the optimal control law for a…

Systems and Control · Electrical Eng. & Systems 2024-10-08 Fengjiao Liu , George Rapakoulias , Panagiotis Tsiotras

In this study, we consider an optimal control problem driven by a stochastic differential system with a stopping time terminal cost functional. We establish the stochastic maximum principle for this new kind of an optimal control problem by…

Optimization and Control · Mathematics 2018-12-11 Shuzhen Yang

Recently path integral methods have been developed for stochastic optimal control for a wide class of models with non-linear dynamics in continuous space-time. Path integral methods find the control that minimizes the expected cost-to-go.…

Systems and Control · Computer Science 2012-03-19 Bart van den Broek , Wim Wiegerinck , Hilbert Kappen

In this paper we propose a new methodology for solving an uncertain stochastic Markovian control problem in discrete time. We call the proposed methodology the adaptive robust control. We demonstrate that the uncertain control problem under…

Optimization and Control · Mathematics 2017-06-08 Tomasz R. Bielecki , Tao Chen , Igor Cialenco , Areski Cousin , Monique Jeanblanc

We present a novel particle filtering framework for continuous-time dynamical systems with continuous-time measurements. Our approach is based on the duality between estimation and optimal control, which allows reformulating the estimation…

Optimization and Control · Mathematics 2021-10-08 Qinsheng Zhang , Amirhossein Taghvaei , Yongxin Chen

In this paper, we study a stochastic recursive optimal control problem in which the value functional is defined by the solution of a backward stochastic differential equation (BSDE) under $\tilde{G}$-expectation. Under standard assumptions,…

Optimization and Control · Mathematics 2021-06-08 Mingshang Hu , Shaolin Ji , Xiaojuan Li

We consider a stochastic control problem which is composed of a controlled stochastic differential equation, and whose associated cost functional is defined through a controlled backward stochastic differential equation. Under appropriate…

Probability · Mathematics 2009-02-17 Rainer Buckdahn , Boubakeur Labed , Catherine Rainer , Lazhar Tamer

Under a Bayesian framework, we formulate the fully sequential sampling and selection decision in statistical ranking and selection as a stochastic control problem, and derive the associated Bellman equation. Using value function…

Machine Learning · Computer Science 2017-10-10 Yijie Peng , Edwin K. P. Chong , Chun-Hung Chen , Michael C. Fu

In this paper, we study a stochastic recursive optimal control problem in which the cost functional is described by the solution of a backward stochastic differential equation driven by G-Brownian motion. Under standard assumptions, we…

Optimization and Control · Mathematics 2014-10-15 Mingshang Hu , Shaolin Ji

We study the problem of pathwise stochastic optimal control, where the optimization is performed for each fixed realisation of the driving noise, by phrasing the problem in terms of the optimal control of rough differential equations. We…

Probability · Mathematics 2019-06-13 Andrew L. Allan , Samuel N. Cohen

In this paper we extend dynamic programming techniques to the study of discrete-time infinite horizon optimal control problems on compact control invariant sets with state-independent best asymptotic average cost. To this end we analyse the…

Optimization and Control · Mathematics 2023-05-22 David Angeli , Lars Grüne

In this paper, we first establish the dynamic programming principle for stochastic optimal control problems defined on compact Riemannian manifolds without boundary. Subsequently, we derive the associated Hamilton-Jacobi-Bellman (HJB)…

Optimization and Control · Mathematics 2025-07-03 Dingqian Gao , Qi Lü

This paper mainly investigates reflected stochastic recursive control problems governed by jump-diffusion dynamics. The system's state evolution is described by a stochastic differential equation driven by both Brownian motion and Poisson…

Optimization and Control · Mathematics 2025-05-15 Lu Liu , Qingmeng Wei