中文
相关论文

相关论文: Connection between MP and DPP for Stochastic Recur…

200 篇论文

Stochastic maximum principle of nonlinear controlled forward-backward systems, where the set of strict (classical) controls need not be convex and the diffusion coefficient depends explicitly on the variable control, is an open problem…

概率论 · 数学 2008-12-20 Seid Bahlali

Motion planning and control problems are embedded and essential in almost all robotics applications. These problems are often formulated as stochastic optimal control problems and solved using dynamic programming algorithms. Unfortunately,…

机器人学 · 计算机科学 2018-01-12 Alex A. Gorodetsky , Sertac Karaman , Youssef M. Marzouk

We extend the proof of the dynamic programming principle (DPP) for standard stochastic optimal control problems driven by general L\'{e}vy noises. Under appropriate assumptions, it is shown that the DPP still holds when the state process…

最优化与控制 · 数学 2016-03-25 Ben Goldys , Wei Wu

We prove the dynamic programming principle (DPP) in a class of problems where an agent controls a $d$-dimensional diffusive dynamics via both classical and singular controls and, moreover, is able to terminate the optimisation at a time of…

最优化与控制 · 数学 2022-11-07 Tiziano De Angelis , Alessandro Milazzo

The purpose of this article is to study a stochastic control problem on a junction, with control at the junction point. The problem of control is formulated in the weak sense, using a relaxed control, namely a control which takes values in…

最优化与控制 · 数学 2023-11-28 Isaac Ohavi

We study stochastic motion planning problems which involve a controlled process, with possibly discontinuous sample paths, visiting certain subsets of the state-space while avoiding others in a sequential fashion. For this purpose, we first…

最优化与控制 · 数学 2017-11-27 Peyman Mohajerin Esfahani , Debasish Chatterjee , John Lygeros

In this paper, we study a stochastic recursive optimal control problem in which the cost functional is described by the solution of a backward stochastic differential equation driven by G-Brownian motion. Under standard assumptions, we…

最优化与控制 · 数学 2014-10-15 Mingshang Hu , Shaolin Ji

This work establishes a general stochastic maximum principle for partially observed optimal control of semi-linear stochastic partial differential equations in a nonconvex control domain. The state evolves in a Hilbert space driven by a…

最优化与控制 · 数学 2025-04-22 Yanzhao Cao , Hongjiang Qian , George Yin

We provide an overview on how to use the measurable selection techniques to derive the dynamic programming principle for a general stochastic optimal control/stopping problem. By considering its martingale problem formulation on the…

最优化与控制 · 数学 2024-10-03 Nicole El Karoui , Xiaolu Tan

In this work we study the stochastic recursive control problem, in which the aggregator (or called generator) of the backward stochastic differential equation describing the running cost is continuous but not necessarily Lipschitz with…

最优化与控制 · 数学 2015-09-15 Jiangyan Pu , Qi Zhang

In this paper, we study two kinds of singular optimal controls (SOCs for short) problems where the systems governed by forward-backward stochastic differential equations (FBSDEs for short), in which the control has two components: the…

最优化与控制 · 数学 2020-12-22 Liangquan Zhang

In this paper we consider non convex control problems of stochastic differential equations driven by relaxed controls. We present existence of optimal controls and then develop necessary conditions of optimality. We cover both continuous…

最优化与控制 · 数学 2013-02-15 Nasir U. Ahmed , Charalambos D. Charalambous

This paper is concerned with the Dynamic Programming Principle (DPP in short) with SDEs on Riemannian manifolds. Moreover, through the DPP, we conclude that the cost function is the unique viscosity solution to the related PDEs on…

概率论 · 数学 2010-01-19 Xuehong Zhu

In this paper the connection between stochastic optimal control and reinforcement learning is investigated. Our main motivation is to apply importance sampling to sampling rare events which can be reformulated as an optimal control problem.…

最优化与控制 · 数学 2024-02-16 Jannes Quer , Enric Ribera Borrell

The paper is devoted to the study of a new class of optimal control problems for nonsmooth dynamical systems governed by nonconvex discontinuous differential inclusions of the sweeping type with involving variable time into optimization. We…

最优化与控制 · 数学 2025-03-05 Tan H. Cao , Boris S. Mordukhovich , Dao Nguyen , Trang Nguyen , Nguyen N. Thieu

In this paper, we consider a stochastic recursive optimal control problem under model uncertainty. In this framework, the cost function is described by solutions of a family of backward stochastic differential equations. With the help of…

概率论 · 数学 2020-04-16 Mingshang Hu , Falei Wang

Sample average approximation--based stochastic dynamic programming (SDP) and model predictive control (MPC) are two different methods for approaching multistage stochastic optimization. In this paper we investigate the conditions under…

最优化与控制 · 数学 2026-02-10 Dominic S. T. Keehan , Andrew B. Philpott , Edward J. Anderson

Optimal control of stochastic nonlinear dynamical systems is a major challenge in the domain of robot learning. Given the intractability of the global control problem, state-of-the-art algorithms focus on approximate sequential optimization…

机器学习 · 计算机科学 2020-04-23 Joe Watson , Hany Abdulsamad , Jan Peters

In this paper, we study one kind of stochastic recursive optimal control problem with the obstacle constraints for the cost function where the cost function is described by the solution of one reflected backward stochastic differential…

最优化与控制 · 数学 2007-05-23 Zhen Wu , Zhiyong Yu

This paper studies the stochastic optimal control of jump-diffusion processes and the associated fully nonlinear backward stochastic Hamilton--Jacobi--Bellman (BSHJB) equations. We establish the dynamic programming principle (DPP) via…

最优化与控制 · 数学 2026-05-21 Dunxiang Liang , Qingxin Meng