English
Related papers

Related papers: Dynamic Programming Principle for Stochastic Contr…

200 papers

In this paper, we consider optimal control problems derived by stochastic systems with delay, where control domains are non-convex and the diffusion coefficients depend on control variables. By an estimate of the integral of…

Optimization and Control · Mathematics 2022-10-25 Qixia Zhang

We prove in this article that functions satisfying a dynamic programming principle have a local interior Lipschitz type regularity. This DPP is partly motivated by the connection to the normalized parabolic $p$-Laplace operator.

Analysis of PDEs · Mathematics 2019-10-17 Jeongmin Han

In this paper, we study the relationship between maximum principle (MP) and dynamic programming principle (DPP) for forward-backward control system under consistent convex expectation dominated by G-expectation. Under the smooth assumptions…

Optimization and Control · Mathematics 2024-09-18 Xiaojuan Li , Mingshang Hu

The purpose of this article is to study a stochastic control problem on a junction, with control at the junction point. The problem of control is formulated in the weak sense, using a relaxed control, namely a control which takes values in…

Optimization and Control · Mathematics 2023-11-28 Isaac Ohavi

Classical adaptive control proves total-system stability for control of linear plants, but only for plants meeting very restrictive assumptions. Approximate Dynamic Programming (ADP) has the potential, in principle, to ensure stability…

adap-org · Physics 2015-06-24 Paul J. Werbos

Dynamical sampling deals with signals that evolve in time under the action of a linear operator. The purpose of the present paper is to analyze the performance of the basic dynamical sampling algorithms in the finite dimensional case and…

Numerical Analysis · Mathematics 2018-10-16 Akram Aldroubi , Longxiu Huang , Ilya Krishtal , Akos Ledeczi , Roy R. Lederman , Peter Volgyesi

We show that the value function of a stochastic control problem is the unique solution of the associated Hamilton-Jacobi-Bellman (HJB) equation, completely avoiding the proof of the so-called dynamic programming principle (DPP). Using…

Probability · Mathematics 2013-09-25 Erhan Bayraktar , Mihai Sirbu

This paper is concerned with the Dynamic Programming Principle (DPP in short) with SDEs on Riemannian manifolds. Moreover, through the DPP, we conclude that the cost function is the unique viscosity solution to the related PDEs on…

Probability · Mathematics 2010-01-19 Xuehong Zhu

In this article, we study optimal feedback control synthesis of stochastic 2D Navier-Stokes equations perturbed Levy type noise with distributed stochastic control process acting on the state equation. We use the dynamic programming…

Analysis of PDEs · Mathematics 2022-04-19 Manil. T. Mohan , K. Sakthivel , Sivaguru S. Sritharan

We consider an agent trying to bring a system to an acceptable state by repeated probabilistic action. Several recent works on algorithmizations of the Lovasz Local Lemma (LLL) can be seen as establishing sufficient conditions for the agent…

Discrete Mathematics · Computer Science 2016-11-29 Dimitris Achlioptas , Fotis Iliopoulos , Nikos Vlassis

We consider a system of stochastic interacting particles in $\mathbb{R}^d$ and we describe large deviations asymptotics in a joint mean-field and small-noise limit. Precisely, a large deviations principle (LDP) is established for the…

Probability · Mathematics 2020-11-17 Carlo Orrieri

In this paper, we study a stochastic recursive optimal control problem in which the cost functional is described by the solution of a backward stochastic differential equation driven by G-Brownian motion. Under standard assumptions, we…

Optimization and Control · Mathematics 2014-10-15 Mingshang Hu , Shaolin Ji

In this paper, we study the relationship between maximum principle (MP) and dynamic programming principle (DPP) for stochastic recursive optimal control problem driven by $G$-Brownian motion. Under the smooth assumption for the value…

Optimization and Control · Mathematics 2022-10-12 Xiaojuan Li

We consider a change-point detection problem for a simple class of Piecewise Deterministic Markov Processes (PDMPs). A continuous-time PDMP is observed in discrete time and through noise, and the aim is to propose a numerical method to…

Optimization and Control · Mathematics 2017-09-28 Alice Cleynen , Benoîte de Saporta

We study the problem of pathwise stochastic optimal control, where the optimization is performed for each fixed realisation of the driving noise, by phrasing the problem in terms of the optimal control of rough differential equations. We…

Probability · Mathematics 2019-06-13 Andrew L. Allan , Samuel N. Cohen

We consider the problem of nonlinear stochastic optimal control. This problem is thought to be fundamentally intractable owing to Bellman's "curse of dimensionality". We present a result that shows that repeatedly solving an open-loop…

Systems and Control · Electrical Eng. & Systems 2024-10-11 Mohamed Naveed Gul Mohamed , Suman Chakravorty , Raman Goyal , Ran Wang

In this paper, we first establish the dynamic programming principle for stochastic optimal control problems defined on compact Riemannian manifolds without boundary. Subsequently, we derive the associated Hamilton-Jacobi-Bellman (HJB)…

Optimization and Control · Mathematics 2025-07-03 Dingqian Gao , Qi Lü

We establish a large deviation principle (LDP) for a class of stochastic porous media equations driven by L\'{e}vy-type noise on a $\sigma$-finite measure space $(E,\mathcal{B}(E),\mu)$, with the Laplacian replaced by a negative definite…

Probability · Mathematics 2023-12-07 Weina Wu , Jianliang Zhai

This paper considers a distributed stochastic optimization problem where the goal is to minimize the time average of a cost function subject to a set of constraints on the time averages of a related stochastic processes called penalties. We…

Information Theory · Computer Science 2016-10-06 B. N. Bharath , Vaishali P

For sequential stochastic control problems with standard Borel measurement and control action spaces, we introduce a general (universally applicable) dynamic programming formulation, establish its well-posedness, and provide new existence…

Optimization and Control · Mathematics 2020-07-02 Serdar Yüksel