English
Related papers

Related papers: Rough Stochastic Pontryagin Maximum Principle and …

200 papers

We study the Pontryagin maximum principle by deriving necessary and sufficient conditions for a class of optimal control problems arising in non exchangeable mean field systems, where agents interact through heterogeneous and asymmetric…

Optimization and Control · Mathematics 2025-06-09 Idris Kharroubi , Samy Mekkaoui , Huyên Pham

In this article we derive a strong version of the Pontryagin Maximum Principle for general nonlinear optimal control problems on time scales in finite dimension. The final time can be fixed or not, and in the case of general boundary…

Optimization and Control · Mathematics 2013-02-15 Loïc Bourdin , Emmanuel Trélat

This paper considers optimal control of dynamical systems which are represented by nonlinear stochastic differential equations. It is well-known that the optimal control policy for this problem can be obtained as a function of a value…

Robotics · Computer Science 2014-05-30 Oktay Arslan , Evangelos Theodorou , Panagiotis Tsiotras

In this paper we develop necessary conditions for optimality, in the form of the stochastic Pontryagin maximum principle, for controlled equations with pointwise delay in the state and with control dependent noise, in the general case of…

Optimization and Control · Mathematics 2018-11-29 Giuseppina Guatteri , Federica Masiero

This paper considers the problem of partially observed optimal control for forward stochastic systems which are driven by Brownian motions and an independent Poisson random measure with a feature that the cost functional is of mean-field…

Probability · Mathematics 2014-03-19 Yaozhong Hu , David Nualart , Qing Zhou

We study pathwise approximation of scalar stochastic differential equations at a single point. We provide the exact rate of convergence of the minimal errors that can be achieved by arbitrary numerical methods that are based (in a…

Probability · Mathematics 2007-05-23 Thomas Muller-Gronbach

We consider nonsmooth optimal control problems subject to a linear elliptic partial differential equation with homogeneous Dirichlet boundary conditions. It is well-known that local solutions satisfy the celebrated Pontryagin maximum…

Optimization and Control · Mathematics 2024-06-28 Daniel Wachsmuth

In this paper, we study the numerical method for stochastic optimal control problems (SOCPs). By reducing the optimal control problem to the discrete case, we derive a discrete stochastic maximum principle (SMP). With the help of this SMP,…

Numerical Analysis · Mathematics 2020-07-14 Mingshang Hu , Lianzi Jiang

In this paper, we present a novel reinforcement learning framework designed to optimize molecular dynamics by focusing on the entire trajectory rather than just the final molecular configuration. Leveraging a stochastic version of…

Optimization and Control · Mathematics 2024-10-22 Chandrajit Bajaj , Minh Nguyen , Conrad Li

IIn this paper, we study a partially observed progressive optimal control problem of forward-backward stochastic differential equations with random jumps, where the control domain is not necessarily convex, and the control variable enter…

Optimization and Control · Mathematics 2022-06-27 Yueyang Zheng , Jingtao Shi

In this paper we introduce a new procedure to solve nonlinear optimal control problems with delays which exploits indirect methods combined with numerical homotopy procedures. It is known that solving this kind of problems via indirect…

Optimization and Control · Mathematics 2017-09-14 Riccardo Bonalli , Bruno Hérissé , Emmanuel Trélat

This paper examines the stochastic maximum principle (SMP) for a forward-backward stochastic control system where the backward state equation is characterized by the backward stochastic differential equation (BSDE) with quadratic growth and…

Optimization and Control · Mathematics 2023-08-22 Shaolin Ji , Rundong Xu

Optimal control of stochastic nonlinear dynamical systems is a major challenge in the domain of robot learning. Given the intractability of the global control problem, state-of-the-art algorithms focus on approximate sequential optimization…

Machine Learning · Computer Science 2020-04-23 Joe Watson , Hany Abdulsamad , Jan Peters

We consider a unifying framework for stochastic control problem including the following features: partial observation, path-dependence (both with respect to the state and the control), and without any non-degeneracy condition on the…

Probability · Mathematics 2016-09-14 Elena Bandini , Andrea Cosso , Marco Fuhrman , Huyên Pham

In this paper, a model of a pair of Dubins vehicles is considered. The vehicles move from an initial position and orientation to final position and orientation. A long the motion, the two vehicles are not allowed to collide however the two…

Robotics · Computer Science 2008-05-01 Heru Tjahjana , Iwan Pranoto , Hari Muhammad , J. Naiborhu , Miswanto

In this paper, we propose novel learning frameworks to tackle optimal control problems by applying the Pontryagin maximum principle and then solving for a Hamiltonian dynamical system. Applying the Pontryagin maximum principle to the…

Optimization and Control · Mathematics 2024-08-13 Chandrajit Bajaj , Minh Nguyen

We study an optimal control problem for the stochastic wave equation driven by affine multiplicative noise, formulated as a stochastic linear-quadratic (SLQ) problem. By applying a stochastic Pontryagin's maximum principle, we characterize…

Optimization and Control · Mathematics 2025-10-30 Abhishek Chaudhary

This paper outlines a novel extension of the classical Pontryagin minimum (maximum) principle to stochastic optimal control problems. Contrary to the well-known stochastic Pontryagin minimum principle involving forward-backward stochastic…

Optimization and Control · Mathematics 2026-05-11 Manfred Opper , Sebastian Reich

In this work, we study the stochastic optimal control problem (SOC) mainly from the probabilistic view point, i.e. via the Stochastic Maximum principle (SMP) \cite{Peng4}. We adopt the sample-wise backpropagation scheme proposed in…

Optimization and Control · Mathematics 2025-06-17 Hui Sun , Feng Bao

The Method of Successive Approximations (MSA) is a fixed-point iterative method used to solve stochastic optimal control problems. It is an indirect method based on the conditions derived from the Stochastic Maximum Principle (SMP), an…

Optimization and Control · Mathematics 2024-05-14 Safouane Taoufik , Badr Missaoui