English
Related papers

Related papers: Dynamic programming for optimal control of stochas…

200 papers

We consider a Bolza-type optimal control problem for a dynamical system described by a fractional differential equation with the Caputo derivative of an order $\alpha \in (0, 1)$. The value of this problem is introduced as a functional in a…

Optimization and Control · Mathematics 2019-08-06 Mikhail I. Gomoyunov

This paper investigates the optimal control problems for the finite-horizon continuous-time Markov decision processes with delay-dependent control policies. We develop compactification methods in decision processes, and show that the…

Probability · Mathematics 2023-07-06 Zhong-Wei Liao , Jinghai Shao

Autonomous systems have witnessed a rapid increase in their capabilities, but it remains a challenge for them to perform tasks both effectively and safely. The fact that performance and safety can sometimes be competing objectives renders…

Systems and Control · Electrical Eng. & Systems 2024-12-04 Hao Wang , Adityaya Dhande , Somil Bansal

We provide an overview on how to use the measurable selection techniques to derive the dynamic programming principle for a general stochastic optimal control/stopping problem. By considering its martingale problem formulation on the…

Optimization and Control · Mathematics 2024-10-03 Nicole El Karoui , Xiaolu Tan

In this paper, we present a scalable deep learning approach to solve opinion dynamics stochastic optimal control problems with mean field term coupling in the dynamics and cost function. Our approach relies on the probabilistic…

Multiagent Systems · Computer Science 2022-04-19 Tianrong Chen , Ziyi Wang , Evangelos A. Theodorou

We consider an optimal control problem arising in the context of economic theory of growth, on the lines of the works by Skiba (1978) and Askenazy - Le Van (1999). The economic framework of the model is intertemporal infinite horizon…

Optimization and Control · Mathematics 2014-09-05 Francesco Bartaloni

This work is the third part of a program initiated in arXiv:2111.13258, arXiv:2302.06571 aiming at the development of an intrinsic geometric well-posedness theory for Hamilton-Jacobi equations related to controlled gradient flow problems in…

Analysis of PDEs · Mathematics 2024-02-02 Giovanni Conforti , Richard C. Kraaij , Luca Tamanini , Daniela Tonon

We study the stochastic control problem of maximizing expected utility from terminal wealth under a non-bankruptcy constraint. The wealth process is subject to shocks produced by a general marked point process. The problem of the agent is…

Optimization and Control · Mathematics 2010-08-31 Mohamed Mnif

Fishing quotas are unpleasant but efficient to control the productivity of a fishing site. A popular model has a stochastic differential equation for the biomass on which a stochastic dynamic programming or a Hamilton-Jacobi-Bellman…

Optimization and Control · Mathematics 2021-09-15 Mathieu Laurière , Gilles Pagès , Olivier Pironneau

We study a multiscale stochastic optimal control problem subject to state constraints on the slow variable. To address this class of problems, we develop a rigorous theoretical framework based on singular perturbation analysis, tailored to…

Optimization and Control · Mathematics 2025-08-12 Anderson O. Calixto , Bernardo Freitas Paulo da Costa , Glauco Valle

This paper deals with a stochastic recursive optimal control problem, where the diffusion coefficient depends on the control variable and the control domain is not necessarily convex. We focus on the connection between the general maximum…

Optimization and Control · Mathematics 2016-12-21 Tianyang Nie , Jingtao Shi , Zhen Wu

We study stochastic optimal control of rough stochastic differential equations (RSDEs). This is in the spirit of the pathwise control problem (Lions--Souganidis 1998, Buckdahn--Ma 2007; also Davis--Burstein 1992), with renewed interest and…

Probability · Mathematics 2025-10-24 Peter K. Friz , Khoa Lê , Huilin Zhang

We develop an exhaustive study of Markov decision process (MDP) under mean field interaction both on states and actions in the presence of common noise, and when optimization is performed over open-loop controls on infinite horizon. Such…

Optimization and Control · Mathematics 2021-09-10 Médéric Motte , Huyên Pham

This paper is devoted to the numerical resolution of McKean-Vlasov control problems via the class of mean-field neural networks introduced in our companion paper [25] in order to learn the solution on the Wasserstein space. We propose…

Optimization and Control · Mathematics 2024-03-20 Huyên Pham , Xavier Warin

We consider a system of diffusion processes interacting through their empirical distribution. Assuming that the empirical average of a given observable can be observed at any time, we derive regularity and quantitative stability results for…

Optimization and Control · Mathematics 2025-01-08 Louis-Pierre Chaintron , Giovanni Conforti

We use optimal control via a distributed exterior field to steer the dynamics of an ensemble of N interacting ferromagnetic particles which are immersed into a heat bath by minimizing a quadratic functional. By using dynamic programing…

Numerical Analysis · Mathematics 2018-06-19 Max Jensen , Ananta Majee , Andreas Prohl , Christian Schellnegger

This paper studies an optimal stochastic impulse control problem in a finite horizon with a decision lag, by which we mean that after an impulse is made, a fixed number units of time has to be elapsed before the next impulse is allowed to…

Optimization and Control · Mathematics 2021-02-09 Chang Li , Jiongmin Yong

In this work, we consider the local Cahn-Hilliard-Navier-Stokes equation with regular potential in two dimensional bounded domain. We formulate distributed optimal control problem as the minimization of a suitable cost functional subject to…

Analysis of PDEs · Mathematics 2024-03-08 Sheetal Dharmatti , Perisetti Lakshmi Naga Mahendranath

We study a high-dimensional stochastic optimization problem which features both control and stopping. In particular, a central planner steers a large population of particles, and can also remove particles at any time by paying a penalty. In…

Optimization and Control · Mathematics 2026-03-24 Pierre Cardaliaguet , Joe Jackson , Panagiotis E. Souganidis

We study a mean field optimal control problem with general non-Markovian dynamics, including both common noise and jumps. We show that its minimizers are Nash equilibria of an associated mean field game of controls. These types of games are…

Optimization and Control · Mathematics 2025-05-12 Felix Höfer , H. Mete Soner