English
Related papers

Related papers: Dynamic Programming Principle for Stochastic Contr…

200 papers

In this paper, an open problem is solved, for the stochastic optimal control problem with delay where the control domain is nonconvex and the diffusion term contains both control and its delayed term. Inspired by previous results by \O…

Optimization and Control · Mathematics 2020-07-14 Weijun Meng , Jingtao Shi

This paper presents a general class of dynamic stochastic optimization problems we refer to as Stochastic Depletion Problems. A number of challenging dynamic optimization problems of practical interest are stochastic depletion problems.…

Optimization and Control · Mathematics 2008-01-25 Carri W. Chan , Vivek F. Farias

We consider the problem of optimally controlling stochastic, Markovian systems subject to joint chance constraints over a finite-time horizon. For such problems, standard Dynamic Programming is inapplicable due to the time correlation of…

Optimization and Control · Mathematics 2024-11-22 Niklas Schmid , Marta Fochesato , Sarah H. Q. Li , Tobias Sutter , John Lygeros

This paper presents a continuous-time optimal control framework for the generation of reference trajectories in driving scenarios with uncertainty. A previous work presented a discrete-time stochastic generator for autonomous vehicles;…

Optimization and Control · Mathematics 2026-03-17 Ange Valli , Shangyuan Zhang , Abdel Lisser

Self-optimizing control is a strategy for selecting controlled variables, where the economic objective guides the selection and design of controlled variables, with the expectation that maintaining the controlled variables at constant…

Optimization and Control · Mathematics 2026-05-08 Chenchen Zhou , Shaoqi Wang , Hongxin Su , Xinhui Tang , Yi Cao , Shuang-Hua Yang

This paper presents a robust, distributed algorithm to solve general linear programs. The algorithm design builds on the characterization of the solutions of the linear program as saddle points of a modified Lagrangian function. We show…

Optimization and Control · Mathematics 2014-09-26 Dean Richert , Jorge Cortes

We study a specific class of finite-horizon mean field optimal stopping problems by means of the dynamic programming approach. In particular, we consider problems where the state process is not affected by the stopping time. Such problems…

Optimization and Control · Mathematics 2025-03-07 Andrea Cosso , Laura Perelli

In this paper we prove necessary conditions for optimality of a stochastic control problem for a class of stochastic partial differential equations that is controlled through the boundary. This kind of problems can be interpreted as a…

Probability · Mathematics 2016-12-05 Giuseppina Guatteri

We study discrete-time finite-horizon optimal control problems in probability spaces, whereby the state of the system is a probability measure. We show that, in many instances, the solution of dynamic programming in probability spaces…

Optimization and Control · Mathematics 2024-04-09 Antonio Terpin , Nicolas Lanzetti , Florian Dörfler

In this paper we develop necessary conditions for optimality, in the form of the stochastic Pontryagin maximum principle, for controlled equation with delay in the state and with control dependent noise, in the general case of controls $u…

Probability · Mathematics 2023-06-14 Giuseppina Guatteri , Federica Masiero

In the article Positive Dynamic Programming, David Blackwell tries to answer the question concerning the existence of optimal stationary strategies for a positive dynamic programming problem. The principal results obtained in the paper are…

Optimization and Control · Mathematics 2024-08-07 Aaqib Peerzada

We prove a stochastic maximum principle ofPontryagin's type for the optimal control of a stochastic partial differential equationdriven by white noise in the case when the set of control actions is convex. Particular attention is paid to…

Probability · Mathematics 2017-06-12 Marco Fuhrman , Ying Hu , Gianmario Tessitore

Probabilistic prediction of stochastic dynamical systems (SDSs) aims to accurately predict the conditional probability distributions of future states. However, accurate probabilistic predictions tightly hinge on accurate distributional…

Optimization and Control · Mathematics 2026-04-21 Tao Xu , Jianping He

This work presents a stochastic dynamic programming (SDP) algorithm that aims at minimizing an economic criteria based on the total energy consumption of a range extender electric vehicle (REEV). This algorithm integrates information from…

Optimization and Control · Mathematics 2016-11-18 K. Aouchiche , J. Frederic Bonnans , Giovanni Granato , Hasnaa Zidani

In this study, we consider an optimal control problem driven by a stochastic differential equation with state constraints. Here, the state constraints mean the constraints about the path of state. In order to show the maximum principe for…

Optimization and Control · Mathematics 2018-04-23 Shuzhen Yang

The Linear Parameter-Varying (LPV) framework has long been used to guarantee performance and stability requirements of nonlinear (NL) systems mainly through the $\mathcal{L}_2$-gain concept. However, recent research has pointed out that…

Systems and Control · Electrical Eng. & Systems 2020-05-14 P. J. W. Koelewijn , R. Tóth , H. Nijmeijer

This paper considers an optimal impulse control problem of dynamical systems generated by a flow. The performance criteria are total costs over the infinite time horizon. Apart from the main performance to be minimized, there are multiple…

Optimization and Control · Mathematics 2020-10-27 Alexey Piunovskiy , Yi Zhang

Stochastic systems have a control-theoretic interpretation in which noise plays the role of control. In the weak-noise limit, relevant at low temperatures or in large populations, this leads to a precise mathematical mapping: the most…

Molecular Networks · Quantitative Biology 2025-09-03 Eric De Giuli

In this paper, we study one kind of stochastic recursive optimal control problem with the obstacle constraints for the cost function where the cost function is described by the solution of one reflected backward stochastic differential…

Optimization and Control · Mathematics 2007-05-23 Zhen Wu , Zhiyong Yu

In complex engineered systems, completing an objective is sometimes not enough. The system must be able to reach a set performance characteristic, such as an unmanned aerial vehicle flying from point A to point B, \textit{under 10 seconds}.…

Optimization and Control · Mathematics 2015-06-03 Manan Gandhi