English
Related papers

Related papers: Maximum principle for stochastic recursive optimal…

200 papers

We consider an arbitrary network of $M/M/\infty$ queues with controlled transitions between queues. We consider optimal control problems where the costs are linear functions of the state and inputs over a finite or infinite horizon. We…

Optimization and Control · Mathematics 2025-09-11 Giovanni Pugliese Carratelli , Ioannis Lestas

In this paper, we study a stochastic recursive optimal control problem in which the cost functional is described by the solution of a backward stochastic differential equation driven by G-Brownian motion. Under standard assumptions, we…

Optimization and Control · Mathematics 2014-10-15 Mingshang Hu , Shaolin Ji

Optimal control under uncertainty is a prevailing challenge for many reasons. One of the critical difficulties lies in producing tractable solutions for the underlying stochastic optimization problem. We show how advanced approximate…

Machine Learning · Computer Science 2024-10-28 Joe Watson , Hany Abdulsamad , Rolf Findeisen , Jan Peters

The present work addresses a finite-horizon linear-quadratic optimal control problem for uncertain systems driven by piecewise constant controls. The precise values of the system parameters are unknown, but assumed to belong to a finite set…

Systems and Control · Computer Science 2021-08-05 Félix A. Miranda , Fernando Castaños , Alexander Poznyak

This paper aims to study the relationship between the maximum principle and the dynamic programming principle for recursive optimal control problem of stochastic evolution equations, where the control domain is not necessarily convex and…

Optimization and Control · Mathematics 2025-12-19 Ying Hu , Guomin Liu , Shanjian Tang

In this paper we study the stochastic control problem of partially observed (multi-dimensional) stochastic system driven by both Brownian motions and fractional Brownian motions. In the absence of the powerful tool of Girsanov…

Optimization and Control · Mathematics 2023-08-22 Yueyang Zheng , Yaozhong Hu

This paper deals with the problem of formulating an adaptive Model Predictive Control strategy for constrained uncertain systems. We consider a linear system, in presence of bounded time varying additive uncertainty. The uncertainty is…

Systems and Control · Electrical Eng. & Systems 2021-04-13 Monimoy Bujarbaruah , Xiaojing Zhang , Marko Tanaskovic , Francesco Borrelli

In this paper, we derive first-order Pontryagin optimality conditions for risk-averse stochastic optimal control problems subject to final time inequality constraints, and whose costs are general, possibly non-smooth finite coherent risk…

Optimization and Control · Mathematics 2023-05-30 Riccardo Bonalli , Benoît Bonnet

This paper deals with a stochastic recursive optimal control problem, where the diffusion coefficient depends on the control variable and the control domain is not necessarily convex. We focus on the connection between the general maximum…

Optimization and Control · Mathematics 2016-12-21 Tianyang Nie , Jingtao Shi , Zhen Wu

This paper is concerned with the relationship between maximum principle and dynamic programming principle for risk-sensitive stochastic optimal control problems. Under the smooth assumption of the value function, relations among the adjoint…

Optimization and Control · Mathematics 2025-07-10 Huanqing Dong , Jingtao Shi

A re-entrant manufacturing system producing a large number of items and involving many steps can be approximately modeled by a hyperbolic partial differential equation (PDE) according to mass conservation law with respect to a continuous…

Optimization and Control · Mathematics 2016-11-15 Xiaodong Xu , Stevan Dubljevic

In this paper we present a framework for risk-sensitive model predictive control (MPC) of linear systems affected by stochastic multiplicative uncertainty. Our key innovation is to consider a time-consistent, dynamic risk evaluation of the…

Optimization and Control · Mathematics 2018-04-26 Sumeet Singh , Yin-Lam Chow , Anirudha Majumdar , Marco Pavone

Combining efficient and safe control for safety-critical systems is challenging. Robust methods may be overly conservative, whereas probabilistic controllers require a trade-off between efficiency and safety. In this work, we propose a…

Systems and Control · Electrical Eng. & Systems 2022-09-16 Tim Brüdigam , Robert Jacumet , Dirk Wollherr , Marion Leibold

We prove a maximum principle of optimal control of stochastic delay equations on infinite horizon. We establish first and second sufficient stochastic maximum principles as well as necessary conditions for that problem. We illustrate our…

Optimization and Control · Mathematics 2012-06-29 N. Agram , S. Haadem , B. Øksendal , F. Proske

In this paper, we consider the stochastic optimal control problems under model risk caused by uncertain volatilities. To have a mathematical consistent framework we use the notion of G-expectation and its corresponding G-Brwonian motion…

Optimization and Control · Mathematics 2014-04-18 Zhongyang Sun , Xin Zhang , Junyi Guo

This paper studies an optimal control problem for continuous-time stochastic systems subject to reachability objectives specified in a subclass of metric interval temporal logic specifications, a temporal logic with real-time constraints.…

Systems and Control · Computer Science 2015-04-21 Jie Fu , Ufuk Topcu

We consider the problem of controlling an unknown linear dynamical system under a stochastic convex cost and full feedback of both the state and cost function. We present a computationally efficient algorithm that attains an optimal…

Optimization and Control · Mathematics 2022-06-23 Asaf Cassel , Alon Cohen , Tomer Koren

An optimal control problem with a time-parameter is considered. The functional to be optimized includes the maximum over time-horizon reached by a function of the state variable, and so an $L^\infty$-term. In addition to the classical…

Optimization and Control · Mathematics 2018-11-01 Sébastien Court , Karl Kunisch , Laurent Pfeiffer

We prove a sufficient stochastic maximum principle for the optimal control of a regime-switching diffusion model. We show the connection to dynamic programming and we apply the result to a quadratic loss minimization problem, which can be…

Optimization and Control · Mathematics 2014-01-31 Catherine Donnelly

We consider a stochastic control problem where the set of strict (classical) controls is not necessarily convex and the the variable control has two components, the first being absolutely continuous and the second singular. The system is…

Probability · Mathematics 2008-12-20 Seid Bahlali