English
Related papers

Related papers: Maximum principle for discrete-time stochastic opt…

200 papers

This paper studies the problem of steering the distribution of a discrete-time dynamical system from an initial distribution to a target distribution in finite time. The formulation is fully nonlinear, allowing the use of general control…

Systems and Control · Electrical Eng. & Systems 2024-09-05 George Rapakoulias , Panagiotis Tsiotras

We consider distributionally robust optimal control of stochastic linear systems under signal temporal logic (STL) chance constraints when the disturbance distribution is unknown. By assuming that the underlying predicate functions are…

Systems and Control · Electrical Eng. & Systems 2024-09-09 Arash Bahari Kordabad , Eleftherios E. Vlahakis , Lars Lindemann , Dimos V. Dimarogonas , Sadegh Soudjani

In this paper, we study the numerical method for stochastic optimal control problems (SOCPs). By reducing the optimal control problem to the discrete case, we derive a discrete stochastic maximum principle (SMP). With the help of this SMP,…

Numerical Analysis · Mathematics 2020-07-14 Mingshang Hu , Lianzi Jiang

In this paper, we consider the inverse optimal control problem for the discrete-time linear quadratic regulator, over finite-time horizons. Given observations of the optimal trajectories, and optimal control inputs, to a linear…

Optimization and Control · Mathematics 2018-10-31 Han Zhang , Jack Umenberger , Xiaoming Hu

We study Mean Field stochastic control problems where the cost function and the state dynamics depend upon the joint distribution of the controlled state and the control process. We prove suitable versions of the Pontryagin stochastic…

Optimization and Control · Mathematics 2018-06-26 Beatrice Acciaio , Julio Backhoff-Veraguas , Rene Carmona

We investigate a numerical behaviour of robust deterministic optimal control problem subject to a convection diffusion equation containing uncertain inputs. Stochastic Galerkin approach, turning the original optimization problem containing…

Numerical Analysis · Mathematics 2023-03-01 Pelin Çiloğlu , Hamdullah Yücel

We consider a stochastic transportation problem between two prescribed probability distributions (a source and a target) over processes with general drift dependence and with free end times. First, and in order to establish a dual…

Optimization and Control · Mathematics 2019-09-12 Samer Dweik , Nassif Ghoussoub , Young-Heon Kim , Aaron Zeff Palmer

We study an optimal control problem for the stochastic wave equation driven by affine multiplicative noise, formulated as a stochastic linear-quadratic (SLQ) problem. By applying a stochastic Pontryagin's maximum principle, we characterize…

Optimization and Control · Mathematics 2025-10-30 Abhishek Chaudhary

In the present paper we derive, via a backward induction technique, and ad hoc maximum principle for an optimal control problem with multiple random terminal times. Therefore we apply the aforementioned result to the case of a linear…

Optimization and Control · Mathematics 2019-12-03 Francesco Cordoni , Luca Di Persio

In this paper we prove a version of the maximum principle, in the sense of Pontryagin, for the optimal control of a finite dimensional stochastic differential equation, driven by a multidimensional Wiener process. We drop the usual…

Optimization and Control · Mathematics 2017-03-14 Carlo Orrieri

This paper is devoted to the analysis of a finite horizon discrete-time stochastic optimal control problem, in presence of constraints. We study the regularity of the value function which comes from the dynamic programming algorithm. We…

Optimization and Control · Mathematics 2007-05-23 M. Papi , S. Sbaraglia

We study a class of optimal control problems governed by nonlinear stochastic equations of monotone type under certain coercivity and linear growth conditions. We give first order necessary conditions of optimality. A stochastic Pontryagin…

Optimization and Control · Mathematics 2025-12-24 Ioana Ciotir , Nicolas Forcadel , Piero Visconti , Hasnaa Zidani

We consider a distributionally robust formulation of stochastic optimization problems arising in statistical learning, where robustness is with respect to uncertainty in the underlying data distribution. Our formulation builds on…

Optimization and Control · Mathematics 2021-06-09 Mert Gürbüzbalaban , Andrzej Ruszczyński , Landi Zhu

We study the problem of optimal inside control of an SPDE (a stochastic evolution equation) driven by a Brownian motion and a Poisson random measure. Our optimal control problem is new in two ways: (i) The controller has access to inside…

Optimization and Control · Mathematics 2016-08-31 Olfa Draouil , Bernt Øksendal

The problem of minimizing convex functionals of probability distributions is solved under the assumption that the density of every distribution is bounded from above and below. A system of sufficient and necessary first-order optimality…

Information Theory · Computer Science 2018-12-05 Michael Fauss , Abdelhak M. Zoubir

We consider a singular stochastic control problem, which is called the Monotone Follower Stochastic Control Problem and give sufficient conditions for the existence and uniqueness of a local-time type optimal control. To establish this…

Optimization and Control · Mathematics 2007-05-23 Erhan Bayraktar , Masahiko Egami

This papers shows the convergence of optimal control problems where the constraint function is discretised by a particle method. In particular, we investigate the viscous Burgers equation in the whole space $\mathbb R$ by using…

Optimization and Control · Mathematics 2013-10-01 Jan Marburger , Rene Pinnau

This paper proposes a distributionally robust approach to regret optimal control of discrete-time linear dynamical systems with quadratic costs subject to a stochastic additive disturbance on the state process. The underlying probability…

Optimization and Control · Mathematics 2023-08-17 Feras Al Taha , Shuhao Yan , Eilyan Bitar

We consider control of uncertain linear time-varying stochastic systems from the perspective of regret minimization. Specifically, we focus on the problem of designing a feedback controller that minimizes the loss relative to a clairvoyant…

Systems and Control · Electrical Eng. & Systems 2024-07-04 Andrea Martin , Luca Furieri , Florian Dörfler , John Lygeros , Giancarlo Ferrari-Trecate

This work addresses stochastic optimal control problems where the unknown state evolves in continuous time while partial, noisy, and possibly controllable measurements are only available in discrete time. We develop a framework for…

Optimization and Control · Mathematics 2025-08-19 Christian Bayer , Boualem Djehiche , Eliza Rezvanova , Raul Fidel Tempone