English
Related papers

Related papers: Numerical approximations for partially observed op…

200 papers

Optimal control of stochastic nonlinear dynamical systems is a major challenge in the domain of robot learning. Given the intractability of the global control problem, state-of-the-art algorithms focus on approximate sequential optimization…

Machine Learning · Computer Science 2020-04-23 Joe Watson , Hany Abdulsamad , Jan Peters

We provide a framework for the numerical approximation of distributed optimal control problems, based on least-squares finite element methods. Our proposed method simultaneously solves the state and adjoint equations and is $\inf$--$\sup$…

Numerical Analysis · Mathematics 2023-08-03 Thomas Führer , Michael Karkulik

We consider a one dimensional elliptic distributed optimal control problem with pointwise constraints on the derivative of the state. By exploiting the variational inequality satisfied by the derivative of the optimal state, we obtain…

Numerical Analysis · Mathematics 2021-06-18 Susanne C. Brenner , Li-yeng Sung , Winnifried Wollner

In this paper, we consider a class of continuous-time, continuous-space stochastic optimal control problems. Building upon recent advances in Markov chain approximation methods and sampling-based algorithms for deterministic path planning,…

Robotics · Computer Science 2012-02-27 Vu Anh Huynh , Sertac Karaman , Emilio Frazzoli

In this article, we present a general methodology for stochastic control problems driven by the Brownian motion filtration including non-Markovian and non-semimartingale state processes controlled by mutually singular measures. The main…

Probability · Mathematics 2024-04-04 Dorival Leão , Alberto Ohashi , Francys Andrews de Souza

We study the problem of optimal inside control of an SPDE (a stochastic evolution equation) driven by a Brownian motion and a Poisson random measure. Our optimal control problem is new in two ways: (i) The controller has access to inside…

Optimization and Control · Mathematics 2016-08-31 Olfa Draouil , Bernt Øksendal

This paper deals with a stochastic optimal feedback control problem for the controlled stochastic partial differential equations. More precisely, we establish the existence of stochastic optimal feedback control for the controlled…

Probability · Mathematics 2025-01-07 Gaofeng Zong

In this paper, we address a social planner's optimal control problem for a partially observable stochastic epidemic model. The control measures include social distancing, testing, and vaccination. Using a diffusion approximation for the…

Optimization and Control · Mathematics 2025-03-11 Ibrahim Mbouandi Njiasse , Florent Ouabo Kamkumo , Ralf Wunderlich

This paper deals with the optimal stopping problem under partial observation for piecewise-deterministic Markov processes. We first obtain a recursive formulation of the optimal filter process and derive the dynamic programming equation of…

Probability · Mathematics 2013-05-28 Adrien Brandejsky , Benoîte de Saporta , François Dufour

This paper investigates numerical methods for solving stochastic linear quadratic (SLQ) optimal control problems governed by stochastic partial differential equations (SPDEs). Two distinct approaches, the open-loop and closed-loop ones, are…

Optimization and Control · Mathematics 2024-11-19 Andreas Prohl , Yanqing Wang

In this paper we study the mixed virtual element approximation to an elliptic optimal control problem with boundary observations. The objective functional of this type of optimal control problem contains the outward normal derivatives of…

Numerical Analysis · Mathematics 2023-12-19 Minghui Yang , Zhaojie Zhou

In this work, we present an efficient gradient projection method for solving a class of stochastic optimal control problem with expected integral state constraint. The first order optimality condition system consisting of forward-backward…

Optimization and Control · Mathematics 2024-12-24 Qiming Wang , Wenbin Liu

This paper studies an optimal control problem governed by a semilinear elliptic equation, in which the control acts in a multiplicative or bilinear way as the reaction coefficient of the equation. We focus on the numerical discretization of…

Optimization and Control · Mathematics 2025-06-25 Eduardo Casas , Konstantinos Chrysafinos , Mariano Mateos

We present a multilevel stochastic gradient descent method for the optimal control of systems governed by partial differential equations under uncertain input data. The gradient descent method used to find the optimal control leverages a…

Optimization and Control · Mathematics 2025-06-04 Niklas Baumgarten , David Schneiderhan

In this paper, we consider the stochastic optimal control problem for the interacting particle system. We obtain the stochastic maximum principle of the optimal control system by introducing a generalized backward stochastic differential…

Probability · Mathematics 2025-05-14 Andrey A. Dorogovtsev , Yuecai Han , Kateryna Hlyniana , Yuhang Li

In this paper, we investigate an optimal control problem governed by parabolic equations with measure-valued controls over time. We establish the well-posedness of the optimal control problem and derive the first-order optimality condition…

Optimization and Control · Mathematics 2024-04-04 Wei Gong , Dongdong Liang

In this paper we focus on a general type of mean-field stochastic control problem with partial observation, in which the coefficients depend in a non-linear way not only on the state process $X_t$ and its control $u_t$ but also on the…

Optimization and Control · Mathematics 2021-11-23 Juan Li , Hao Liang , Chao Mi

The maximum principle for optimal control problems of fully coupled forward-backward doubly stochastic differential equations (FBDSDEs in short) in the global form is obtained, under the assumptions that the diffusion coefficients do not…

Optimization and Control · Mathematics 2012-05-28 Liangquan Zhang , Yufeng Shi

This paper presents a novel Wasserstein distributionally robust control and state estimation algorithm for partially observable linear stochastic systems, where the probability distributions of disturbances and measurement noises are…

Systems and Control · Electrical Eng. & Systems 2024-06-05 Minhyuk Jang , Astghik Hakobyan , Insoon Yang

This paper considers optimal control of dynamical systems which are represented by nonlinear stochastic differential equations. It is well-known that the optimal control policy for this problem can be obtained as a function of a value…

Robotics · Computer Science 2014-05-30 Oktay Arslan , Evangelos Theodorou , Panagiotis Tsiotras