English
Related papers

Related papers: Discrete-time Approximation of Stochastic Optimal …

200 papers

This paper studies a discrete-time stochastic control problem with linear quadratic criteria over an infinite-time horizon. We focus on a class of control systems whose system matrices are associated with random parameters involving unknown…

Optimization and Control · Mathematics 2022-01-17 Zhaorong Zhang , Juanjuan Xu , Xun Li

This paper deals with the optimal stopping problem under partial observation for piecewise-deterministic Markov processes. We first obtain a recursive formulation of the optimal filter process and derive the dynamic programming equation of…

Probability · Mathematics 2013-05-28 Adrien Brandejsky , Benoîte de Saporta , François Dufour

In this survey we present the near-optimal stochastic control problem according to some recent tools in the literature. In particular, we focus on the approach of a discretization of the noise values instead of the canonical…

Probability · Mathematics 2021-06-30 Lourival Lima , Paulo Ruffino , Francys Souza

In this paper we focus on a general type of mean-field stochastic control problem with partial observation, in which the coefficients depend in a non-linear way not only on the state process $X_t$ and its control $u_t$ but also on the…

Optimization and Control · Mathematics 2021-11-23 Juan Li , Hao Liang , Chao Mi

This article solves an optimal control problem arising in attitude control of a spacecraft under state and control constraints. We first derive the discrete-time attitude dynamics by employing discrete mechanics. The orientation transfer,…

Systems and Control · Computer Science 2017-11-27 Karmvir Singh Phogat , Debasish Chatterjee , Ravi Banavar

An optimal control problem for the linear wave equation with control cost chosen as the BV semi-norm in time is analyzed. This formulation enhances piecewise constant optimal controls and penalizes the number of jumps. Existence of optimal…

Optimization and Control · Mathematics 2018-09-11 Sebastian Engel , Karl Kunisch

In this paper, we first introduce a new spatial-temporal interaction operator to describe the space-time dependent phenomena. Then we consider the stochastic optimal control of a new system governed by a stochastic partial differential…

Optimization and Control · Mathematics 2020-03-06 Zhun Gou , Nan-jing Huang , Ming-hui Wang , Yao-jia Zhang

The aim of this notes is to give a concise introduction to control theory for systems governed by stochastic partial differential equations. We shall mainly focus on controllability and optimal control problems for these systems. For the…

Optimization and Control · Mathematics 2021-01-27 Qi Lü , Xu Zhang

In this paper, we consider the inverse optimal control problem for the discrete-time linear quadratic regulator, over finite-time horizons. Given observations of the optimal trajectories, and optimal control inputs, to a linear…

Optimization and Control · Mathematics 2018-10-31 Han Zhang , Jack Umenberger , Xiaoming Hu

We present a combination technique based on mixed differences of both spatial approximations and quadrature formulae for the stochastic variables to solve efficiently a class of Optimal Control Problems (OCPs) constrained by random partial…

Numerical Analysis · Mathematics 2024-03-29 Fabio Nobile , Tommaso Vanzan

This paper introduces a generalization of the well-known Riccati recursion for solving the discrete-time equality-constrained linear quadratic optimal control problem. The recursion can be used to compute the solutions as well as optimal…

Optimization and Control · Mathematics 2024-12-31 Lander Vanroye , Joris De Schutter , Wilm Decré

Viewing stochastic processes through the lens of occupation measures has proved to be a powerful angle of attack for the theoretical and computational analysis of stochastic optimal control problems. We present a simple modification of the…

Optimization and Control · Mathematics 2025-01-20 Flemming Holtorf , Alan Edelman , Christopher Rackauckas

We consider a class of stochastic optimal control problems for discrete-time stochastic linear systems which seek for control policies that will steer the probability distribution of the terminal state of the system close to a desired…

Optimization and Control · Mathematics 2020-10-01 Isin M. Balci , Efstathios Bakolas

This paper is devoted to the analysis of a finite horizon discrete-time stochastic optimal control problem, in presence of constraints. We study the regularity of the value function which comes from the dynamic programming algorithm. We…

Optimization and Control · Mathematics 2007-05-23 M. Papi , S. Sbaraglia

In this paper we study simulation based optimization algorithms for solving discrete time optimal stopping problems. This type of algorithms became popular among practioneers working in the area of quantitative finance. Using large…

Optimization and Control · Mathematics 2009-09-22 Denis Belomestny

This papers shows the convergence of optimal control problems where the constraint function is discretised by a particle method. In particular, we investigate the viscous Burgers equation in the whole space $\mathbb R$ by using…

Optimization and Control · Mathematics 2013-10-01 Jan Marburger , Rene Pinnau

In this paper we study the stochastic control problem of partially observed (multi-dimensional) stochastic system driven by both Brownian motions and fractional Brownian motions. In the absence of the powerful tool of Girsanov…

Optimization and Control · Mathematics 2023-08-22 Yueyang Zheng , Yaozhong Hu

We study high-dimensional stochastic optimal control problems in which many agents cooperate to minimize a convex cost functional. We consider both the full-information problem, in which each agent observes the states of all other agents,…

Probability · Mathematics 2023-01-10 Joe Jackson , Daniel Lacker

This paper focuses on the discrete-time backward stochastic linear quadratic (BSLQ) optimal control problem with nonhomogeneous system terms and cost function cross terms. The terminal constraint of such systems distinguishes it from…

Optimization and Control · Mathematics 2026-04-14 Hu Ligui , Meng Qingxin , Tang Maoning

In this paper, we first design a time optimal control problem for the heat equation with sampled-data controls, and then use it to approximate a time optimal control problem for the heat equation with distributed controls. Our design is…

Optimization and Control · Mathematics 2017-01-24 Gengsheng Wang , Donghui Yang , Yubiao Zhang