English
Related papers

Related papers: Discrete-time approximation for stochastic optimal…

200 papers

This paper is concerned with the exact controllability of discrete-time stochastic system which is one of the basic problems of modern control theory. Though the exact controllability of continuous-time system governed by Ito stochastic…

Optimization and Control · Mathematics 2024-01-01 Juanjuan Xu , Huanshui Zhang

Model predictive control strategies require to solve in an sequential manner, many, possibly non-convex, optimization problems. In this work, we propose an interacting stochastic agent system to solve those problems. The agents evolve in…

Optimization and Control · Mathematics 2023-12-21 Giacomo Borghi , Michael Herty

In this paper, we consider the problem of minimum-time optimal control for a dynamical system with initial state uncertainties and propose a sequential convex programming (SCP) solution framework. We seek to minimize the expected terminal…

Optimization and Control · Mathematics 2024-09-17 Kazuya Echigo , Abhishek Cauligi , Behçet Açıkmeşe

The present article investigates the convergence of a class of space-time discretization schemes for the Cauchy problem for linear parabolic stochastic partial differential equations (SPDEs) defined on the whole space. Sufficient conditions…

Probability · Mathematics 2012-10-04 Eric Joseph Hall

In this paper, we propose a unified stochastic optimal control framework that integrates time-optimal control problems with classical stochastic optimal control formulations. Unlike conventional deterministic time-optimal control models,…

Optimization and Control · Mathematics 2025-10-21 Shuzhen Yang

In this article, we discuss two algorithms tailored to discrete-time deterministic finite-horizon nonlinear optimal control problems or so-called deterministic trajectory optimization problems. Both algorithms can be derived from an…

Optimization and Control · Mathematics 2024-12-10 Mohammad Mahmoudi Filabadi , Tom Lefebvre , Guillaume Crevecoeur

In this paper we study simulation based optimization algorithms for solving discrete time optimal stopping problems. This type of algorithms became popular among practioneers working in the area of quantitative finance. Using large…

Optimization and Control · Mathematics 2009-09-22 Denis Belomestny

In this paper, we study the optimal control problem for steering the state covariance of a discrete-time linear stochastic system over a finite time horizon. First, we establish the existence and uniqueness of the optimal control law for a…

Systems and Control · Electrical Eng. & Systems 2024-10-08 Fengjiao Liu , George Rapakoulias , Panagiotis Tsiotras

In this work, we propose a feedback control based temporal discretization for linear quadratic optimal control problems (LQ problems) governed by controlled mean-field stochastic differential equations. We firstly decompose the original…

Optimization and Control · Mathematics 2023-02-08 Yanqing Wang

This work addresses the optimal covariance control problem for stochastic discrete-time linear time-varying systems subject to chance constraints. Covariance steering is a stochastic control problem to steer the system state Gaussian…

Optimization and Control · Mathematics 2018-04-10 Kazuhide Okamoto , Maxim Goldshtein , Panagiotis Tsiotras

We introduce a class of numerical schemes for optimal control problems based on a novel Markov chain approximation, which uses, in turn, a piecewise constant policy approximation, Euler-Maruyama time stepping, and a Gauss-Hermite…

Optimization and Control · Mathematics 2020-01-07 Athena Picarelli , Christoph Reisinger

Energy-efficient real-time task scheduling has been actively explored in the past decade. Different from the past work, this paper considers schedulability conditions for stochastic real-time tasks. A schedulability condition is first…

Operating Systems · Computer Science 2008-04-07 Vandy Berten , Chi-Ju Chang , Tei-Wei Kuo

The control of ensembles of dynamical systems is an intriguing and challenging problem, arising for example in quantum control. We initiate the investigation of optimal control of ensembles of discrete-time systems, focusing on minimising…

Optimization and Control · Mathematics 2025-11-07 Christian Fiedler , Alessandro Scagliotti

We consider the Chance Constrained Model Predictive Control problem for polynomial systems subject to disturbances. In this problem, we aim at finding optimal control input for given disturbed dynamical system to minimize a given cost…

Optimization and Control · Mathematics 2016-05-04 Ashkan Jasour , Constantino Lagoa

We consider a discrete time analog of $G$--expectations and we prove that in the case where the time step goes to 0 the corresponding values converge to the original $G$--expectation. Furthermore we provide error estimates for the…

Probability · Mathematics 2011-09-16 Yan Dolinsky

This work discusses the finite element discretization of an optimal control problem for the linear wave equation with time-dependent controls of bounded variation. The main focus lies on the convergence analysis of the discretization…

Optimization and Control · Mathematics 2019-07-26 Sebastian Engel , Philip Trautmann , Boris Vexler

Inspired by the successes of stochastic algorithms in the training of deep neural networks and the simulation of interacting particle systems, we propose and analyze a framework for randomized time-splitting in linear-quadratic optimal…

Optimization and Control · Mathematics 2022-06-02 Daniel Veldman , Enrique Zuazua

Optimal Dirichlet boundary control for a fractional/normal evolution with a final observation is considered. The unique existence of the solution and the first-order optimality condition of the optimal control problem are derived. The…

Numerical Analysis · Mathematics 2020-07-20 Qin Zhou , Binjie Li

This paper presents a stochastic model predictive control approach for nonlinear systems subject to time-invariant probabilistic uncertainties in model parameters and initial conditions. The stochastic optimal control problem entails a cost…

Optimization and Control · Mathematics 2014-10-17 Stefan Streif , Matthias Karl , Ali Mesbah

In this paper, we study the numerical method for stochastic optimal control problems (SOCPs). By reducing the optimal control problem to the discrete case, we derive a discrete stochastic maximum principle (SMP). With the help of this SMP,…

Numerical Analysis · Mathematics 2020-07-14 Mingshang Hu , Lianzi Jiang