English
Related papers

Related papers: Discrete-time approximation for stochastic optimal…

200 papers

In this paper, we present a distributed model predictive control (DMPC) scheme for dynamically decoupled systems which are subject to state constraints, coupling state constraints and input constraints. In the proposed control scheme,…

Systems and Control · Electrical Eng. & Systems 2024-08-17 Adrian Wiltz , Fei Chen , Dimos V. Dimarogonas

We devise an optimal allocation strategy for the execution of a predefined number of stocks in a given time frame using the technique of discrete-time Stochastic Control Theory for a defined market model. This market structure allows an…

Mathematical Finance · Quantitative Finance 2019-09-25 Akshay Bansal , Diganta Mukherjee

We study a Q learning algorithm for continuous time stochastic control problems. The proposed algorithm uses the sampled state process by discretizing the state and control action spaces under piece-wise constant control processes. We show…

Optimization and Control · Mathematics 2023-03-10 Erhan Bayraktar , Ali Devran Kara

We consider stochastic control with discretionary stopping for the drift of a diffusion process over an infinite time horizon. The objective is to choose a control process and a stopping time to minimize the expectation of a convex terminal…

Optimization and Control · Mathematics 2025-06-24 Václav E. Beneš , Georgy Gaitsgori , Ioannis Karatzas

We design receding horizon control strategies for stochastic discrete-time linear systems with additive (possibly) unbounded disturbances, while obeying hard bounds on the control inputs. We pose the problem of selecting an appropriate…

Optimization and Control · Mathematics 2011-07-07 Debasish Chatterjee , Peter Hokayem , John Lygeros

This paper studies the problem of steering the distribution of a discrete-time dynamical system from an initial distribution to a target distribution in finite time. The formulation is fully nonlinear, allowing the use of general control…

Systems and Control · Electrical Eng. & Systems 2024-09-05 George Rapakoulias , Panagiotis Tsiotras

The purpose of this work is the development of space-time discretization schemes for phase-field optimal control problems. Specifically in the optimal control minimization problem, a tracking-type cost functional is minimized to steer the…

Optimization and Control · Mathematics 2022-09-14 Denis Khimin , Marc C. Steinbach , Thomas Wick

This paper develops a distributed model predictive control (DMPC) strategy for a class of discrete-time linear systems with consideration of globally coupled constraints. The DMPC under study is based on the dual problem concerning all…

Optimization and Control · Mathematics 2019-07-25 Yanxu Su , Yang Shi , Changyin Sun

The problem of optimal motion planing and control is fundamental in robotics. However, this problem is intractable for continuous-time stochastic systems in general and the solution is difficult to approximate if non-instantaneous nonlinear…

Robotics · Computer Science 2017-02-28 Mustafa Mukadam , Ching-An Cheng , Xinyan Yan , Byron Boots

We examine Lagrangian techniques for computing underapproximations of finite-time horizon, stochastic reach-avoid level-sets for discrete-time, nonlinear systems. We use the concept of reachability of a target tube in the control literature…

Systems and Control · Computer Science 2017-04-13 Joseph D. Gleason , Abraham P. Vinod , Meeko. M. K. Oishi

This paper studies a data-driven predictive control for a class of control-affine systems which is subject to uncertainty. With the accessibility to finite sample measurements of the uncertain variables, we aim to find controls which are…

Optimization and Control · Mathematics 2021-05-03 Dan Li , Dariush Fooladivanda , Sonia Martinez

Multi-stage decision-making under uncertainty, where decisions are taken under sequentially revealing uncertain problem parameters, is often essential to faithfully model managerial problems. Given the significant computational challenges…

Optimization and Control · Mathematics 2026-04-30 Simon Thomä , Maximilian Schiffer , Wolfram Wiesemann

In this paper, we consider a class of stochastic impulse control problem when there is a fixed delay $\Delta$ between the decision and execution times. The dynamics of the controlled system between two impulses is an arbitrary adapted…

Probability · Mathematics 2026-01-23 Said Hamadène , Ibtissam Hdhiri

The scope of this paper is the analysis and approximation of an optimal control problem related to the Allen-Cahn equation. A tracking functional is minimized subject to the Allen-Cahn equation using distributed controls that satisfy…

Numerical Analysis · Mathematics 2022-07-27 Konstantinos Chrysafinos , Dimitra Plaka

In this paper, we present a new control policy parametrization for the finite-horizon covariance steering problem for discrete-time Gaussian linear systems (DTGLS) which can reduce the latter stochastic optimal control problem to a…

Optimization and Control · Mathematics 2021-03-29 Isin M. Balci , Efstathios Bakolas

Dual control explicitly addresses the problem of trading off active exploration and exploitation in the optimal control of partially unknown systems. While the problem can be cast in the framework of stochastic dynamic programming, exact…

Systems and Control · Electrical Eng. & Systems 2019-11-12 Elena Arcari , Lukas Hewing , Melanie N. Zeilinger

In this paper we investigate a priori error estimates for the space-time Galerkin finite element discretization of a simplified semilinear gradient enhanced damage model. The model equations are of a special structure as the state equation…

Optimization and Control · Mathematics 2020-04-14 Marita Holtmannspötter , Arnd Rösch

We consider a class of stochastic gradient optimization schemes. Assuming that the objective function is strongly convex, we prove weak error estimates which are uniform in time for the error between the solution of the numerical scheme,…

Numerical Analysis · Mathematics 2026-01-27 Charles-Edouard Bréhier , Marc Dambrine , Nassim En-Nebbazi

In this paper we establish best approximation type error estimates for the fully discrete Galerkin solutions of the time-dependent Stokes problem using the stream-function formulation. For the time discretization we use the discontinuous…

Numerical Analysis · Mathematics 2026-05-20 Dmitriy Leykekhman , Boris Vexler , Jakob Wagner

We propose an actor-critic framework to solve the time-continuous stochastic optimal control problem. A least square temporal difference method is applied to compute the value function for the critic. The policy gradient method is…

Optimization and Control · Mathematics 2025-01-27 Mo Zhou , Jianfeng Lu