English
Related papers

Related papers: Discrete-time Approximation of Stochastic Optimal …

200 papers

The scope of this paper is the analysis and approximation of an optimal control problem related to the Allen-Cahn equation. A tracking functional is minimized subject to the Allen-Cahn equation using distributed controls that satisfy…

Numerical Analysis · Mathematics 2022-07-27 Konstantinos Chrysafinos , Dimitra Plaka

Data-driven control of discrete-time and continuous-time systems is of tremendous research interest. In this paper, we explore data-driven optimal control of continuous-time linear systems using input-output data. Based on a density result,…

Optimization and Control · Mathematics 2024-07-18 Philipp Schmitz , Timm Faulwasser , Paolo Rapisarda , Karl Worthmann

In this paper we consider an optimal control problem governed by a time-dependent variational inequality arising in quasistatic plasticity with linear kinematic hardening. We address certain continuity properties of the forward operator,…

Optimization and Control · Mathematics 2012-09-06 Gerd Wachsmuth

In this paper, a new approach based on convex analysis is introduced to solve the $H_\infty$ problem for discrete-time nonlinear stochastic systems. A stochastic version of bounded real lemma is proved and the state feedback $H_\infty$…

Optimization and Control · Mathematics 2017-10-27 Xiangyun Lin , Tianliang Zhang , Weihai Zhang , Bor-Sen Chen

The paper addresses an optimal control problem for a perturbed sweeping process of the rate-independent hysteresis type described by a controlled "play and stop" operator with separately controlled perturbations. This problem can be reduced…

Optimization and Control · Mathematics 2015-12-01 Tan H. Cao , Boris S. Mordukhovich

We consider a nonlinear discrete stochastic control system, and our goal is to design a feedback control policy in order to lead the system to a prespecified state. We adopt a stochastic approximation viewpoint of this problem. It is known…

Optimization and Control · Mathematics 2025-09-03 Hoang Huy Nguyen , Siva Theja Maguluri

We present safe control of partially-observed linear time-varying systems in the presence of unknown and unpredictable process and measurement noise. We introduce a control algorithm that minimizes dynamic regret, i.e., that minimizes the…

Systems and Control · Electrical Eng. & Systems 2023-04-03 Hongyu Zhou , Vasileios Tzoumas

We prove a general existence result in stochastic optimal control in discrete time where controls take values in conditional metric spaces, and depend on the current state and the information of past decisions through the evolution of a…

Optimization and Control · Mathematics 2018-12-19 Asgar Jamneshan , Michael Kupper , José Miguel Zapata

Though switched dynamical systems have shown great utility in modeling a variety of physical phenomena, the construction of an optimal control of such systems has proven difficult since it demands some type of optimal mode scheduling. In…

Optimization and Control · Mathematics 2014-02-04 Ramanarayan Vasudevan , Humberto Gonzalez , Ruzena Bajcsy , S. Shankar Sastry

In this paper, we study a class of finite-time control problems for discrete-time positive linear systems with time-varying state parameters. Although several interesting control problems appearing in population biology, economics, and…

Systems and Control · Electrical Eng. & Systems 2020-08-04 Chengyan Zhao , Masaki Ogura , Kenji Sugimoto

We consider the Chance Constrained Model Predictive Control problem for polynomial systems subject to disturbances. In this problem, we aim at finding optimal control input for given disturbed dynamical system to minimize a given cost…

Optimization and Control · Mathematics 2016-05-04 Ashkan Jasour , Constantino Lagoa

This paper is concerned with a partially observed hybrid optimal control problem, where continuous dynamics and discrete events coexist and in particular, the continuous dynamics can be observed while the discrete events, described by a…

Optimization and Control · Mathematics 2023-03-14 Siyu Lv , Jie Xiong , Wen Xu

The paper is devoted to the study of a new class of optimal control problems for nonsmooth dynamical systems governed by nonconvex discontinuous differential inclusions of the sweeping type with involving variable time into optimization. We…

Optimization and Control · Mathematics 2025-03-05 Tan H. Cao , Boris S. Mordukhovich , Dao Nguyen , Trang Nguyen , Nguyen N. Thieu

This work introduces a stochastic model predictive control scheme for dynamic chance constraints. We consider linear discrete-time systems affected by unbounded additive stochastic disturbance. To synthesize an optimal controller, we solve…

Systems and Control · Electrical Eng. & Systems 2023-07-26 Maico Hendrikus Wilhelmus Engelaar , Sofie Haesaert , Mircea Lazar

The minimum-time control problem consists in finding a control policy that will drive a given dynamic system from a given initial state to a given target state (or a set of states) as quickly as possible. This is a well-known challenging…

Systems and Control · Computer Science 2015-03-19 Laurent Bako , Dulin Chen , Stéphane Lecoeuche

The goal of this paper is to solve a class of stochastic optimal control problems numerically, in which the state process is governed by an It\^o type stochastic differential equation with control process entering both in the drift and the…

Optimization and Control · Mathematics 2020-06-05 Richard Archibald , Feng Bao , Jiongmin Yong , Tao Zhou

Stochastic policies (also known as relaxed controls) are widely used in continuous-time reinforcement learning algorithms. However, executing a stochastic policy and evaluating its performance in a continuous-time environment remain open…

Machine Learning · Computer Science 2025-10-03 Yanwei Jia , Du Ouyang , Yufei Zhang

We propose a novel reformulation of the stochastic optimal control problem as an approximate inference problem, demonstrating, that such a interpretation leads to new practical methods for the original problem. In particular we characterise…

Machine Learning · Computer Science 2010-09-22 Konrad Rawlik , Marc Toussaint , Sethu Vijayakumar

In the first part of this paper we introduced an algorithm that uses reachable set approximation to approximate the minimum time function of linear control problems. To illustrate the error estimates and to demonstrate differences to other…

Optimization and Control · Mathematics 2016-01-01 Robert Baier , Thuy Thi Thien Le

In this paper, we discuss the numerical approximation of a distributed optimal control problem governed by the von Karman equations, defined in polygonal domains with point-wise control constraints. Conforming finite elements are employed…

Numerical Analysis · Mathematics 2017-09-19 Gouranga Mallik , Neela Nataraj , Jean-Pierre Raymond