English
Related papers

Related papers: Discrete-time approximation for stochastic optimal…

200 papers

In this paper, the optimal control for discrete-time systems driven by fractional noises is studied. A stochastic maximum principle is obtained by introducing a backward stochastic difference equation contains both fractional noises and the…

Optimization and Control · Mathematics 2024-12-24 Yuecai Han , Yuhang Li

We consider optimal control problems for diffusion processes, where the objective functional is defined by a time-consistent dynamic risk measure. We focus on coherent risk measures defined by $g$-evaluations. For such problems, we…

Optimization and Control · Mathematics 2016-08-22 Andrzej Ruszczynski , Jianing Yao

The paper is devoted to the study of a new class of optimal control problems for nonsmooth dynamical systems governed by nonconvex discontinuous differential inclusions of the sweeping type with involving variable time into optimization. We…

Optimization and Control · Mathematics 2025-03-05 Tan H. Cao , Boris S. Mordukhovich , Dao Nguyen , Trang Nguyen , Nguyen N. Thieu

This paper introduces a novel approach to the optimal control of linear discrete-time systems subject to bounded disturbances. Our approach is based on the newly established duality between ellipsoidal approximations of reachable and hardly…

Systems and Control · Electrical Eng. & Systems 2024-09-20 Egor Dogadin , Alexey Peregudin , Dmitriy Shirokih

In this paper, we present a discrete-type approximation scheme to solve continuous-time optimal stopping problems based on fully non-Markovian continuous processes adapted to the Brownian motion filtration. The approximations satisfy…

Probability · Mathematics 2019-06-24 Dorival Leão , Alberto Ohashi , Francesco Russo

We propose a class of numerical schemes for mixed optimal stopping and control of processes with infinite activity jumps and where the objective is evaluated by a nonlinear expectation. Exploiting an approximation by switching systems,…

Numerical Analysis · Mathematics 2018-03-13 Roxana Dumitrescu , Christoph Reisinger , Yufei Zhang

In this paper, we study a class of finite-time control problems for discrete-time positive linear systems with time-varying state parameters. Although several interesting control problems appearing in population biology, economics, and…

Systems and Control · Electrical Eng. & Systems 2020-08-04 Chengyan Zhao , Masaki Ogura , Kenji Sugimoto

We establish a variety of results extending the well-known Pontryagin maximum principle of optimal control to discrete-time optimal control problems posed on smooth manifolds. These results are organized around a new theorem on critical and…

Optimization and Control · Mathematics 2017-07-14 Robert Kipka , Rohit Gupta

Distributed model predictive control methods for uncertain systems often suffer from considerable conservatism and can tolerate only small uncertainties due to the use of robust formulations that are amenable to distributed design and…

Systems and Control · Electrical Eng. & Systems 2022-03-03 Simon Muntwiler , Kim P. Wabersich , Lukas Hewing , Melanie N. Zeilinger

The paper deals with a stochastic Galerkin approximation of elliptic Dirichlet boundary control problems with random input data. The expectation of a tracking cost functional with the deterministic constrained control is minimized. Error…

Optimization and Control · Mathematics 2025-06-16 Max Winkler , Hamdullah Yücel

In this paper, we study a discrete-time stochastic optimal control problem under distribution uncertainty with convex control domain. By weak convergence method and Sion's minimax theorem, we obtain the variational inequality for cost…

Optimization and Control · Mathematics 2022-06-28 Mingshang Hu , Shaolin Ji , Xiaojuan Li

We prove convergence of the proximal policy gradient method for a class of constrained stochastic control problems with control in both the drift and diffusion of the state process. The problem requires either the running or terminal cost…

Optimization and Control · Mathematics 2025-05-27 Ashley Davey , Harry Zheng

This paper presents a continuous-time optimal control framework for the generation of reference trajectories in driving scenarios with uncertainty. A previous work presented a discrete-time stochastic generator for autonomous vehicles;…

Optimization and Control · Mathematics 2026-03-17 Ange Valli , Shangyuan Zhang , Abdel Lisser

The purpose of this work is the development of space-time discretization schemes for phase-field optimal control problems. First, a time discretization of the forward problem is derived using a discontinuous Galerkin formulation. Here, a…

Optimization and Control · Mathematics 2022-03-24 Denis Khimin , Marc C. Steinbach , Thomas Wick

In this paper, a space-time discontinuous Galerkin finite element method for distributed optimal control problems governed by unsteady diffusion-convection-reaction equations with control constraints is studied. Time discretization is…

Optimization and Control · Mathematics 2013-08-09 Tuğba Akman , Bülent Karasözen

The goal of this paper is to solve a class of stochastic optimal control problems numerically, in which the state process is governed by an It\^o type stochastic differential equation with control process entering both in the drift and the…

Optimization and Control · Mathematics 2020-06-05 Richard Archibald , Feng Bao , Jiongmin Yong , Tao Zhou

In this paper, we investigate an optimal control problem with terminal stochastic linear complementarity constraints (SLCC), and its discrete approximation using the relaxation, the sample average approximation (SAA) and the implicit Euler…

Optimization and Control · Mathematics 2022-08-17 Jianfeng Luo , Xiaojun Chen

This paper focuses on optimal control problem for a class of discrete-time nonlinear systems. In practical applications, computation time is a crucial consideration when solving nonlinear optimal control problems, especially under real-time…

Optimization and Control · Mathematics 2025-04-01 Chuanzhi Lv , Xunmin Yin , Hongdan Li , Huanshui Zhang

In this paper, a stochastic algorithm for the efficient simulation and optimal control of networked wave equations based on the random batch method is proposed and analyzed. The random approximation is constructed by dividing the time…

Optimization and Control · Mathematics 2025-12-16 Daniel Veldman , Yue Wang

Stochastic policies (also known as relaxed controls) are widely used in continuous-time reinforcement learning algorithms. However, executing a stochastic policy and evaluating its performance in a continuous-time environment remain open…

Machine Learning · Computer Science 2025-10-03 Yanwei Jia , Du Ouyang , Yufei Zhang