English
Related papers

Related papers: Parameter learning: stochastic optimal control app…

200 papers

We develop a continuous-time entropy-regularized reinforcement learning framework under model uncertainty. By applying Sion's minimax theorem, we transform the intractable robust control problem into an equivalent standard…

Optimization and Control · Mathematics 2025-11-11 Jiaxuan Hou , Lifeng Wei

We propose a data-driven technique to automatically learn contextual uncertainty sets in robust optimization, resulting in excellent worst-case and average-case performance while also guaranteeing constraint satisfaction. Our method…

Optimization and Control · Mathematics 2025-06-25 Irina Wang , Bart Van Parys , Bartolomeo Stellato

A general stochastic maximum principle is proved for optimal controls of semilinear stochastic evolution equations. Stochastic evolution operators, and the control with values in a general set enter into both drift and diffusion terms.

Optimization and Control · Mathematics 2012-07-03 Kai Du , Qingxin Meng

This paper is concerned with the partial information optimal control problem of wa controlled forward-backward stochastic differential equation of jump diffusion with correlated noises between the system and the observation. For this type…

Probability · Mathematics 2017-08-28 Qingxin Meng

This paper deals with partially-observed optimal control problems for the state governed by stochastic differential equation with delay. We develop a stochastic maximum principle for this kind of optimal control problems using a variational…

Optimization and Control · Mathematics 2020-10-15 Shuaiqi Zhang , Xun Li , Jie Xiong

This work presents a technique for learning systems, where the learning process is guided by knowledge of the physics of the system. In particular, we solve the problem of the two-point boundary optimal control problem of linear…

Systems and Control · Electrical Eng. & Systems 2021-05-03 Vasanth Reddy , Hoda Eldardiry , Almuatazbellah Boker

Accurate state estimation requires careful consideration of uncertainty surrounding the process and measurement models; these characteristics are usually not well-known and need an experienced designer to select the covariance matrices. An…

Machine Learning · Statistics 2025-07-18 Pardha Sai Krishna Ala , Ameya Salvi , Venkat Krovi , Matthias Schmid

We consider the problem of Reinforcement Learning for nonlinear stochastic dynamical systems. We show that in the RL setting, there is an inherent ``Curse of Variance" in addition to Bellman's infamous ``Curse of Dimensionality", in…

Machine Learning · Computer Science 2021-07-30 Raman Goyal , Suman Chakravorty , Ran Wang , Mohamed Naveed Gul Mohamed

This work describes a technique for active rejection of multiple independent and time-correlated stochastic disturbances for a nonlinear flexible inverted pendulum with cart system with uncertain model parameters. The control law is…

Systems and Control · Electrical Eng. & Systems 2024-04-09 Vincent W. Hill

In this paper, we obtain the maximum principle for optimal controls of stochastic systems with jumps by introducing a new method of variation. The control is allowed to enter both diffusion and jump term and the control domain need not to…

Optimization and Control · Mathematics 2019-10-10 Yuanzhuo Song , Shanjian Tang , Zhen Wu

In this paper, we solve an open problem and obtain a general maximum principle for a stochastic optimal control problem where the control domain is an arbitrary non-empty set and all the coefficients (especially the diffusion term and the…

Optimization and Control · Mathematics 2023-02-08 Weijun Meng , Jingtao Shi , Tianxiao Wang , Ji-Feng Zhang

Dynamic real-time optimization (DRTO) is a challenging task due to the fact that optimal operating conditions must be computed in real time. The main bottleneck in the industrial application of DRTO is the presence of uncertainty. Many…

In this paper we present a dynamic programing approach to stochastic optimal control problems with dynamic, time-consistent risk constraints. Constrained stochastic optimal control problems, which naturally arise when one has to consider…

Optimization and Control · Mathematics 2015-11-24 Yin-Lam Chow , Marco Pavone

This work considers the optimal covariance steering problem for systems subject to both additive noise and uncertain parameters which may enter multiplicatively with the state and the control. The unknown parameters are modeled as a…

Systems and Control · Electrical Eng. & Systems 2023-03-21 Jacob Knaup , Panagiotis Tsiotras

In this paper, an open problem is solved, for the stochastic optimal control problem with delay where the control domain is nonconvex and the diffusion term contains both control and its delayed term. Inspired by previous results by \O…

Optimization and Control · Mathematics 2020-07-14 Weijun Meng , Jingtao Shi

We propose a comprehensive framework for policy gradient methods tailored to continuous time reinforcement learning. This is based on the connection between stochastic control problems and randomised problems, enabling applications across…

Optimization and Control · Mathematics 2024-05-01 Robert Denkert , Huyên Pham , Xavier Warin

This paper is devoted to an optimal control problem of fully coupled forward-backward stochastic differential equations driven by sub-diffusion, whose solutions are not Markov processes. The stochastic maximum principle is obtained, where…

Optimization and Control · Mathematics 2025-03-11 Chenhui Hao , Jingtao Shi , Shuaiqi Zhang

This paper considers optimal control of dynamical systems which are represented by nonlinear stochastic differential equations. It is well-known that the optimal control policy for this problem can be obtained as a function of a value…

Robotics · Computer Science 2014-05-30 Oktay Arslan , Evangelos Theodorou , Panagiotis Tsiotras

Distributionally robust control is a well-studied framework for optimal decision making under uncertainty, with the objective of minimizing an expected cost function over control actions, assuming the most adverse probability distribution…

Systems and Control · Electrical Eng. & Systems 2025-08-12 Alexandros E. Tzikas , Lukas Fiechtner , Arec Jamgochian , Mykel J. Kochenderfer

Despite the celebrated success of stochastic control approaches for uncertain systems, such approaches are limited in the ability to handle non-Gaussian uncertainties. This work presents an adaptive robust control for linear uncertain…

Optimization and Control · Mathematics 2026-01-13 Xuehui Ma , Shiliang Zhang , Zhiyong Sun , Xiaohui Zhang , Sabita Maharjan