English
Related papers

Related papers: Approximate Inference and Stochastic Optimal Contr…

200 papers

The considered optimal control problem of a stochastic power system, is to select the set of power supply vectors which infimizes the probability that the phase-angle differences of any power flow of the network, endangers the transient…

Optimization and Control · Mathematics 2024-01-31 Zhen Wang , Kaihua Xi , Aijie Cheng , Hai Xiang Lin , Jan H. van Schuppen

This paper investigates the so-called reward-balancing methods, a novel class of algorithms for solving discounted-return reinforcement learning (RL) problems. These methods consist of iteratively adjusting the reward function to transform…

Optimization and Control · Mathematics 2026-04-23 Simone Baroncini , Bahman Gharesifard , Giuseppe Notarstefano

Evolutionary strategies have recently been shown to achieve competing levels of performance for complex optimization problems in reinforcement learning. In such problems, one often needs to optimize an objective function subject to a set of…

Neural and Evolutionary Computing · Computer Science 2022-02-23 Youssef Diouane , Aurelien Lucchi , Vihang Patil

This paper focuses on stochastic optimal control problems with constraints in law, which are rewritten as optimization (minimization) of probability measures problem on the canonical space. We introduce a penalized version of this type of…

Optimization and Control · Mathematics 2025-03-18 Thibaut Bourdais , Nadia Oudjane , Francesco Russo

A dual control problem is presented for the optimal stochastic control of a system governed by partial differential equations. Relationships between the optimal values of the original and the dual problems are investigated and two duality…

Optimization and Control · Mathematics 2017-05-03 Shinji Tanimoto

Trajectory optimization is a fundamental stochastic optimal control problem. This paper deals with a trajectory optimization approach for dynamical systems subject to measurement noise that can be fitted into linear time-varying stochastic…

Systems and Control · Electrical Eng. & Systems 2021-08-24 Prakash Mallick , Zhiyong Chen

This work provides a Deep Reinforcement Learning approach to solving a periodic review inventory control system with stochastic vendor lead times, lost sales, correlated demand, and price matching. While this dynamic program has…

Machine Learning · Computer Science 2022-11-30 Dhruv Madeka , Kari Torkkola , Carson Eisenach , Anna Luo , Dean P. Foster , Sham M. Kakade

In this paper, we investigate the optimal output tracking problem for linear discrete-time systems with unknown dynamics using reinforcement learning and robust output regulation theory. This output tracking problem only allows to utilize…

Dynamical Systems · Mathematics 2021-01-22 Ci Chen , Lihua Xie , Yi Jiang , Kan Xie , Shengli Xie

The problem of optimal motion planing and control is fundamental in robotics. However, this problem is intractable for continuous-time stochastic systems in general and the solution is difficult to approximate if non-instantaneous nonlinear…

Robotics · Computer Science 2017-02-28 Mustafa Mukadam , Ching-An Cheng , Xinyan Yan , Byron Boots

This paper presents a method to approximately solve stochastic optimal control problems in which the cost function and the system dynamics are polynomial. For stochastic systems with polynomial dynamics, the moments of the state can be…

Optimization and Control · Mathematics 2017-02-24 Andrew Lamperski , Khem Raj Ghusinga , Abhyudai Singh

In this paper, stochastic optimal control problems in continuous time and space are considered. In recent years, such problems have received renewed attention from the lens of reinforcement learning (RL) which is also one of our motivation.…

Systems and Control · Electrical Eng. & Systems 2024-10-29 Anant A. Joshi , Amirhossein Taghvaei , Prashant G. Mehta , Sean P. Meyn

The paper investigates stochastic resource allocation problems with scarce, reusable resources and non-preemtive, time-dependent, interconnected tasks. This approach is a natural generalization of several standard resource management…

Machine Learning · Computer Science 2014-01-16 Balázs Csanád Csáji , László Monostori

We propose a function-learning methodology with a control-theoretical foundation. We parametrise the approximating function as the solution to a control system on a reproducing-kernel Hilbert space, and propose several methods to find the…

Optimization and Control · Mathematics 2024-06-18 Paolo Colusso , Damir Filipović

In this paper we are introducing a new reinforcement learning method for control problems in environments with delayed feedback. Specifically, our method employs stochastic planning, versus previous methods that used deterministic planning.…

Machine Learning · Computer Science 2024-02-02 Zhiyuan Yao , Ionut Florescu , Chihoon Lee

Most existing neural network-based approaches for solving stochastic optimal control problems using the associated backward dynamic programming principle rely on the ability to simulate the underlying state variables. However, in some…

Machine Learning · Statistics 2024-01-30 Christian Yeo

The goal of this paper is to solve a class of stochastic optimal control problems numerically, in which the state process is governed by an It\^o type stochastic differential equation with control process entering both in the drift and the…

Optimization and Control · Mathematics 2020-06-05 Richard Archibald , Feng Bao , Jiongmin Yong , Tao Zhou

Many real world stochastic control problems suffer from the "curse of dimensionality". To overcome this difficulty, we develop a deep learning approach that directly solves high-dimensional stochastic control problems based on Monte-Carlo…

Machine Learning · Computer Science 2016-11-23 Jiequn Han , Weinan E

This paper applies a reinforcement learning (RL) method to solve infinite horizon continuous-time stochastic linear quadratic problems, where drift and diffusion terms in the dynamics may depend on both the state and control. Based on…

Optimization and Control · Mathematics 2021-09-17 Na Li , Xun Li , Jing Peng , Zuo Quan Xu

Several researchers have recently investigated the connection between reinforcement learning and classification. We are motivated by proposals of approximate policy iteration schemes without value functions which focus on policy…

Machine Learning · Computer Science 2008-07-06 Christos Dimitrakakis , Michail G. Lagoudakis

Model predictive control solves a constrained optimization problem online in order to compute an implicit closed-loop control policy. Recursive feasibility -- guaranteeing that the optimal control problem will have a solution at every time…

Optimization and Control · Mathematics 2024-10-16 Jacob W. Knaup , Panagiotis Tsiotras