English
Related papers

Related papers: Deep Reinforcement Learning for Online Control of …

200 papers

In this study, we develop a stochastic optimal control approach with reinforcement learning structure to learn the unknown parameters appeared in the drift and diffusion terms of the stochastic differential equation. By choosing an…

Optimization and Control · Mathematics 2023-08-22 Shuzhen Yang

In this paper, we aim to solve the high dimensional stochastic optimal control problem from the view of the stochastic maximum principle via deep learning. By introducing the extended Hamiltonian system which is essentially an FBSDE with a…

Optimization and Control · Mathematics 2021-06-23 Shaolin Ji , Shige Peng , Ying Peng , Xichuan Zhang

Considering generating samples with high rewards, we focus on optimizing deep neural networks parameterized stochastic differential equations (SDEs), the advanced generative models with high expressiveness, with policy gradient, the leading…

Machine Learning · Computer Science 2024-06-27 Xiangxin Zhou , Liang Wang , Yichi Zhou

Learning the evolutionary dynamics of Partial Differential Equations (PDEs) is critical in understanding dynamic systems, yet current methods insufficiently learn their representations. This is largely due to the multi-scale nature of the…

Machine Learning · Computer Science 2024-10-16 Aoming Liang , Zhaoyang Mu , Pengxiao Lin , Cong Wang , Mingming Ge , Ling Shao , Dixia Fan , Hao Tang

Developing algorithms for solving high-dimensional partial differential equations (PDEs) has been an exceedingly difficult task for a long time, due to the notoriously difficult problem known as the "curse of dimensionality". This paper…

Numerical Analysis · Mathematics 2020-07-17 Jiequn Han , Arnulf Jentzen , Weinan E

We describe a new approach for managing aleatoric uncertainty in the Reinforcement Learning (RL) paradigm. Instead of selecting actions according to a single statistic, we propose a distributional method based on the second-order stochastic…

Machine Learning · Computer Science 2020-10-08 John D. Martin , Michal Lyskawinski , Xiaohu Li , Brendan Englot

In this paper we are introducing a new reinforcement learning method for control problems in environments with delayed feedback. Specifically, our method employs stochastic planning, versus previous methods that used deterministic planning.…

Machine Learning · Computer Science 2024-02-02 Zhiyuan Yao , Ionut Florescu , Chihoon Lee

The problem of synthesizing stochastic explicit model predictive control policies is known to be quickly intractable even for systems of modest complexity when using classical control-theoretic methods. To address this challenge, we present…

Machine Learning · Computer Science 2022-05-24 Ján Drgoňa , Sayak Mukherjee , Aaron Tuor , Mahantesh Halappanavar , Draguna Vrabie

Harnessing data to discover the underlying governing laws or equations that describe the behavior of complex physical systems can significantly advance our modeling, simulation and understanding of such systems in various science and…

Machine Learning · Computer Science 2021-11-17 Zhao Chen , Yang Liu , Hao Sun

Partial differential equation (PDE)-constrained optimization arises in many scientific and engineering domains, such as energy systems, fluid dynamics and material design. In these problems, the decision variables (e.g., control inputs or…

Machine Learning · Computer Science 2026-01-21 Yusuf Guven , Vincenzo Di Vito , Ferdinando Fioretto

We study the problem of optimal inside control of an SPDE (a stochastic evolution equation) driven by a Brownian motion and a Poisson random measure. Our optimal control problem is new in two ways: (i) The controller has access to inside…

Optimization and Control · Mathematics 2016-08-31 Olfa Draouil , Bernt Øksendal

We study reinforcement learning for controlled diffusion processes with unbounded continuous state spaces, bounded continuous actions, and polynomially growing rewards: settings that arise naturally in finance, economics, and operations…

Machine Learning · Computer Science 2025-12-18 Hanqing Jin , Renyuan Xu , Yanzhao Yang

Modeling and controlling complex spatiotemporal dynamical systems driven by partial differential equations (PDEs) often necessitate dimensionality reduction techniques to construct lower-order models for computational efficiency. This paper…

Systems and Control · Electrical Eng. & Systems 2024-09-12 Priyabrata Saha , Saibal Mukhopadhyay

Applications in quantitative finance such as optimal trade execution, risk management of options, and optimal asset allocation involve the solution of high dimensional and nonlinear Partial Differential Equations (PDEs). The connection…

Machine Learning · Statistics 2019-10-28 Batuhan Güler , Alexis Laignelet , Panos Parpas

We consider the joint design and control of discrete-time stochastic dynamical systems over a finite time horizon. We formulate the problem as a multi-step optimization problem under uncertainty seeking to identify a system design and a…

Machine Learning · Computer Science 2022-01-07 Adrien Bolland , Ioannis Boukas , Mathias Berger , Damien Ernst

In recent years, deep learning has proven to be a viable methodology for surrogate modeling and uncertainty quantification for a vast number of physical systems. However, in their traditional form, such models can require a large amount of…

Computational Physics · Physics 2019-12-04 Nicholas Geneva , Nicholas Zabaras

In this paper,we mainly focus on the numerical solution of high-dimensional stochastic optimal control problem driven by fully-coupled forward-backward stochastic differential equations (FBSDEs in short) through deep learning. We first…

Optimization and Control · Mathematics 2024-08-21 Shaolin Ji , Shige Peng , Ying Peng , Xichuan Zhang

This work describes a technique for active rejection of multiple independent and time-correlated stochastic disturbances for a nonlinear flexible inverted pendulum with cart system with uncertain model parameters. The control law is…

Systems and Control · Electrical Eng. & Systems 2024-04-09 Vincent W. Hill

Optimal control of parametric partial differential equations (PDEs) is crucial in many applications in engineering and science. In recent years, the progress in scientific machine learning has opened up new frontiers for the control of…

Machine Learning · Computer Science 2024-10-10 Nicolò Botteghi , Urban Fasel

Stochastic partial differential equations (SPDEs) are the mathematical tool of choice for modelling spatiotemporal PDE-dynamics under the influence of randomness. Based on the notion of mild solution of an SPDE, we introduce a novel neural…

Machine Learning · Computer Science 2022-09-27 Cristopher Salvi , Maud Lemercier , Andris Gerasimovics