English
Related papers

Related papers: Learning Deep Stochastic Optimal Control Policies …

200 papers

Physical systems whose dynamics are governed by partial differential equations (PDEs) find applications in numerous fields, from engineering design to weather forecasting. The process of obtaining the solution from such PDEs may be…

Machine Learning · Computer Science 2022-09-21 Pratyush Bhatt , Yash Kumar , Azzeddine Soulaimani

We develop policy gradients methods for stochastic control with exit time in a model-free setting. We propose two types of algorithms for learning either directly the optimal policy or by learning alternately the value function (critic) and…

Computational Finance · Quantitative Finance 2023-02-16 Mohamed Hamdouche , Pierre Henry-Labordere , Huyen Pham

Backward reachability (also termed controllability) has been extensively studied in control theory, and tools for a wide class of systems have been developed. Nevertheless, assessing a backward reachability analysis or synthesis remains…

Optimization and Control · Mathematics 2021-09-13 Davide Liuzza , Paolo Falcone , Massimo Tipaldi , Luigi Glielmo

Integrating measurements and historical data can enhance control systems through learning-based techniques, but ensuring performance and safety is challenging. Robust model predictive control strategies, like stochastic model predictive…

Systems and Control · Electrical Eng. & Systems 2023-03-28 J. Pohlodek , H. Alsmeier , B. Morabito , C. Schlauch , A. Savchenko , R. Findeisen

This letter proposes a deep neural network (DNN)-based neuro-adaptive sliding mode control (SMC) strategy for leader-follower tracking in multi-agent systems with higher-order, heterogeneous, nonlinear, and unknown dynamics under external…

Systems and Control · Electrical Eng. & Systems 2025-07-30 Khushal Chaudhari , Krishanu Nath , Manas Kumar Bera

We consider the joint design and control of discrete-time stochastic dynamical systems over a finite time horizon. We formulate the problem as a multi-step optimization problem under uncertainty seeking to identify a system design and a…

Machine Learning · Computer Science 2022-01-07 Adrien Bolland , Ioannis Boukas , Mathias Berger , Damien Ernst

Deterministic and Stochastic techniques in Deep Reinforcement Learning (Deep-RL) have become a promising solution to improve motion control and the decision-making tasks for a wide variety of robots. Previous works showed that these Deep-RL…

In this work, we present a novel forward differential deep learning-based algorithm for solving high-dimensional nonlinear backward stochastic differential equations (BSDEs). Motivated by the fact that differential deep learning can…

Numerical Analysis · Mathematics 2024-08-13 Lorenc Kapllani , Long Teng

We propose a new multistep deep learning-based algorithm for the resolution of moderate to high dimensional nonlinear backward stochastic differential equations (BSDEs) and their corresponding parabolic partial differential equations (PDE).…

Numerical Analysis · Mathematics 2023-08-29 Daniel Bussell , Camilo Andrés García-Trillos

We consider numerical approaches for deterministic, finite-dimensional optimal control problems whose dynamics depend on unknown or uncertain parameters. We seek to amortize the solution over a set of relevant parameters in an offline stage…

Optimization and Control · Mathematics 2024-02-16 Deepanshu Verma , Nick Winovich , Lars Ruthotto , Bart van Bloemen Waanders

We propose the use of Bayesian networks, which provide both a mean value and an uncertainty estimate as output, to enhance the safety of learned control policies under circumstances in which a test-time input differs significantly from the…

Machine Learning · Computer Science 2019-02-18 Keuntaek Lee , Kamil Saigol , Evangelos A. Theodorou

We study how to safely control nonlinear control-affine systems that are corrupted with bounded non-stochastic noise, i.e., noise that is unknown a priori and that is not necessarily governed by a stochastic model. We focus on safety…

Systems and Control · Electrical Eng. & Systems 2024-12-11 Hongyu Zhou , Yichen Song , Vasileios Tzoumas

Stochastic nonlinear dynamical systems are ubiquitous in modern, real-world applications. Yet, estimating the unknown parameters of stochastic, nonlinear dynamical models remains a challenging problem. The majority of existing methods…

Machine Learning · Statistics 2022-05-06 Anubhab Ghosh , Mohamed Abdalmoaty , Saikat Chatterjee , Håkan Hjalmarsson

Optimal and safety-critical control are fundamental problems for stochastic systems, and are widely considered in real-world scenarios such as robotic manipulation and autonomous driving. In this paper, we consider the problem of…

Systems and Control · Electrical Eng. & Systems 2024-05-10 Zhuoyuan Wang , Reece Keller , Xiyu Deng , Kenta Hoshino , Takashi Tanaka , Yorie Nakahira

A prominent challenge to the safe and optimal operation of the modern power grid arises due to growing uncertainties in loads and renewables. Stochastic optimal power flow (SOPF) formulations provide a mechanism to handle these…

Optimization and Control · Mathematics 2021-12-07 Sarthak Gupta , Sidhant Misra , Deepjyoti Deka , Vassilis Kekatos

Forecasting physical signals in long time range is among the most challenging tasks in Partial Differential Equations (PDEs) research. To circumvent limitations of traditional solvers, many different Deep Learning methods have been…

Machine Learning · Computer Science 2023-06-09 Leon Migus , Julien Salomon , Patrick Gallinari

Minimax optimization problems have attracted a lot of attention over the past few years, with applications ranging from economics to machine learning. While advanced optimization methods exist for such problems, characterizing their…

Machine Learning · Computer Science 2024-02-21 Enea Monzio Compagnoni , Antonio Orvieto , Hans Kersting , Frank Norbert Proske , Aurelien Lucchi

In this paper, we investigate the controlled system described by forward-backward stochastic differential equations with the control contained in drift, diffusion and generator of BSDE. A new verification theorem is derived within the…

Optimization and Control · Mathematics 2012-05-28 Liangquan Zhang

This paper studies the robust optimal control design for uncertain nonlinear systems from a perspective of robust adaptive dynamic programming (robust-ADP). The objective is to fill up a gap in the past literature of ADP where dynamic…

Dynamical Systems · Mathematics 2013-03-12 Yu Jiang , Zhong-Ping Jiang

We introduce a novel approach to options trading strategies using a highly scalable and data-driven machine learning algorithm. In contrast to traditional approaches that often require specifications of underlying market dynamics or…

Portfolio Management · Quantitative Finance 2024-11-22 Wee Ling Tan , Stephen Roberts , Stefan Zohren