English
Related papers

Related papers: Learning Deep Stochastic Optimal Control Policies …

200 papers

This paper explores the use of deep neural networks for semiparametric estimation of economic models of maximizing behavior in production or discrete choice. We argue that certain deep networks are particularly well suited as a…

Econometrics · Economics 2022-04-06 Konrad Menzel

Sophisticated multilayer neural networks have achieved state of the art results on multiple supervised tasks. However, successful applications of such multilayer networks to control have so far been limited largely to the perception portion…

Machine Learning · Computer Science 2013-11-08 Sergey Levine

We introduce a differentiable framework for zero-shot adaptive control over parametric families of nonlinear dynamical systems. Our approach integrates a function encoder-based neural ODE (FE-NODE) for modeling system dynamics with a…

Systems and Control · Electrical Eng. & Systems 2026-04-16 Hassan Iqbal , Xingjian Li , Tyler Ingebrand , Adam Thorpe , Krishna Kumar , Ufuk Topcu , Ján Drgoňa

Correlated with the trend of increasing degrees of freedom in robotic systems is a similar trend of rising interest in Spatio-Temporal systems described by Partial Differential Equations (PDEs) among the robotics and control communities.…

Robotics · Computer Science 2021-02-19 Ethan N. Evans , Andrew P. Kendall , Evangelos A. Theodorou

Data-enabled predictive control (DeePC) is a data-driven control algorithm that utilizes data matrices to form a non-parametric representation of the underlying system, predicting future behaviors and generating optimal control actions.…

Systems and Control · Electrical Eng. & Systems 2024-10-18 Xuewen Zhang , Kaixiang Zhang , Zhaojian Li , Xunyuan Yin

The effectiveness of many optimal network control algorithms (e.g., BackPressure) relies on the premise that all of the nodes are fully controllable. However, these algorithms may yield poor performance in a partially-controllable network…

Networking and Internet Architecture · Computer Science 2019-01-08 Qingkai Liang , Eytan Modiano

We study methods for solving stochastic control problems of systems of forward-backward mean-field equations with delay, in finite or infinite horizon. Necessary and sufficient maximum principles under partial information are given. The…

Optimization and Control · Mathematics 2016-10-31 Nacira Agram , Elin Engen Rose

This paper presents a distributed model predictive control (DMPC) scheme for nonlinear continuous-time systems. The underlying distributed optimal control problem is cooperatively solved in parallel via a sensitivity-based algorithm. The…

Optimization and Control · Mathematics 2024-06-06 Maximilian Pierer von Esch , Andreas Völz , Knut Graichen

Learning a stable Linear Dynamical System (LDS) from data involves creating models that both minimize reconstruction error and enforce stability of the learned representation. We propose a novel algorithm for learning stable LDSs. Using a…

Machine Learning · Computer Science 2020-11-19 Giorgos Mamakoukas , Orest Xherija , T. D. Murphey

When designing controllers for safety-critical systems, practitioners often face a challenging tradeoff between robustness and performance. While robust control methods provide rigorous guarantees on system stability under certain…

Machine Learning · Computer Science 2021-04-27 Priya L. Donti , Melrose Roderick , Mahyar Fazlyab , J. Zico Kolter

Multistage stochastic programming provides a modeling framework for sequential decision-making problems that involve uncertainty. One typically overlooked aspect of this methodology is how uncertainty is incorporated into modeling.…

Optimization and Control · Mathematics 2021-09-24 Juyoung Wang , Mucahit Cevik , Merve Bodur

In this work, we extend deep learning-based numerical methods to fully coupled forward-backward stochastic differential equations (FBSDEs) within a non-Markovian framework. Error estimates and convergence are provided. In contrast to the…

Mathematical Finance · Quantitative Finance 2025-11-25 Hasib Uddin Molla , Matthew Backhouse , Ankit Banarjee , Jinniao Qiu

To better understand and improve the behavior of neural networks, a recent line of works bridged the connection between ordinary differential equations (ODEs) and deep neural networks (DNNs). The connections are made in two folds: (1) View…

Machine Learning · Computer Science 2019-11-05 Xinshi Chen

In recent years, deep learning has proven to be a viable methodology for surrogate modeling and uncertainty quantification for a vast number of physical systems. However, in their traditional form, such models can require a large amount of…

Computational Physics · Physics 2019-12-04 Nicholas Geneva , Nicholas Zabaras

State-space models (SSMs) offer a powerful framework for dynamical system analysis, wherein the temporal dynamics of the system are assumed to be captured through the evolution of the latent states, which govern the values of the…

Machine Learning · Statistics 2024-12-17 Jiahe Lin , George Michailidis

Despite the notable success of deep neural networks (DNNs) in solving complex tasks, the training process still remains considerable challenges. A primary obstacle is the substantial time required for training, particularly as high…

Machine Learning · Computer Science 2025-09-09 Viet Hoang Pham , Hyo-Sung Ahn

We systematically develop a learning-based treatment of stochastic optimal control (SOC), relying on direct optimization of parametric control policies. We propose a derivation of adjoint sensitivity results for stochastic differential…

Machine Learning · Computer Science 2021-06-08 Stefano Massaroli , Michael Poli , Stefano Peluchetti , Jinkyoo Park , Atsushi Yamashita , Hajime Asama

Deep unrolling, or unfolding, is an emerging learning-to-optimize method that unrolls a truncated iterative algorithm in the layers of a trainable neural network. However, the convergence guarantees and generalizability of the unrolled…

Machine Learning · Computer Science 2024-12-02 Samar Hadou , Navid NaderiAlizadeh , Alejandro Ribeiro

We consider the problem of controlling a possibly unknown linear dynamical system with adversarial perturbations, adversarially chosen convex loss functions, and partially observed states, known as non-stochastic control. We introduce a…

Machine Learning · Computer Science 2020-06-26 Max Simchowitz , Karan Singh , Elad Hazan

Decision making algorithms are used in a multitude of different applications. Conventional approaches for designing decision algorithms employ principled and simplified modelling, based on which one can determine decisions via tractable…

Signal Processing · Electrical Eng. & Systems 2022-06-23 Nir Shlezinger , Yonina C. Eldar , Stephen P. Boyd