English
Related papers

Related papers: Recurrent Neural Networks for Stochastic Control P…

200 papers

We consider numerical approaches for deterministic, finite-dimensional optimal control problems whose dynamics depend on unknown or uncertain parameters. We seek to amortize the solution over a set of relevant parameters in an offline stage…

Optimization and Control · Mathematics 2024-02-16 Deepanshu Verma , Nick Winovich , Lars Ruthotto , Bart van Bloemen Waanders

Traditional maximum entropy and sparsity-based algorithms for analytic continuation often suffer from the ill-posed kernel matrix or demand tremendous computation time for parameter tuning. Here we propose a neural network method by convex…

Machine Learning · Computer Science 2022-02-07 Dongchen Huang , Yi-feng Yang

This work theoretically studies stochastic neural networks, a main type of neural network in use. We prove that as the width of an optimized stochastic neural network tends to infinity, its predictive variance on the training set decreases…

Machine Learning · Computer Science 2022-05-25 Liu Ziyin , Hanlin Zhang , Xiangming Meng , Yuting Lu , Eric Xing , Masahito Ueda

Deep reinforcement learning has achieved many impressive results in recent years. However, tasks with sparse rewards or long horizons continue to pose significant challenges. To tackle these important problems, we propose a general…

Artificial Intelligence · Computer Science 2017-04-12 Carlos Florensa , Yan Duan , Pieter Abbeel

Networked Predictive Control is widely used to mitigate the effect of delays and dropouts in Networked Control Systems, particularly when these exceed the sampling time. A key design choice of these methods is the delay bound, which…

Systems and Control · Electrical Eng. & Systems 2026-05-18 Severin Beger , Yihui Lin , Katarina Stanojevic , Sandra Hirche

We study a class of infinite-horizon impulse control problems with execution delay in discrete time. Using probabilistic methods, particularly the notion of the Snell envelope of processes, we construct an optimal strategy among all…

Optimization and Control · Mathematics 2025-01-22 Said Hamadène , Boualem Djehiche

This paper investigates an optimal control problem where the system is described by a stochastic differential equation with extended mixed delays that contain point delay, extended distributed delay, and extended noisy memory. The model is…

Optimization and Control · Mathematics 2026-01-19 Xinpo Li , Jingtao Shi

Continuous-depth neural networks, such as Neural ODEs, have refashioned the understanding of residual neural networks in terms of non-linear vector-valued optimal control problems. The common solution is to use the adjoint sensitivity…

Machine Learning · Computer Science 2022-02-16 Andrew Corbett , Dmitry Kangin

This paper formulates a stochastic optimal control problem for linear networked control systems featuring stochastic packet disordering with a unique stabilizing solution certified. The problem is solved by proposing reinforcement learning…

Systems and Control · Electrical Eng. & Systems 2023-12-13 Wenqian Xue , Yi Jiang , Frank L. Lewis , Bosen Lian

Stochastic network optimization problems entail finding resource allocation policies that are optimum on an average but must be designed in an online fashion. Such problems are ubiquitous in communication networks, where resources such as…

Optimization and Control · Mathematics 2018-05-09 Amrit S. Bedi , Ketan Rajawat

We develop a probabilistic machine learning method, which formulates a class of stochastic neural networks by a stochastic optimal control problem. An efficient stochastic gradient descent algorithm is introduced under the stochastic…

Machine Learning · Computer Science 2021-04-06 Richard Archibald , Feng Bao , Yanzhao Cao , He Zhang

Control of complex systems involves both system identification and controller design. Deep neural networks have proven to be successful in many identification tasks, however, from model-based control perspective, these networks are…

Optimization and Control · Mathematics 2019-02-28 Yize Chen , Yuanyuan Shi , Baosen Zhang

Deep neural networks have recently achieved state of the art performance thanks to new training algorithms for rapid parameter estimation and new regularization methods to reduce overfitting. However, in practice the network architecture…

Machine Learning · Computer Science 2016-03-04 Minyoung Kim , Luca Rigazio

Learning-based control methods for industrial processes leverage the repetitive nature of the underlying process to learn optimal inputs for the system. While many works focus on linear systems, real-world problems involve nonlinear…

Systems and Control · Electrical Eng. & Systems 2023-07-25 Samuel Balula , Efe C. Balta , Dominic Liao-McPherson , Alisa Rupenyan , John Lygeros

In this paper, we propose a new methodology for state constrained stochastic optimal control (SOC) problems. The solution is based on past work in solving SOC problems using forward-backward stochastic differential equations (FBSDE). Our…

Systems and Control · Electrical Eng. & Systems 2021-04-07 Bolun Dai , Prashanth Krishnamurthy , Andrew Papanicolaou , Farshad Khorrami

Recurrent Neural Networks (RNNs) produce state-of-art performance on many machine learning tasks but their demand on resources in terms of memory and computational power are often high. Therefore, there is a great interest in optimizing the…

Neural and Evolutionary Computing · Computer Science 2017-02-28 Joachim Ott , Zhouhan Lin , Ying Zhang , Shih-Chii Liu , Yoshua Bengio

We develop a deep learning algorithm for constructing globally accurate approximations to functional rational expectations equilibria of dynamic stochastic economies in the sequence space. We use deep neural networks to parameterize key…

General Economics · Economics 2026-03-17 Marlon Azinovic-Yang , Jan Žemlička

The intersection of machine learning and dynamical systems has generated considerable interest recently. Neural Ordinary Differential Equations (NODEs) represent a rich overlap between these fields. In this paper, we develop a continuous…

Optimization and Control · Mathematics 2023-06-16 Maria Oprea , Mark Walth , Robert Stephany , Gabriella Torres Nothaft , Arnaldo Rodriguez-Gonzalez , William Clark

This thesis addresses the question of stability of systems defined by differential equations which contain nonlinearity and delay. In particular, we analyze the stability of a well-known delayed nonlinear implementation of a certain…

Dynamical Systems · Mathematics 2007-05-23 Matthew M. Peet

Randomized Neural Networks explore the behavior of neural systems where the majority of connections are fixed, either in a stochastic or a deterministic fashion. Typical examples of such systems consist of multi-layered neural network…

Machine Learning · Computer Science 2021-02-03 Claudio Gallicchio , Simone Scardapane