English
Related papers

Related papers: A Constructive Approach to Function Realization by…

200 papers

The computational capabilities of a neural network are widely assumed to be determined by its static architecture. Here we challenge this view by establishing that a fixed neural structure can operate in fundamentally different…

Neural and Evolutionary Computing · Computer Science 2025-09-24 Xia Chen

Stochastic dual dynamic programming (SDDP) is a state-of-the-art method for solving multi-stage stochastic optimization, widely used for modeling real-world process optimization tasks. Unfortunately, SDDP has a worst-case complexity that…

Machine Learning · Computer Science 2021-12-03 Hanjun Dai , Yuan Xue , Zia Syed , Dale Schuurmans , Bo Dai

Multiscale stochastic dynamical systems have been widely adopted to a variety of scientific and engineering problems due to their capability of depicting complex phenomena in many real world applications. This work is devoted to…

Machine Learning · Statistics 2024-01-02 Lingyu Feng , Ting Gao , Min Dai , Jinqiao Duan

Stochastic differential equations provide a rich class of flexible generative models, capable of describing a wide range of spatio-temporal processes. A host of recent work looks to learn data-representing SDEs, using neural networks and…

Machine Learning · Statistics 2021-10-12 Scott Cameron , Tyron Cameron , Arnu Pretorius , Stephen Roberts

Discrete-time stochastic systems are an essential modelling tool for many engineering systems. We consider stochastic control systems that are evolving over continuous spaces. For this class of models, methods for the formal verification…

Systems and Control · Computer Science 2018-11-29 Sofie Haesaert , Sadegh Soudjani

Neural Stochastic Differential Equations (NSDE) have been trained as both Variational Autoencoders, and as GANs. However, the resulting Stochastic Differential Equations can be hard to interpret or analyse due to the generic nature of the…

Machine Learning · Computer Science 2022-11-18 Simon M. Koop , Mark A. Peletier , Jacobus W. Portegies , Vlado Menkovski

We address the reachability problem for continuous-time stochastic dynamic systems. Our objective is to present a unified framework that characterizes the reachable set of a dynamic system in the presence of both stochastic disturbances and…

Systems and Control · Electrical Eng. & Systems 2024-09-04 Saber Jafarpour , Zishun Liu , Yongxin Chen

This paper proposes an approach, Spectral Dynamics Embedding Control (SDEC), to optimal control for nonlinear stochastic systems. This method reveals an infinite-dimensional feature representation induced by the system's nonlinear…

Machine Learning · Computer Science 2025-08-27 Zhaolin Ren , Tongzheng Ren , Haitong Ma , Na Li , Bo Dai

This paper develops algorithms for high-dimensional stochastic control problems based on deep learning and dynamic programming. Unlike classical approximate dynamic programming approaches, we first approximate the optimal policy by means of…

Probability · Mathematics 2021-09-21 Côme Huré , Huyên Pham , Achref Bachouch , Nicolas Langrené

Neural differential equations predict the derivative of a stochastic process. This allows irregular forecasting with arbitrary time-steps. However, the expressive temporal flexibility often comes with a high sensitivity to noise. In…

Machine Learning · Computer Science 2023-02-07 Stav Belogolovsky , Ido Greenberg , Danny Eitan , Shie Mannor

Stochastic differential equations (sdes) play an important role in physics but existing numerical methods for solving such equations are of low accuracy and poor stability. A general strategy for developing accurate and efficient schemes…

Quantum Physics · Physics 2009-11-10 Joshua Wilkie

Many successful methods to learn dynamical systems from data have recently been introduced. However, ensuring that the inferred dynamics preserve known constraints, such as conservation laws or restrictions on the allowed system states,…

Machine Learning · Computer Science 2024-02-16 Alistair White , Niki Kilbertus , Maximilian Gelbrecht , Niklas Boers

We design and analyse a new numerical method to solve ODE system based on the structural method. We compute approximations of solutions together with its derivatives up to order $K$ by solving an entire block corresponding to $R$ time…

Numerical Analysis · Mathematics 2025-08-05 S. Clain , M. T. Malheiro , G. J. Machado , R. Costa

Most existing neural network-based approaches for solving stochastic optimal control problems using the associated backward dynamic programming principle rely on the ability to simulate the underlying state variables. However, in some…

Machine Learning · Statistics 2024-01-30 Christian Yeo

Dynamical systems that are subject to continuous uncertain fluctuations can be modelled using Stochastic Differential Equations (SDEs). Controlling such system results in solving path constrained SDEs. Broadly, these problems fall under the…

Optimization and Control · Mathematics 2023-06-16 Sumit Suthar , Soumyendu Raha

Stochastic regularization of neural networks (e.g. dropout) is a wide-spread technique in deep learning that allows for better generalization. Despite its success, continuous-time models, such as neural ordinary differential equation (ODE),…

Machine Learning · Computer Science 2020-06-29 Viktor Oganesyan , Alexandra Volokhova , Dmitry Vetrov

This paper considers an optimization problem for a dynamical system whose evolution depends on a collection of binary decision variables. We develop scalable approximation algorithms with provable suboptimality bounds to provide…

Optimization and Control · Mathematics 2016-10-31 Insoon Yang , Samuel A. Burden , Ram Rajagopal , S. Shankar Sastry , Claire J. Tomlin

Stochastic partial differential equations (SPDEs) are the mathematical tool of choice for modelling spatiotemporal PDE-dynamics under the influence of randomness. Based on the notion of mild solution of an SPDE, we introduce a novel neural…

Machine Learning · Computer Science 2022-09-27 Cristopher Salvi , Maud Lemercier , Andris Gerasimovics

We study the use of Temporal-Difference learning for estimating the structural parameters in dynamic discrete choice models. Our algorithms are based on the conditional choice probability approach but use functional approximations to…

Econometrics · Economics 2022-12-23 Karun Adusumilli , Dita Eckardt

We consider the problem of approximating flow functions of continuous-time dynamical systems with inputs. It is well-known that continuous-time recurrent neural networks are universal approximators of this type of system. In this paper, we…

Systems and Control · Electrical Eng. & Systems 2023-09-20 Miguel Aguiar , Amritam Das , Karl H. Johansson