English
Related papers

Related papers: A Neural RDE approach for continuous-time non-Mark…

200 papers

Astronomical time series from large-scale surveys like LSST are often irregularly sampled and incomplete, posing challenges for classification and anomaly detection. We introduce a new framework based on Neural Stochastic Delay Differential…

Machine Learning · Computer Science 2026-04-03 YongKyung Oh , Seungsu Kam , Dong-Young Lim , Sungil Kim

Reinforcement learning (RL) is currently one of the most prominent methods for optimizing dynamical systems, with breakthrough results across various fields. The framework is based on the concept of a Markov decision process (MDP), leading…

Optimization and Control · Mathematics 2025-11-17 Rene Carmona , Mathieu Lauriere

Neural Ordinary Differential Equation (Neural ODE) has been proposed as a continuous approximation to the ResNet architecture. Some commonly used regularization mechanisms in discrete neural networks (e.g. dropout, Gaussian noise) are…

Machine Learning · Computer Science 2019-06-07 Xuanqing Liu , Tesi Xiao , Si Si , Qin Cao , Sanjiv Kumar , Cho-Jui Hsieh

In this article we show a robustness theorem for controlled stochastic differential equations driven by approximations of Brownian motion. Often, Brownian motion is used as an idealized model of a diffusion where approximations such as…

Optimization and Control · Mathematics 2023-12-07 Somnath Pradhan , Zachary Selk , Serdar Yüksel

Neural differential equations predict the derivative of a stochastic process. This allows irregular forecasting with arbitrary time-steps. However, the expressive temporal flexibility often comes with a high sensitivity to noise. In…

Machine Learning · Computer Science 2023-02-07 Stav Belogolovsky , Ido Greenberg , Danny Eitan , Shie Mannor

Recent low-thrust space missions have highlighted the importance of designing trajectories that are robust against uncertainties. In its complete form, this process is formulated as a nonlinear constrained stochastic optimal control…

Optimization and Control · Mathematics 2022-02-25 Naoya Ozaki , Stefano Campagnola , Ryu Funase

This paper presents an algorithm to solve non-convex optimal control problems, where non-convexity can arise from nonlinear dynamics, and non-convex state and control constraints. This paper assumes that the state and control constraints…

Optimization and Control · Mathematics 2017-05-05 Yuanqi Mao , Michael Szmuk , Behcet Acikmese

Discrete time stochastic optimal control problems and Markov decision processes (MDPs), respectively, serve as fundamental models for problems that involve sequential decision making under uncertainty and as such constitute the theoretical…

Optimization and Control · Mathematics 2023-03-08 Christian Beck , Arnulf Jentzen , Konrad Kleinberg , Thomas Kruse

We tackle high-dimensional, path-dependent valuation and control and introduce a deep BSDE/2BSDE solver that couples truncated log-signatures with a neural rough differential equation (RDE) backbone. The architecture aligns stochastic…

Mathematical Finance · Quantitative Finance 2025-11-04 Ali Atiah Alzahrani

This paper develops algorithms for high-dimensional stochastic control problems based on deep learning and dynamic programming. Unlike classical approximate dynamic programming approaches, we first approximate the optimal policy by means of…

Probability · Mathematics 2021-09-21 Côme Huré , Huyên Pham , Achref Bachouch , Nicolas Langrené

We unify and extend the semigroup and the PDE approaches to stochastic maximal regularity of time-dependent semilinear parabolic problems with noise given by a cylindrical Brownian motion. We treat random coefficients that are only…

Analysis of PDEs · Mathematics 2019-02-12 Pierre Portal , Mark Veraar

Model-based reinforcement learning (MBRL) approaches rely on discrete-time state transition models whereas physical systems and the vast majority of control tasks operate in continuous-time. To avoid time-discretization approximation of the…

Machine Learning · Computer Science 2021-06-14 Çağatay Yıldız , Markus Heinonen , Harri Lähdesmäki

In this paper we propose a new methodology for decision-making under uncertainty using recent advancements in the areas of nonlinear stochastic optimal control theory, applied mathematics, and machine learning. Grounded on the fundamental…

Robotics · Computer Science 2021-07-12 Marcus Pereira , Ziyi Wang , Ioannis Exarchos , Evangelos A. Theodorou

We consider a class of finite time horizon nonlinear stochastic optimal control problem, where the control acts additively on the dynamics and the control cost is quadratic. This framework is flexible and has found applications in many…

Optimization and Control · Mathematics 2023-04-26 Ajay Jasra , Jeremy Heng , Yaxian Xu , Adrian N. Bishop

This article proposes for stochastic partial differential equations (SPDEs) driven by additive noise, a novel approach for the approximate parameterizations of the ``small'' scales by the ``large'' ones, along with the derivaton of the…

Analysis of PDEs · Mathematics 2013-11-14 Mickaël D. Chekroun , Honghu Liu , Shouhong Wang

Optimal control problems naturally arise in many scientific applications where one wishes to steer a dynamical system from a certain initial state $\mathbf{x}_0$ to a desired target state $\mathbf{x}^*$ in finite time $T$. Recent advances…

Machine Learning · Computer Science 2022-09-20 Lucas Böttcher , Thomas Asikis

In this article, we present a general methodology for control problems driven by the Brownian motion filtration including non-Markovian and non-semimartingale state processes controlled by mutually singular measures. The main result of this…

Probability · Mathematics 2018-01-19 Dorival Leão , Alberto Ohashi , Francys Souza

We present a deep recurrent neural network architecture to solve a class of stochastic optimal control problems described by fully nonlinear Hamilton Jacobi Bellmanpartial differential equations. Such PDEs arise when one considers…

Machine Learning · Computer Science 2019-12-24 Marcus A Pereira , Ziyi Wang , Tianrong Chen , Emily Reed , Evangelos A Theodorou

This paper presents a continuous-time optimal control framework for the generation of reference trajectories in driving scenarios with uncertainty. A previous work presented a discrete-time stochastic generator for autonomous vehicles;…

Optimization and Control · Mathematics 2026-03-17 Ange Valli , Shangyuan Zhang , Abdel Lisser

We consider a discrete time stochastic Markovian control problem under model uncertainty. Such uncertainty not only comes from the fact that the true probability law of the underlying stochastic process is unknown, but the parametric family…

Optimization and Control · Mathematics 2022-03-23 Erhan Bayraktar , Tao Chen