English
Related papers

Related papers: Deep BSDE-ML Learning and Its Application to Model…

200 papers

In this study, we develop a stochastic optimal control approach with reinforcement learning structure to learn the unknown parameters appeared in the drift and diffusion terms of the stochastic differential equation. By choosing an…

Optimization and Control · Mathematics 2023-08-22 Shuzhen Yang

We consider data-driven Bayesian state estimation from compressed measurements (BSCM) of a model-free process. The dimension of the temporal measurement vector is lower than that of the temporal state vector to be estimated, leading to an…

Signal Processing · Electrical Eng. & Systems 2026-04-28 Anubhab Ghosh , Yonina C. Eldar , Saikat Chatterjee

Continuous-time approximation of Stochastic Gradient Descent (SGD) is a crucial tool to study its escaping behaviors from stationary points. However, existing stochastic differential equation (SDE) models fail to fully capture these…

Machine Learning · Statistics 2025-06-04 Xiang Li , Zebang Shen , Liang Zhang , Niao He

This paper investigates optimal control problems for delayed systems governed by Infinitely Anticipated Backward Stochastic Differential Equations (IABSDEs). Unlike existing frameworks limited to bounded delays, we introduce a generalized…

Optimization and Control · Mathematics 2025-12-22 Guanwei Cheng

We propose a new method for the numerical solution of the forward-backward stochastic differential equations (FBSDE) appearing in the Feynman-Kac representation of the value function in stochastic optimal control problems. Using Girsanov's…

Optimization and Control · Mathematics 2022-10-20 Kelsey P. Hawkins , Ali Pakniyat , Evangelos Theodorou , Panagiotis Tsiotras

Modeling and controlling complex spatiotemporal dynamical systems driven by partial differential equations (PDEs) often necessitate dimensionality reduction techniques to construct lower-order models for computational efficiency. This paper…

Systems and Control · Electrical Eng. & Systems 2024-09-12 Priyabrata Saha , Saibal Mukhopadhyay

We study optimal control for mean-field forward backward stochastic differential equations with payoff functionals of mean-field type. Sufficient and necessary optimality conditions in terms of a stochastic maximum principle are derived. As…

Optimization and Control · Mathematics 2019-05-14 Nacira Agram , Salah Eddine Choutri

In recent years, model-agnostic meta-learning (MAML) has become a popular research area. However, the stochastic optimization of MAML is still underdeveloped. Existing MAML algorithms rely on the ``episode'' idea by sampling a few tasks and…

Machine Learning · Computer Science 2023-04-26 Bokun Wang , Zhuoning Yuan , Yiming Ying , Tianbao Yang

Predictive models that accurately emulate complex scientific processes can achieve exponential speed-ups over numerical simulators or experiments, and at the same time provide surrogates for improving the subsequent analysis. Consequently,…

In this paper we study, by probabilistic techniques, the convergence of the value function for a two-scale, infinite-dimensional, stochastic controlled system as the ratio between the two evolution speeds diverges. The value function is…

Optimization and Control · Mathematics 2018-09-12 Giuseppina Guatteri , Gianmario Tessitore

We extend the methodology in [Yang et al., 2023] to learn autonomous continuous-time dynamical systems from invariant measures. The highlight of our approach is to reformulate the inverse problem of learning ODEs or SDEs from data as a…

Dynamical Systems · Mathematics 2023-07-06 Jonah Botvinick-Greenhouse , Robert Martin , Yunan Yang

A fundamental challenge in Deep Learning is to find optimal step sizes for stochastic gradient descent automatically. In traditional optimization, line searches are a commonly used method to determine step sizes. One problem in Deep…

Machine Learning · Computer Science 2022-02-22 Maximus Mutschler , Kevin Laube , Andreas Zell

In this paper, we establish the ordinary differential equation (ODE) that underlies the training dynamics of Model-Agnostic Meta-Learning (MAML). Our continuous-time limit view of the process eliminates the influence of the manually chosen…

Machine Learning · Statistics 2020-07-09 Ruitu Xu , Lin Chen , Amin Karbasi

Distance Metric Learning (DML) seeks to learn a discriminative embedding where similar examples are closer, and dissimilar examples are apart. In this paper, we address the problem of Semi-Supervised DML (SSDML) that tries to learn a metric…

Machine Learning · Computer Science 2021-05-12 Ujjal Kr Dutta , Mehrtash Harandi , Chellu Chandra Sekhar

Time-synchronized state estimation is a challenge for distribution systems because of limited real-time observability. This paper addresses this challenge by formulating a deep learning (DL)-based approach to perform unbalanced three-phase…

Machine Learning · Computer Science 2021-02-11 Behrouz Azimian , Reetam Sen Biswas , Anamitra Pal , Lang Tong

Autoregressive next-step prediction models have become the de-facto standard for building data-driven neural solvers to forecast time-dependent partial differential equations (PDEs). Denoise training that is closely related to diffusion…

Machine Learning · Computer Science 2025-03-31 Zijie Li , Anthony Zhou , Amir Barati Farimani

Design of process control scheme is critical for quality assurance to reduce variations in manufacturing systems. Taking semiconductor manufacturing as an example, extensive literature focuses on control optimization based on certain…

Machine Learning · Computer Science 2023-09-19 Yanrong Li , Juan Du , Wei Jiang

Robust control of complex engineered and biological systems hinges on the integration of feedforward and feedback mechanisms. This is exemplified in neural motor control, where feedforward muscle co-contraction complements sensory-driven…

Optimization and Control · Mathematics 2026-03-06 Bastien Berret , Frédéric Jean

This paper is concerned with a linear-quadratic (LQ, for short) optimal control problem for backward stochastic differential equations (BSDEs, for short), where the coefficients of the backward control system and the weighting matrices in…

Optimization and Control · Mathematics 2021-05-14 Jingrui Sun , Hanxiao Wang

In recent years, deep learning has proven to be a viable methodology for surrogate modeling and uncertainty quantification for a vast number of physical systems. However, in their traditional form, such models can require a large amount of…

Computational Physics · Physics 2019-12-04 Nicholas Geneva , Nicholas Zabaras