English
Related papers

Related papers: Neural Expectation Operators

200 papers

Neural operators have emerged as powerful tools for learning solution operators of partial differential equations. However, in time-dependent problems, standard training strategies such as teacher forcing introduce a mismatch between…

Machine Learning · Computer Science 2025-05-28 Zaijun Ye , Chen-Song Zhang , Wansheng Wang

The Koopman operator framework provides a perspective that non-linear dynamics can be described through the lens of linear operators acting on function spaces. As the framework naturally yields linear embedding models, there have been…

Optimization and Control · Mathematics 2024-12-09 Daisuke Uchida , Karthik Duraisamy

This paper studies the design of neural network (NN)-based controllers for unknown nonlinear systems, using contraction analysis. A Neural Ordinary Differential Equation (NODE) system is constructed by approximating the unknown draft…

Systems and Control · Electrical Eng. & Systems 2025-05-23 Hao Yin , Claudio De Persis , Bayu Jayawardhana , Santiago Sanchez Escalonilla Plaza

Backward stochastic differential equations (BSDEs) in the sense of Pardoux-Peng [Backward stochastic differential equations and quasilinear parabolic partial differential equations, Lecture Notes in Control and Inform. Sci., 176, 200--217,…

Probability · Mathematics 2010-08-03 Joscha Diehl , Peter Friz

Modeling uncertainty in deep neural networks, despite recent important advances, is still an open problem. Bayesian neural networks are a powerful solution, where the prior over network weights is a design choice, often a normal…

Machine Learning · Statistics 2019-10-29 Raanan Y. Rohekar , Yaniv Gurwicz , Shami Nisimov , Gal Novik

Real-world scientific applications frequently encounter incomplete observational data due to sensor limitations, geographic constraints, or measurement costs. Although neural operators significantly advanced PDE solving in terms of…

Machine Learning · Computer Science 2026-01-28 Jingren Hou , Hong Wang , Pengyu Xu , Chang Gao , Huafeng Liu , Liping Jing

In this paper, we introduce a new type of backward stochastic differential equations (BSDEs), called conditional expectation BSDEs, whose drivers depend not only on the value of the solutions but also on their conditional expectations with…

Probability · Mathematics 2026-04-27 Hanwu Li

This work formulates a new approach to reduced modeling of parameterized, time-dependent partial differential equations (PDEs). The method employs Operator Inference, a scientific machine learning framework combining data-driven learning…

Computational Engineering, Finance, and Science · Computer Science 2025-06-16 Shane A McQuarrie , Parisa Khodabakhshi , Karen E Willcox

Neural operators aim to approximate the solution operator of a system of differential equations purely from data. They have shown immense success in modeling complex dynamical systems across various domains. However, the occurrence of…

Machine Learning · Computer Science 2025-04-01 Christopher Bülte , Philipp Scholl , Gitta Kutyniok

Neural Ordinary Differential Equations (N-ODEs) are a powerful building block for learning systems, which extend residual networks to a continuous-time dynamical system. We propose a Bayesian version of N-ODEs that enables well-calibrated…

Machine Learning · Computer Science 2020-02-19 Andreas Look , Melih Kandemir

Ordinary and partial differential equations (ODEs/PDEs) play a paramount role in analyzing and simulating complex dynamic processes across all corners of science and engineering. In recent years machine learning tools are aspiring to…

Machine Learning · Computer Science 2021-06-11 Sifan Wang , Paris Perdikaris

This paper proposes a statistically optimal approach for learning a function value using a confidence interval in a wide range of models, including general non-parametric estimation of an expected loss described as a stochastic programming…

Machine Learning · Statistics 2025-08-07 Arnab Ganguly , Tobias Sutter

Semilinear parabolic partial differential equations (PDEs) are fundamental to modeling complex dynamical systems across scientific domains. The Deep Backward Stochastic Differential Equation (BSDE) method is a promising approach for…

Computational Engineering, Finance, and Science · Computer Science 2026-05-12 Xiaotao Zheng , Xingye Yue , Zhihong Xia , Xin Li

Although neural operators are widely used in data-driven physical simulations, their training remains computationally expensive. Recent advances address this issue via downstream learning, where a model pretrained on simpler problems is…

Machine Learning · Computer Science 2025-11-17 Mikhail Masliaev , Dmitry Gusarov , Ilya Markov , Alexander Hvatov

When the underlying conditional density is known, conditional expectations can be computed analytically or numerically. When, however, such knowledge is not available and instead we are given a collection of training data, the goal of this…

Machine Learning · Statistics 2024-07-19 George V. Moustakides

Inverse problems challenge existing neural operator architectures because ill-posed inverse maps violate continuity, uniqueness, and stability assumptions. We introduce B2B${}^{-1}$, an inverse basis-to-basis neural operator framework that…

Machine Learning · Computer Science 2025-12-23 Adam J. Thorpe , Stepan Tretiakov , Dibakar Roy Sarkar , Krishna Kumar , Ufuk Topcu

Neural operators have proven to be a promising approach for modeling spatiotemporal systems in the physical sciences. However, training these models for large systems can be quite challenging as they incur significant computational and…

Machine Learning · Computer Science 2023-12-12 Michael McCabe , Peter Harrington , Shashank Subramanian , Jed Brown

Recently, Neural Ordinary Differential Equations has emerged as a powerful framework for modeling physical simulations without explicitly defining the ODEs governing the system, but instead learning them via machine learning. However, the…

When neural networks (NNs) are used as a type of nonlinear parametric representation to solve partial differential equations (PDEs), they often display frequency-dependent learning dynamics that can differ from those seen in direct function…

Numerical Analysis · Mathematics 2026-03-03 Roy Y. He , Ying Liang , Hongkai Zhao , Yimin Zhong

Industrial design evaluation often relies on high-fidelity simulations of governing partial differential equations (PDEs). While accurate, these simulations are computationally expensive, making dense exploration of design spaces…

Machine Learning · Computer Science 2025-10-01 Zhizhou Zhang , Youjia Wu , Kaixuan Zhang , Yanjia Wang