English
Related papers

Related papers: Neural Expectation Operators

200 papers

Neural PDE solvers are often described as learning solution operators that map problem data to PDE solutions. In this work, we argue that this interpretation is generally incorrect when boundary conditions vary. We show that standard neural…

Machine Learning · Computer Science 2026-05-21 Lennon J. Shikhman

We consider a stochastic control problem for a class of nonlinear kernels. More precisely, our problem of interest consists in the optimisation, over a set of possibly non-dominated probability measures, of solutions of backward stochastic…

Probability · Mathematics 2017-07-28 Dylan Possamaï , Xiaolu Tan , Chao Zhou

Implicit neural networks, a.k.a., deep equilibrium networks, are a class of implicit-depth learning models where function evaluation is performed by solving a fixed point equation. They generalize classic feedforward models and are…

Machine Learning · Computer Science 2022-01-27 Saber Jafarpour , Alexander Davydov , Anton V. Proskurnikov , Francesco Bullo

We take advantage of recent and new results on optimal quantization theory to improve the quadratic optimal quantization error bounds for backward stochastic differential equations (BSDE) and nonlinear filtering problems. For both problems,…

Probability · Mathematics 2017-07-26 Gilles Pagès

Learning underlying dynamics from data is important and challenging in many real-world scenarios. Incorporating differential equations (DEs) to design continuous networks has drawn much attention recently, however, most prior works make…

Machine Learning · Computer Science 2023-02-03 Yesom Park , Jaemoo Choi , Changyeon Yoon , Chang hoon Song , Myungjoo Kang

DeepONets have recently been proposed as a framework for learning nonlinear operators mapping between infinite dimensional Banach spaces. We analyze DeepONets and prove estimates on the resulting approximation and generalization errors. In…

Numerical Analysis · Mathematics 2022-01-14 Samuel Lanthaler , Siddhartha Mishra , George Em Karniadakis

Operator regression provides a powerful means of constructing discretization-invariant emulators for partial-differential equations (PDEs) describing physical systems. Neural operators specifically employ deep neural networks to approximate…

Machine Learning · Computer Science 2023-04-18 Katiana Kontolati , Somdatta Goswami , George Em Karniadakis , Michael D. Shields

Generative neural networks have been empirically found very promising in providing effective structural priors for compressed sensing, since they can be trained to span low-dimensional data manifolds in high-dimensional signal spaces.…

Information Theory · Computer Science 2020-06-29 Constantinos Daskalakis , Dhruv Rohatgi , Manolis Zampetakis

We analyze Neural Ordinary Differential Equations (NODEs) from a control theoretical perspective to address some of the main properties and paradigms of Deep Learning (DL), in particular, data classification and universal approximation.…

Optimization and Control · Mathematics 2021-04-13 Domènec Ruiz-Balet , Enrique Zuazua

The classical development of neural networks has primarily focused on learning mappings between finite dimensional Euclidean spaces or finite sets. We propose a generalization of neural networks to learn operators, termed neural operators,…

Recent advances in the theory of Neural Operators (NOs) have enabled fast and accurate computation of the solutions to complex systems described by partial differential equations (PDEs). Despite their great success, current NO-based…

Machine Learning · Computer Science 2024-03-18 Ashutosh Singh , Ricardo Augusto Borsoi , Deniz Erdogmus , Tales Imbiriba

Neural oscillators that originate from second-order ordinary differential equations (ODEs) have shown competitive performance in learning mappings between dynamic loads and responses of complex nonlinear structural systems. Despite this…

Machine Learning · Computer Science 2026-05-11 Zifeng Huang , Konstantin M. Zuev , Yong Xia , Michael Beer

We present Neural Autoregressive Distribution Estimation (NADE) models, which are neural network architectures applied to the problem of unsupervised distribution and density estimation. They leverage the probability product rule and a…

Machine Learning · Computer Science 2016-05-30 Benigno Uria , Marc-Alexandre Côté , Karol Gregor , Iain Murray , Hugo Larochelle

We present a new scientific machine learning method that learns from data a computationally inexpensive surrogate model for predicting the evolution of a system governed by a time-dependent nonlinear partial differential equation (PDE), an…

Numerical Analysis · Mathematics 2022-02-28 Elizabeth Qian , Ionut-Gabriel Farcas , Karen Willcox

Neural operators, as an efficient surrogate model for learning the solutions of PDEs, have received extensive attention in the field of scientific machine learning. Among them, attention-based neural operators have become one of the…

Machine Learning · Computer Science 2024-12-30 Zipeng Xiao , Zhongkai Hao , Bokai Lin , Zhijie Deng , Hang Su

Operator learning has emerged as a powerful tool in scientific computing for approximating mappings between infinite-dimensional function spaces. A primary application of operator learning is the development of surrogate models for the…

Machine Learning · Statistics 2025-04-07 Unique Subedi , Ambuj Tewari

In this work, we present the first stability results for approximate predictors in multi-input non-linear systems with distinct actuation delays. We show that if the predictor approximation satisfies a uniform (in time) error bound,…

Systems and Control · Electrical Eng. & Systems 2025-09-23 Filip Bajraktari , Luke Bhan , Miroslav Krstic , Yuanyuan Shi

Learning probabilistic surrogates for partial differential equations remains challenging in data-scarce regimes: neural operators require large amounts of high-fidelity data, while generative approaches typically sacrifice resolution…

Computation · Statistics 2025-12-18 Sahil Bhola , Karthik Duraisamy

Neural networks can be used to learn the solution of partial differential equations (PDEs) on arbitrary domains without requiring a computational mesh. Common approaches integrate differential operators in training neural networks using a…

Machine Learning · Computer Science 2022-07-07 Shamsulhaq Basir , Inanc Senocak

In this paper we study a class of infinite horizon fully coupled forward-backward stochastic differential equations (FBSDEs), that are stimulated by various continuous time future expectations models with random coefficients. Under standard…

Probability · Mathematics 2016-09-29 Xanthi-Isidora Kartala , Nikolaos Englezos , Athanasios N. Yannacopoulos