English
Related papers

Related papers: Operator Learning: A Statistical Perspective

200 papers

Rapidly developing machine learning methods has stimulated research interest in computationally reconstructing differential equations (DEs) from observational data which may provide additional insight into underlying causative mechanisms.…

Machine Learning · Computer Science 2026-05-12 Mingtao Xia , Xiangting Li , Qijing Shen , Tom Chou

Deep neural networks (DNNs) have achieved remarkable success in numerous domains, and their application to PDE-related problems has been rapidly advancing. This paper provides an estimate for the generalization error of learning Lipschitz…

Machine Learning · Computer Science 2023-10-04 Ke Chen , Chunmei Wang , Haizhao Yang

Machine learning approaches for solving partial differential equations require learning mappings between function spaces. While convolutional or graph neural networks are constrained to discretized functions, neural operators present a…

Stochastic partial differential equations (SPDEs) are significant tools for modeling dynamics in many areas including atmospheric sciences and physics. Neural Operators, generations of neural networks with capability of learning maps…

Machine Learning · Computer Science 2022-07-19 Peiyan Hu , Qi Meng , Bingguang Chen , Shiqi Gong , Yue Wang , Wei Chen , Rongchan Zhu , Zhi-Ming Ma , Tie-Yan Liu

Operator learning for Partial Differential Equations (PDEs) is rapidly emerging as a promising approach for surrogate modeling of intricate systems. Transformers with the self-attention mechanism$\unicode{x2013}$a powerful tool originally…

Machine Learning · Computer Science 2024-05-17 Junfeng Chen , Kailiang Wu

Operator learning provides methods to approximate mappings between infinite-dimensional function spaces. Deep operator networks (DeepONets) are a notable architecture in this field. Recently, an extension of DeepONet based on model…

Machine Learning · Computer Science 2024-03-28 Hamidreza Eivazi , Stefan Wittek , Andreas Rausch

Surrogate models for partial-differential equations are widely used in the design of meta-materials to rapidly evaluate the behavior of composable components. However, the training cost of accurate surrogates by machine learning can rapidly…

Machine Learning · Computer Science 2020-11-04 Raphaël Pestourie , Youssef Mroueh , Thanh V. Nguyen , Payel Das , Steven G. Johnson

Regularization plays a pivotal role in integrating prior information into inverse problems. While many deep learning methods have been proposed to solve inverse problems, determining where to apply regularization remains a crucial…

Numerical Analysis · Mathematics 2024-03-22 Ke Chen , Chunmei Wang , Haizhao Yang

Stochastic partial differential equations (SPDEs) are the mathematical tool of choice for modelling spatiotemporal PDE-dynamics under the influence of randomness. Based on the notion of mild solution of an SPDE, we introduce a novel neural…

Machine Learning · Computer Science 2022-09-27 Cristopher Salvi , Maud Lemercier , Andris Gerasimovics

Reliability analysis is a formidable task, particularly in systems with a large number of stochastic parameters. Conventional methods for quantifying reliability often rely on extensive simulations or experimental data, which can be costly…

Numerical Analysis · Mathematics 2024-09-10 N Navaneeth , Tushar , Souvik Chakraborty

This work develops an active learning framework to intelligently enrich data-driven reduced-order models (ROMs) of parametric dynamical systems, which can serve as the foundation of virtual assets in a digital twin. Data-driven ROMs are…

Machine Learning · Statistics 2026-01-05 Shane A. McQuarrie , Mengwu Guo , Anirban Chaudhuri

Since the advent of the ``Neural Ordinary Differential Equation (Neural ODE)'' paper, learning ODEs with deep learning has been applied to system identification, time-series forecasting, and related areas. Exploiting the diffeomorphic…

Machine Learning · Statistics 2025-08-27 Yuji Okamoto , Tomoya Takeuchi , Yusuke Sakemi

In this paper, we investigate the applications of operator learning, specifically DeepONet, for solving nonlinear partial differential equations (PDEs). Unlike conventional function learning methods that require training separate neural…

Machine Learning · Computer Science 2025-09-30 Yahong Yang

This paper addresses the data-driven identification of latent dynamical representations of partially-observed systems, i.e., dynamical systems for which some components are never observed, with an emphasis on forecasting applications,…

Recently, researchers have utilized neural networks to accurately solve partial differential equations (PDEs), enabling the mesh-free method for scientific computation. Unfortunately, the network performance drops when encountering a high…

Machine Learning · Computer Science 2021-09-29 Pongpisit Thanasutives , Masayuki Numao , Ken-ichi Fukui

Operator learning techniques have recently emerged as a powerful tool for learning maps between infinite-dimensional Banach spaces. Trained under appropriate constraints, they can also be effective in learning the solution operator of…

Machine Learning · Computer Science 2021-10-13 Sifan Wang , Hanwen Wang , Paris Perdikaris

This work explores the application of deep operator learning principles to a problem in statistical physics. Specifically, we consider the linear kinetic equation, consisting of a differential advection operator and an integral collision…

Numerical Analysis · Mathematics 2024-02-27 Jae Yong Lee , Steffen Schotthöfer , Tianbai Xiao , Sebastian Krumscheid , Martin Frank

Data-driven modeling has become a key building block in computational science and engineering. However, data that are available in science and engineering are typically scarce, often polluted with noise and affected by measurement errors…

Machine Learning · Computer Science 2022-12-06 Wayne Isaac Tan Uy , Dirk Hartmann , Benjamin Peherstorfer

Systems modeled by partial differential equations (PDEs) are at least as ubiquitous as systems that are by nature finite-dimensional and modeled by ordinary differential equations (ODEs). And yet, systematic and readily usable…

Optimization and Control · Mathematics 2025-09-11 Rafael Vazquez , Jean Auriol , Federico Bribiesca-Argomedo , Miroslav Krstic

We present Basis-to-Basis (B2B) operator learning, a novel approach for learning operators on Hilbert spaces of functions based on the foundational ideas of function encoders. We decompose the task of learning operators into two parts:…

Machine Learning · Computer Science 2024-11-13 Tyler Ingebrand , Adam J. Thorpe , Somdatta Goswami , Krishna Kumar , Ufuk Topcu