English
Related papers

Related papers: Functional SDE approximation inspired by a deep op…

200 papers

This article introduces GIT-Net, a deep neural network architecture for approximating Partial Differential Equation (PDE) operators, inspired by integral transform operators. GIT-NET harnesses the fact that differential operators commonly…

Machine Learning · Statistics 2023-12-06 Chao Wang , Alexandre Hoang Thiery

Uncertainty quantification is a fundamental yet unsolved problem for deep learning. The Bayesian framework provides a principled way of uncertainty estimation but is often not scalable to modern deep neural nets (DNNs) that have a large…

Machine Learning · Computer Science 2020-08-25 Lingkai Kong , Jimeng Sun , Chao Zhang

We construct and analyze approximation rates of deep operator networks (ONets) between infinite-dimensional spaces that emulate with an exponential rate of convergence the coefficient-to-solution map of elliptic second-order partial…

Numerical Analysis · Mathematics 2023-11-27 Carlo Marcati , Christoph Schwab

Neural operators have become increasingly popular in solving \textit{partial differential equations} (PDEs) due to their superior capability to capture intricate mappings between function spaces over complex domains. However, the…

Machine Learning · Computer Science 2026-03-02 Jianing Huang , Kaixuan Zhang , Youjia Wu , Ze Cheng

In this article, we investigate the existence of a deep neural network (DNN) capable of approximating solutions to partial integro-differential equations while circumventing the curse of dimensionality. Using the Feynman-Kac theorem, we…

Numerical Analysis · Mathematics 2025-01-22 Marcin Baranek

Deep Operator Networks (DeepOnets) have revolutionized the domain of scientific machine learning for the solution of the inverse problem for dynamical systems. However, their implementation necessitates optimizing a high-dimensional space…

Machine Learning · Computer Science 2024-11-05 Gianluca Fabiani , Ioannis G. Kevrekidis , Constantinos Siettos , Athanasios N. Yannacopoulos

Recent experiments have shown that deep networks can approximate solutions to high-dimensional PDEs, seemingly escaping the curse of dimensionality. However, questions regarding the theoretical basis for such approximations, including the…

Machine Learning · Computer Science 2021-07-07 Tanya Marwah , Zachary C. Lipton , Andrej Risteski

In this paper, we study a machine-learning-based solver for high-dimensional partial differential equations (PDEs). Computing accurate solutions efficiently for such problems remains challenging because of the curse of dimensionality, which…

Numerical Analysis · Mathematics 2026-04-27 Phuoc-Toan Huynh , Feng Bao , Haizhao Yang , Ahmed Zytoon

Deep neural operators are recognized as an effective tool for learning solution operators of complex partial differential equations (PDEs). As compared to laborious analytical and computational tools, a single neural operator can predict…

Machine Learning · Statistics 2023-02-14 Navaneeth N , Tapas Tripura , Souvik Chakraborty

In many mechanistic medical, biological, physical and engineered spatiotemporal dynamic models the numerical solution of partial differential equations (PDEs) can make simulations impractically slow. Biological models require the…

Soft Condensed Matter · Physics 2021-02-11 J. Quetzalcóatl Toledo-Marín , Geoffrey Fox , James P. Sluka , James A. Glazier

A state-of-the-art deep domain decomposition method (D3M) based on the variational principle is proposed for partial differential equations (PDEs). The solution of PDEs can be formulated as the solution of a constrained optimization…

Machine Learning · Computer Science 2020-04-03 Ke Li , Kejun Tang , Tianfan Wu , Qifeng Liao

Polynomial chaos expansions (PCE) are widely used in the framework of uncertainty quantification. However, when dealing with high dimensional complex problems, challenging issues need to be faced. For instance, high-order polynomials may be…

Methodology · Statistics 2015-06-02 Chu V. Mai , Bruno Sudret

Transfer learning for partial differential equations (PDEs) is to develop a pre-trained neural network that can be used to solve a wide class of PDEs. Existing transfer learning approaches require much information of the target PDEs such as…

Numerical Analysis · Mathematics 2023-01-30 Zezhong Zhang , Feng Bao , Lili Ju , Guannan Zhang

We present a data-driven control framework for partial differential equations (PDEs). Our approach integrates Time-Integrated Deep Operator Networks (TI-DeepONets) as differentiable PDE surrogate models within the Differentiable Predictive…

Computational Engineering, Finance, and Science · Computer Science 2026-04-16 Dibakar Roy Sarkar , Ján Drgoňa , Somdatta Goswami

We consider using deep neural networks to solve time-dependent partial differential equations (PDEs), where multi-scale processing is crucial for modeling complex, time-evolving dynamics. While the U-Net architecture with skip connections…

Machine Learning · Computer Science 2024-03-29 Xuan Zhang , Jacob Helwig , Yuchao Lin , Yaochen Xie , Cong Fu , Stephan Wojtowytsch , Shuiwang Ji

Model discrepancy, defined as the difference between model predictions and reality, is ubiquitous in computational models for physical systems. It is common to derive partial differential equations (PDEs) from first principles physics, but…

Numerical Analysis · Mathematics 2022-11-08 Joseph Hart , Bart van Bloemen Waanders

It is one of the most challenging issues in applied mathematics to approximately solve high-dimensional partial differential equations (PDEs) and most of the numerical approximation methods for PDEs in the scientific literature suffer from…

Probability · Mathematics 2024-06-04 Fabian Hornung , Arnulf Jentzen , Diyora Salimova

In this paper we propose a new model-based unsupervised learning method, called VarNet, for the solution of partial differential equations (PDEs) using deep neural networks (NNs). Particularly, we propose a novel loss function that relies…

Machine Learning · Computer Science 2019-12-17 Reza Khodayi-Mehr , Michael M. Zavlanos

As supported by abundant experimental evidence, neural networks are state-of-the-art for many approximation tasks in high-dimensional spaces. Still, there is a lack of a rigorous theoretical understanding of what they can approximate, at…

Numerical Analysis · Mathematics 2024-06-24 Elena Celledoni , James Jackaman , Davide Murari , Brynjulf Owren

Neural PDE solvers are increasingly used as learned surrogates for families of partial differential equations, where the key machine learning challenge is not only interpolation on a fixed benchmark distribution but generalization under…

Machine Learning · Computer Science 2026-05-26 Lennon Shikhman