English
Related papers

Related papers: Functional SDE approximation inspired by a deep op…

200 papers

Neural operators improve conventional neural networks by expanding their capabilities of functional mappings between different function spaces to solve partial differential equations (PDEs). One of the most notable methods is the Fourier…

Machine Learning · Computer Science 2024-07-29 Xuanle Zhao , Yue Sun , Tielin Zhang , Bo Xu

We propose a novel \textit{capsule} based deep encoder-decoder model for surrogate modeling and uncertainty quantification of systems in mechanics from sparse data. The proposed framework is developed by adapting Capsule Network (CapsNet)…

Machine Learning · Statistics 2022-01-20 Akshay Thakur , Souvik Chakraborty

Operator learning is a recent development in the simulation of Partial Differential Equations (PDEs) by means of neural networks. The idea behind this approach is to learn the behavior of an operator, such that the resulting neural network…

Numerical Analysis · Mathematics 2025-01-15 Ahmed Abdeljawad , Thomas Dittrich

Ordinary and partial differential equations (ODEs/PDEs) play a paramount role in analyzing and simulating complex dynamic processes across all corners of science and engineering. In recent years machine learning tools are aspiring to…

Machine Learning · Computer Science 2021-06-11 Sifan Wang , Paris Perdikaris

Spatiotemporal partial differential equations (PDEs) underpin a wide range of scientific and engineering applications. Neural PDE solvers offer a promising alternative to classical numerical methods. However, existing approaches typically…

Machine Learning · Computer Science 2026-03-03 Yingjie Tan , Quanming Yao , Yaqing Wang

Neural networks are versatile tools for computation, having the ability to approximate a broad range of functions. An important problem in the theory of deep neural networks is expressivity; that is, we want to understand the functions that…

Machine Learning · Computer Science 2021-08-16 Khashayar Filom , Konrad Paul Kording , Roozbeh Farhoodi

Machine learning for scientific applications faces the challenge of limited data. We propose a framework that leverages a priori known physics to reduce overfitting when training on relatively small datasets. A deep neural network is…

Machine Learning · Computer Science 2019-11-22 Jonathan B. Freund , Jonathan F. MacArt , Justin Sirignano

In this paper, we present a deep learning-based numerical method for approximating high dimensional stochastic partial differential equations (SPDEs). At each time step, our method relies on a predictor-corrector procedure. More precisely,…

Numerical Analysis · Mathematics 2022-09-13 He Zhang , Ran Zhang , Tao Zhou

Thanks to their universal approximation properties and new efficient training strategies, Deep Neural Networks are becoming a valuable tool for the approximation of mathematical operators. In the present work, we introduce Mesh-Informed…

Numerical Analysis · Mathematics 2023-05-08 Nicola Rares Franco , Andrea Manzoni , Paolo Zunino

We investigate the potential of applying (D)NN ((deep) neural networks) for approximating nonlinear mappings arising in the finite element discretization of nonlinear PDEs (partial differential equations). As an application, we apply the…

Numerical Analysis · Mathematics 2019-11-14 Tuyen Tran , Aidan Hamilton , Maricela Best McKay , Benjamin Quiring , Panayot S. Vassilevski

Partial differential equations (PDEs) are central to describing complex physical system simulations. Their expensive solution techniques have led to an increased interest in deep neural network based surrogates. However, the practical…

Machine Learning · Computer Science 2022-11-17 Jayesh K. Gupta , Johannes Brandstetter

Partial differential equations (PDEs) govern a wide variety of dynamical processes in science and engineering, yet obtaining their numerical solutions often requires high-resolution discretizations and repeated evaluations of complex…

Machine Learning · Computer Science 2026-01-26 Valentin Duruisseaux , Jean Kossaifi , Anima Anandkumar

The recent researches in Deep Convolutional Neural Network have focused their attention on improving accuracy that provide significant advances. However, if they were limited to classification tasks, nowadays with contributions from…

Computer Vision and Pattern Recognition · Computer Science 2017-11-16 Geraldin Nanfack , Azeddine Elhassouny , Rachid Oulad Haj Thami

Neural operators (NO) are discretization invariant deep learning methods with functional output and can approximate any continuous operator. NO have demonstrated the superiority of solving partial differential equations (PDEs) over other…

Numerical Analysis · Mathematics 2024-02-02 Jianguo Huang , Yue Qiu

(Partial) differential equations (PDEs) are fundamental tools for describing natural phenomena, making their solution crucial in science and engineering. While traditional methods, such as the finite element method, provide reliable…

Machine Learning · Computer Science 2025-03-11 Viggo Moro , Luiz F. O. Chamon

Driven by rapid advances in artificial intelligence and modern GPU computing capabilities, deep learning methods based on the optimization paradigm have provided new pathways to solve spatiotemporal physical problems, whose mathematical…

Computational Physics · Physics 2026-05-18 Shan Ding , Yongfu Tian , Lang Qin , Hongxiang Ma , Guofeng Su , Rui Yang

We present approximation theories and efficient training methods for derivative-informed Fourier neural operators (DIFNOs) with applications to PDE-constrained optimization. A DIFNO is an FNO trained by minimizing its prediction error…

Machine Learning · Computer Science 2026-03-17 Boyuan Yao , Dingcheng Luo , Lianghao Cao , Nikola Kovachki , Thomas O'Leary-Roseberry , Omar Ghattas

The least squares method with deep neural networks as function parametrization has been applied to solve certain high-dimensional partial differential equations (PDEs) successfully; however, its convergence is slow and might not be…

Numerical Analysis · Mathematics 2021-12-30 Yiqi Gu , Haizhao Yang , Chao Zhou

Stochastic differential equation (SDE in short) solvers find numerous applications across various fields. However, in practical simulations, we usually resort to using Ito-Taylor series-based methods like the Euler-Maruyama method. These…

Statistics Theory · Mathematics 2023-12-14 Jingyuan Li , Wei Liu

Machine learning methods for solving nonlinear partial differential equations (PDEs) are hot topical issues, and different algorithms proposed in the literature show efficient numerical approximation in high dimension. In this paper, we…

Optimization and Control · Mathematics 2022-01-05 Maximilien Germain , Mathieu Laurière , Huyên Pham , Xavier Warin