English
Related papers

Related papers: Improved generalization with deep neural operators…

200 papers

We present polynomial-augmented neural networks (PANNs), a novel machine learning architecture that combines deep neural networks (DNNs) with a polynomial approximant. PANNs combine the strengths of DNNs (flexibility and efficiency in…

Machine Learning · Computer Science 2025-02-25 Madison Cooley , Shandian Zhe , Robert M. Kirby , Varun Shankar

Neural operators have emerged as promising surrogate models for solving partial differential equations (PDEs), but struggle to generalise beyond training distributions and are often constrained to a fixed temporal discretisation. This work…

In this article we propose a new deep learning approach to approximate operators related to parametric partial differential equations (PDEs). In particular, we introduce a new strategy to design specific artificial neural network (ANN)…

Numerical Analysis · Mathematics 2026-05-01 Arnulf Jentzen , Adrian Riekert , Philippe von Wurstemberger

Efficient and robust optimization is essential for neural networks, enabling scientific machine learning models to converge rapidly to very high accuracy -- faithfully capturing complex physical behavior governed by differential equations.…

We propose a very general framework for deriving rigorous bounds on the approximation error for physics-informed neural networks (PINNs) and operator learning architectures such as DeepONets and FNOs as well as for physics-informed operator…

Machine Learning · Computer Science 2022-10-11 Tim De Ryck , Siddhartha Mishra

Deep neural network approximation of nonlinear operators, commonly referred to as DeepONet, has proven capable of approximating PDE backstepping designs in which a single Goursat-form PDE governs a single feedback gain function. In boundary…

Optimization and Control · Mathematics 2024-07-04 Shanshan Wang , Mamadou Diagne , Miroslav Krstić

Accurately modeling and inferring solutions to time-dependent partial differential equations (PDEs) over extended horizons remains a core challenge in scientific machine learning. Traditional full rollout (FR) methods, which predict entire…

Machine Learning · Computer Science 2026-03-18 Luis Mandl , Dibyajyoti Nayak , Tim Ricken , Somdatta Goswami

Physical systems whose dynamics are governed by partial differential equations (PDEs) find applications in numerous fields, from engineering design to weather forecasting. The process of obtaining the solution from such PDEs may be…

Machine Learning · Computer Science 2022-09-21 Pratyush Bhatt , Yash Kumar , Azzeddine Soulaimani

Diffractive deep neural network (DNNet) is a novel machine learning framework on the modulation of optical transmission. Diffractive network would get predictions at the speed of light. It's pure passive architecture, no additional power…

Machine Learning · Computer Science 2019-12-24 Yingshi Chen , Jinfeng Zhu

Digital network twin (DNT) is a promising paradigm to replicate real-world cellular networks toward continual assessment, proactive management, and what-if analysis. Existing discussions have been focusing on using only deep learning…

Networking and Internet Architecture · Computer Science 2023-11-22 Yuru Zhang , Ming Zhao , Qiang Liu

We present $\phi-$DeepONet, a physics-informed neural operator designed to learn mappings between function spaces that may contain discontinuities or exhibit non-smooth behavior. Classical neural operators are based on the universal…

Computational Engineering, Finance, and Science · Computer Science 2026-04-10 Sumanta Roy , Stephen T. Castonguay , Pratanu Roy , Michael D. Shields

Deep learning has revolutionized the field of computer vision by introducing large scale neural networks with millions of parameters. Training these networks requires massive datasets and leads to intransparent models that can fail to…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Tom Fischer , Pascal Peter , Joachim Weickert , Eddy Ilg

Deep learning has become a pivotal technology in fields such as computer vision, scientific computing, and dynamical systems, significantly advancing these disciplines. However, neural Networks persistently face challenges related to…

Machine Learning · Computer Science 2025-10-14 Yongshuai Liu , Lianfang Wang , Kuilin Qin , Qinghua Zhang , Faqiang Wang , Li Cui , Jun Liu , Yuping Duan , Tieyong Zeng

Neural Operators (NOs) are machine learning models designed to solve partial differential equations (PDEs) by learning to map between function spaces. Neural Operators such as the Deep Operator Network (DeepONet) and the Fourier Neural…

Machine Learning · Computer Science 2025-04-30 W. Diab , M. Al-Kobaisi

Current groundwater models face a significant challenge in their implementation due to heavy computational burdens. To overcome this, our work proposes a cost-effective emulator that efficiently and accurately forecasts the impact of…

Neural ordinary differential equations (ODEs) have been attracting increasing attention in various research domains recently. There have been some works studying optimization issues and approximation capabilities of neural ODEs, but their…

Machine Learning · Computer Science 2022-03-04 Hanshu Yan , Jiawei Du , Vincent Y. F. Tan , Jiashi Feng

Neural ODEs (NODEs) are continuous-time neural networks (NNs) that can process data without the limitation of time intervals. They have advantages in learning and understanding the evolution of complex real dynamics. Many previous works…

Machine Learning · Computer Science 2024-11-05 Wenjie Mei , Dongzhe Zheng , Shihua Li

Deep operator network (DeepONet) has shown significant promise as surrogate models for systems governed by partial differential equations (PDEs), enabling accurate mappings between infinite-dimensional function spaces. However, when applied…

Machine Learning · Computer Science 2025-10-29 Sharmila Karumuri , Lori Graham-Brady , Somdatta Goswami

Operator learning has emerged as a powerful tool in scientific computing for approximating mappings between infinite-dimensional function spaces. A primary application of operator learning is the development of surrogate models for the…

Machine Learning · Statistics 2025-04-07 Unique Subedi , Ambuj Tewari

Discriminative learning based on convolutional neural networks (CNNs) aims to perform image restoration by learning from training examples of noisy-clean image pairs. It has become the go-to methodology for tackling image restoration and…

Computer Vision and Pattern Recognition · Computer Science 2020-09-01 Junaid Malik , Serkan Kiranyaz , Moncef Gabbouj