English
Related papers

Related papers: Derivative-Informed Neural Operator: An Efficient …

200 papers

This paper introduces the Kernel Neural Operator (KNO), a provably convergent operator-learning architecture that utilizes compositions of deep kernel-based integral operators for function-space approximation of operators (maps from…

Machine Learning · Computer Science 2026-05-06 Matthew Lowery , John Turnage , Zachary Morrow , John D. Jakeman , Akil Narayan , Shandian Zhe , Varun Shankar

We propose a very general framework for deriving rigorous bounds on the approximation error for physics-informed neural networks (PINNs) and operator learning architectures such as DeepONets and FNOs as well as for physics-informed operator…

Machine Learning · Computer Science 2022-10-11 Tim De Ryck , Siddhartha Mishra

Accurately quantifying long-term risk probabilities in diverse stochastic systems is essential for safety-critical control. However, existing sampling-based and partial differential equation (PDE)-based methods often struggle to handle…

Systems and Control · Electrical Eng. & Systems 2025-08-29 Zhuoyuan Wang , Raffaele Romagnoli , Kamyar Azizzadenesheli , Yorie Nakahira

In scientific and engineering applications, solving partial differential equations (PDEs) across various parameters and domains normally relies on resource-intensive numerical methods. Neural operators based on deep learning offered a…

Numerical Analysis · Mathematics 2024-06-21 Zhiwei Zhao , Changqing Liu , Yingguang Li , Zhibin Chen , Xu Liu

The study of operator learning involves the utilization of neural networks to approximate operators. Traditionally, the focus has been on single-operator learning (SOL). However, recent advances have rapidly expanded this to include the…

Machine Learning · Computer Science 2024-04-09 Zecheng Zhang

Neural operators (NOs) provide a new paradigm for efficiently solving partial differential equations (PDEs), but their training depends on costly high-fidelity data from numerical solvers, limiting applications in complex systems. We…

Computational Physics · Physics 2026-05-18 Wen You , Shaoqian Zhou , Xuhui Meng

Partial differential equations (PDEs) govern a wide variety of dynamical processes in science and engineering, yet obtaining their numerical solutions often requires high-resolution discretizations and repeated evaluations of complex…

Machine Learning · Computer Science 2026-01-26 Valentin Duruisseaux , Jean Kossaifi , Anima Anandkumar

The performance of deep neural networks is highly sensitive to the choice of the hyperparameters that define the structure of the network and the learning process. When facing a new application, tuning a deep neural network is a tedious and…

Machine Learning · Computer Science 2019-07-04 Dounia Lakhmiri , Sébastien Le Digabel , Christophe Tribes

Thanks to their universal approximation properties and new efficient training strategies, Deep Neural Networks are becoming a valuable tool for the approximation of mathematical operators. In the present work, we introduce Mesh-Informed…

Numerical Analysis · Mathematics 2023-05-08 Nicola Rares Franco , Andrea Manzoni , Paolo Zunino

The neural operator has emerged as a powerful tool in learning mappings between function spaces in PDEs. However, when faced with real-world physical data, which are often highly non-uniformly distributed, it is challenging to use…

Machine Learning · Computer Science 2023-06-01 Songming Liu , Zhongkai Hao , Chengyang Ying , Hang Su , Ze Cheng , Jun Zhu

Derivative training is an established method that can significantly increase the accuracy of neural networks in certain low-dimensional tasks. In this paper, we extend this improvement to an illustrative image analysis problem:…

Machine Learning · Computer Science 2025-02-04 Vsevolod I. Avrutskiy

Deep neural operators can learn nonlinear mappings between infinite-dimensional function spaces via deep neural networks. As promising surrogate solvers of partial differential equations (PDEs) for real-time prediction, deep neural…

Machine Learning · Computer Science 2023-05-17 Min Zhu , Handi Zhang , Anran Jiao , George Em Karniadakis , Lu Lu

Design and optimal control problems are among the fundamental, ubiquitous tasks we face in science and engineering. In both cases, we aim to represent and optimize an unknown (black-box) function that associates a performance/outcome to a…

Machine Learning · Computer Science 2021-10-27 Sifan Wang , Mohamed Aziz Bhouri , Paris Perdikaris

Inverse problems involving partial differential equations (PDEs) can be seen as discovering a mapping from measurement data to unknown quantities, often framed within an operator learning approach. However, existing methods typically rely…

Numerical Analysis · Mathematics 2025-02-10 Sung Woong Cho , Hwijae Son

With growing investigations into solving partial differential equations by physics-informed neural networks (PINNs), more accurate and efficient PINNs are required to meet the practical demands of scientific computing. One bottleneck of…

Machine Learning · Computer Science 2025-10-29 Tianchi Yu , Yiming Qi , Ivan Oseledets , Shiyi Chen

Neural Operators offer a powerful, data-driven tool for solving parametric PDEs as they can represent maps between infinite-dimensional function spaces. In this work, we employ physics-informed Neural Operators in the context of…

Machine Learning · Statistics 2023-03-08 Sebastian Kaltenbach , Paris Perdikaris , Phaedon-Stelios Koutsourelakis

Neural operators, which aim to approximate mappings between infinite-dimensional function spaces, have been widely applied in the simulation and prediction of physical systems. However, the limited representational capacity of network…

Machine Learning · Computer Science 2025-06-03 Jin Song , Kenji Kawaguchi , Zhenya Yan

Neural ordinary differential equations (NODEs), one of the most influential works of the differential equation-based deep learning, are to continuously generalize residual networks and opened a new field. They are currently utilized for…

Machine Learning · Computer Science 2023-12-19 Woojin Cho , Seunghyeon Cho , Hyundong Jin , Jinsung Jeon , Kookjin Lee , Sanghyun Hong , Dongeun Lee , Jonghyun Choi , Noseong Park

Neural operators have emerged as fast surrogate solvers for parametric partial differential equations (PDEs). However, purely data-driven models often require extensive training data and can generalize poorly, especially in small-data…

Machine Learning · Computer Science 2026-02-16 Heechang Kim , Qianying Cao , Hyomin Shin , Seungchul Lee , George Em Karniadakis , Minseok Choi

Generative models in function spaces, situated at the intersection of generative modeling and operator learning, are attracting increasing attention due to their immense potential in diverse scientific and engineering applications. While…

Machine Learning · Computer Science 2025-10-30 Yaozhong Shi , Zachary E. Ross , Domniki Asimaki , Kamyar Azizzadenesheli