English
Related papers

Related papers: Operator-learning-inspired Modeling of Neural Ordi…

200 papers

The approximation of solutions of partial differential equations (PDEs) with numerical algorithms is a central topic in applied mathematics. For many decades, various types of methods for this purpose have been developed and extensively…

Numerical Analysis · Mathematics 2024-08-26 Lukas Gonon , Arnulf Jentzen , Benno Kuckuck , Siyu Liang , Adrian Riekert , Philippe von Wurstemberger

This paper introduces an operator-based neural network, the mirror-padded Fourier neural operator (MFNO), designed to learn the dynamics of stochastic systems. MFNO extends the standard Fourier neural operator (FNO) by incorporating mirror…

Machine Learning · Computer Science 2025-07-25 Wonjae Lee , Taeyoung Kim , Hyungbin Park

Driven by rapid advances in artificial intelligence and modern GPU computing capabilities, deep learning methods based on the optimization paradigm have provided new pathways to solve spatiotemporal physical problems, whose mathematical…

Computational Physics · Physics 2026-05-18 Shan Ding , Yongfu Tian , Lang Qin , Hongxiang Ma , Guofeng Su , Rui Yang

Modeling dynamical systems is crucial for a wide range of tasks, but it remains challenging due to complex nonlinear dynamics, limited observations, or lack of prior knowledge. Recently, data-driven approaches such as Neural Ordinary…

Operator learning is a variant of machine learning that is designed to approximate maps between function spaces from data. The Fourier Neural Operator (FNO) is one of the main model architectures used for operator learning. The FNO combines…

Numerical Analysis · Mathematics 2025-09-29 Samuel Lanthaler , Andrew M. Stuart , Margaret Trautner

Ordinary and partial differential equations (ODEs/PDEs) play a paramount role in analyzing and simulating complex dynamic processes across all corners of science and engineering. In recent years machine learning tools are aspiring to…

Machine Learning · Computer Science 2021-06-11 Sifan Wang , Paris Perdikaris

The neural ordinary differential equation (ODE) framework has emerged as a powerful tool for developing accelerated surrogate models of complex physical systems governed by partial differential equations (PDEs). A popular approach for PDE…

Fluid Dynamics · Physics 2025-03-26 Ashish S. Nair , Shivam Barwey , Pinaki Pal , Jonathan F. MacArt , Troy Arcomano , Romit Maulik

We introduce the Laplace neural operator (LNO), which leverages the Laplace transform to decompose the input space. Unlike the Fourier Neural Operator (FNO), LNO can handle non-periodic signals, account for transient responses, and exhibit…

Machine Learning · Computer Science 2023-05-31 Qianying Cao , Somdatta Goswami , George Em Karniadakis

Numerical approximations of partial differential equations (PDEs) are routinely employed to formulate the solution of physics, engineering, and mathematical problems involving functions of several variables, such as the propagation of heat…

This study presents a novel unsupervised convolutional Neural Network (NN) architecture with nonlocal interactions for solving Partial Differential Equations (PDEs). The nonlocal Peridynamic Differential Operator (PDDO) is employed as a…

Machine Learning · Computer Science 2023-03-22 A. Mavi , A. C. Bekar , E. Haghighat , E. Madenci

Numerically solving partial differential equations typically requires fine discretization to resolve necessary spatiotemporal scales, which can be computationally expensive. Recent advances in deep learning have provided a new approach to…

Machine Learning · Computer Science 2023-09-22 Saurabh Patil , Zijie Li , Amir Barati Farimani

Differential equations are frequently used in engineering domains, such as modeling and control of industrial systems, where safety and performance guarantees are of paramount importance. Traditional physics-based modeling approaches…

Systems and Control · Electrical Eng. & Systems 2020-11-30 Aaron Tuor , Jan Drgona , Draguna Vrabie

This study investigates the application of machine learning, specifically Fourier Neural Operator (FNO) and Convolutional Neural Network (CNN), to learn time-advancement operators for parametric partial differential equations (PDEs). Our…

Machine Learning · Computer Science 2024-02-19 Rixin Yu , Erdzan Hodzic

Recent advancements in operator-type neural networks have shown promising results in approximating the solutions of spatiotemporal Partial Differential Equations (PDEs). However, these neural networks often entail considerable training…

Machine Learning · Computer Science 2025-05-08 Shuhao Cao , Francesco Brarda , Ruipeng Li , Yuanzhe Xi

The evolution of dynamical systems is generically governed by nonlinear partial differential equations (PDEs), whose solution, in a simulation framework, requires vast amounts of computational resources. In this work, we present a novel…

Machine Learning · Computer Science 2023-09-01 Michael Rotman , Amit Dekel , Ran Ilan Ber , Lior Wolf , Yaron Oz

We propose derivative-informed neural operators (DINOs), a general family of neural networks to approximate operators as infinite-dimensional mappings from input function spaces to output function spaces or quantities of interest. After…

Numerical Analysis · Mathematics 2023-10-18 Thomas O'Leary-Roseberry , Peng Chen , Umberto Villa , Omar Ghattas

Extrapolation remains a grand challenge in deep neural networks across all application domains. We propose an operator learning method to solve time-dependent partial differential equations (PDEs) continuously and with extrapolation in time…

Machine Learning · Computer Science 2023-12-12 Oded Ovadia , Vivek Oommen , Adar Kahana , Ahmad Peyvan , Eli Turkel , George Em Karniadakis

In computational physics, a longstanding challenge lies in finding numerical solutions to partial differential equations (PDEs). Recently, research attention has increasingly focused on Neural Operator methods, which are notable for their…

Machine Learning · Computer Science 2025-09-26 Yichen Song , Yalun Wu , Yunbo Wang , Xiaokang Yang

Numerical solution of partial differential equations (PDEs) plays a vital role in various fields of science and engineering. In recent years, deep neural networks (DNNs) have emerged as a powerful tool for solving PDEs, leveraging their…

Numerical Analysis · Mathematics 2026-02-16 Shuo Ling , Wenjun Ying , Zhen Zhang

Developing neural operators that accurately predict the behavior of systems governed by partial differential equations (PDEs) across unseen parameter regimes is crucial for robust generalization in scientific and engineering applications.…

Machine Learning · Computer Science 2026-04-21 Eva van Tegelen , Taniya Kapoor , George A. K. van Voorn , Peter van Heijster , Ioannis N. Athanasiadis