English
Related papers

Related papers: Fourier Neural Operators Explained: A Practical Pe…

200 papers

Solving partial differential equations remains a central challenge in scientific machine learning. Neural operators offer a promising route by learning mappings between function spaces and enabling resolution-independent inference, yet they…

Machine Learning · Computer Science 2026-02-03 Paolo Marcandelli , Natansh Mathur , Stefano Markidis , Martina Siena , Stefano Mariani

We introduce sparse autoencoder neural operators (SAE-NOs), a new class of sparse autoencoders that operate in function spaces rather than fixed-dimensional Euclidean representations. We formalize the functional representation hypothesis,…

Machine Learning · Computer Science 2026-05-11 Bahareh Tolooshams , Ailsa Shen , Anima Anandkumar

Neural operators have emerged as powerful tools for learning solution operators of partial differential equations (PDEs). However, standard spectral methods based on Fourier transforms struggle with problems involving discontinuous…

Computational Physics · Physics 2026-05-20 Giorgio M. Cavallazzi , Miguel Pérez Cuadrado , Alfredo Pinelli

Magnetohydrodynamics (MHD) plays a pivotal role in describing the dynamics of plasma and conductive fluids, essential for understanding phenomena such as the structure and evolution of stars and galaxies, and in nuclear fusion for plasma…

Computational Physics · Physics 2024-10-11 Taeyoung Kim , Youngsoo Ha , Myungjoo Kang

The classical development of neural networks has primarily focused on learning mappings between finite dimensional Euclidean spaces or finite sets. We propose a generalization of neural networks to learn operators, termed neural operators,…

Partial Differential Equations (PDEs) are central to science and engineering. Since solving them is computationally expensive, a lot of effort has been put into approximating their solution operator via both traditional and recently…

Machine Learning · Computer Science 2025-02-14 Alessandro Longhi , Danny Lathouwers , Zoltán Perkó

Surrogate models are critical for accelerating computationally expensive simulations in science and engineering, particularly for solving parametric partial differential equations (PDEs). Developing practical surrogate models poses…

Numerical Analysis · Mathematics 2025-06-17 Chenyu Zeng , Yanshu Zhang , Jiayi Zhou , Yuhan Wang , Zilin Wang , Yuhao Liu , Lei Wu , Daniel Zhengyu Huang

The laws of physics have been written in the language of dif-ferential equations for centuries. Neural Ordinary Differen-tial Equations (NODEs) are a new machine learning architecture which allows these differential equations to be learned…

Machine Learning · Computer Science 2021-09-20 Max Zhu , Pietro Lio , Jacob Moss

Neural operators have become increasingly popular in solving \textit{partial differential equations} (PDEs) due to their superior capability to capture intricate mappings between function spaces over complex domains. However, the…

Machine Learning · Computer Science 2026-03-02 Jianing Huang , Kaixuan Zhang , Youjia Wu , Ze Cheng

Standard neural networks can approximate general nonlinear operators, represented either explicitly by a combination of mathematical operators, e.g., in an advection-diffusion-reaction partial differential equation, or simply as a black…

Machine Learning · Computer Science 2022-07-19 Somdatta Goswami , Aniruddha Bora , Yue Yu , George Em Karniadakis

This work introduces a paradigm for constructing parametric neural operators that are derived from finite-dimensional representations of Green's operators for linear partial differential equations (PDEs). We refer to such neural operators…

Machine Learning · Computer Science 2026-04-10 Hugo Melchers , Joost Prins , Michael Abdelmalik

Self-training techniques have shown remarkable value across many deep learning models and tasks. However, such techniques remain largely unexplored when considered in the context of learning fast solvers for systems of partial differential…

Machine Learning · Computer Science 2023-11-27 Ritam Majumdar , Amey Varhade , Shirish Karande , Lovekesh Vig

Solving partial or ordinary differential equation models in cardiac electrophysiology is a computationally demanding task, particularly when high-resolution meshes are required to capture the complex dynamics of the heart. Moreover, in…

We introduce a novel Multimodal Neural Operator (MNO) architecture designed to learn solution operators for multi-parameter nonlinear boundary value problems (BVPs). Traditional neural operators primarily map either the PDE coefficients or…

Computational Engineering, Finance, and Science · Computer Science 2025-07-17 Vamshi C. Madala , Nithin Govindarajan , Shivkumar Chandrasekaran

We present a Fourier neural network (FNN) that can be mapped directly to the Fourier decomposition. The choice of activation and loss function yields results that replicate a Fourier series expansion closely while preserving a…

Machine Learning · Computer Science 2021-04-30 Marieme Ngom , Oana Marin

Operator learning is a recent development in the simulation of Partial Differential Equations (PDEs) by means of neural networks. The idea behind this approach is to learn the behavior of an operator, such that the resulting neural network…

Numerical Analysis · Mathematics 2025-01-15 Ahmed Abdeljawad , Thomas Dittrich

The numerical approximation of the Boltzmann collision operator presents significant challenges arising from its high dimensionality, nonlinear structure, and nonlocal integral form. In this work, we propose a Fourier Neural Operator (FNO)…

Numerical Analysis · Mathematics 2025-10-16 Boyun Hu , Kunlun Qi

We present an end-to-end framework to learn partial differential equations that brings together initial data production, selection of boundary conditions, and the use of physics-informed neural operators to solve partial differential…

Computational Physics · Physics 2023-08-21 Shawn G. Rosofsky , Hani Al Majed , E. A. Huerta

Learning dynamics governed by differential equations is crucial for predicting and controlling the systems in science and engineering. Neural Ordinary Differential Equation (NODE), a deep learning model integrated with differential…

Machine Learning · Computer Science 2021-11-09 Shiqi Gong , Qi Meng , Yue Wang , Lijun Wu , Wei Chen , Zhi-Ming Ma , Tie-Yan Liu

Physics-informed Neural Networks (PINNs) have been shown as a promising approach for solving both forward and inverse problems of partial differential equations (PDEs). Meanwhile, the neural operator approach, including methods such as Deep…

Machine Learning · Computer Science 2023-10-31 Bin Lin , Zhiping Mao , Zhicheng Wang , George Em Karniadakis