English
Related papers

Related papers: Maximal Update Parametrization and Zero-Shot Hyper…

200 papers

Neural operators have emerged as powerful data-driven surrogates for learning solution operators of parametric partial differential equations (PDEs). However, widely used Fourier Neural Operators (FNOs) rely on global Fourier…

We introduce a method that combines neural operators, physics-informed machine learning, and standard numerical methods for solving PDEs. The proposed approach extends each of the aforementioned methods and unifies them within a single…

Computational Engineering, Finance, and Science · Computer Science 2025-12-02 Shahed Rezaei , Reza Najian Asl , Kianoosh Taghikhani , Ahmad Moeineddin , Michael Kaliske , Markus Apel

Seismic phase picking is fundamental for microseismic monitoring and subsurface imaging. Manual processing is impractical for real-time applications and large sensor arrays, motivating the use of deep learning-based pickers trained on…

Geophysics · Physics 2026-04-10 Ayrat Abdullin , Umair Bin Waheed , Leo Eisner , Naveed Iqbal

Partial Differential Equation (PDE) problems often exhibit strong local spatial structures, and effectively capturing these structures is critical for approximating their solutions. Recently, the Fourier Neural Operator (FNO) has emerged as…

Machine Learning · Computer Science 2025-06-05 Chaoyu Liu , Davide Murari , Lihao Liu , Yangming Li , Chris Budd , Carola-Bibiane Schönlieb

Transfer learning for partial differential equations (PDEs) is to develop a pre-trained neural network that can be used to solve a wide class of PDEs. Existing transfer learning approaches require much information of the target PDEs such as…

Numerical Analysis · Mathematics 2023-01-30 Zezhong Zhang , Feng Bao , Lili Ju , Guannan Zhang

The physics-informed neural operator (PINO) is a machine learning paradigm that has demonstrated promising results for learning solutions to partial differential equations (PDEs). It leverages the Fourier Neural Operator to learn solution…

Fourier Neural Operators (FNOs) have demonstrated exceptional accuracy in mapping functional spaces by leveraging Fourier transforms to establish a connection with underlying physical principles. However, their opaque inner workings often…

Fluid Dynamics · Physics 2025-11-04 Marco Cayuela , Vincent Le Chenadec , Peter Schmid , Taraneh Sayadi

Many real-world problems, like modelling environment dynamics, physical processes, time series etc., involve solving Partial Differential Equations (PDEs) parameterised by problem-specific conditions. Recently, a deep learning architecture…

Quantum Physics · Physics 2023-06-28 Nishant Jain , Jonas Landman , Natansh Mathur , Iordanis Kerenidis

Neural operators have been validated as promising deep surrogate models for solving partial differential equations (PDEs). Despite the critical role of boundary conditions in PDEs, however, only a limited number of neural operators robustly…

Numerical Analysis · Mathematics 2023-12-13 Ziyuan Liu , Yuhang Wu , Daniel Zhengyu Huang , Hong Zhang , Xu Qian , Songhe Song

Background: Traumatic brain injury modeling requires integrating volumetric neuroimaging, demographic parameters, and acquisition metadata. Finite element solvers are too computationally expensive for clinical settings. Neural operators…

Machine Learning · Computer Science 2026-04-27 Anusha Agarwal , Dibakar Roy Sarkar , Somdatta Goswami

Fourier Neural Operators (FNOs) have been promoted as fast, mesh-invariant surrogates for partial-differential equation solvers, with seismic studies reporting orders-of-magnitude speedup over classical methods. We revisit those claims by…

Geophysics · Physics 2025-08-18 Dimitri Voytan , Litan Li

A standard practice in developing image recognition models is to train a model on a specific image resolution and then deploy it. However, in real-world inference, models often encounter images different from the training sets in resolution…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Jinsung Jeon , Hyundong Jin , Jonghyun Choi , Sanghyun Hong , Dongeun Lee , Kookjin Lee , Noseong Park

This study demonstrates that a transformer-based neural operator (TNO) can perform zero-shot super-resolution of two-dimensional temperature fields near the ground in urban areas. During training, super-resolution is performed from a…

Atmospheric and Oceanic Physics · Physics 2025-09-01 Yuki Yasuda , Ryo Onishi

Flexible intelligent metasurfaces (FIMs) offer a new solution for wireless communications by introducing morphological degrees of freedom, dynamically morphing their three-dimensional shape to ensure multipath signals interfere…

Information Theory · Computer Science 2026-04-08 Jian Xiao , Ji Wang , Qimei Cui , Yucang Yang , Xingwang Li , Dusit Niyato , Chau Yuen

Neural operators (NO) are discretization invariant deep learning methods with functional output and can approximate any continuous operator. NO have demonstrated the superiority of solving partial differential equations (PDEs) over other…

Numerical Analysis · Mathematics 2024-02-02 Jianguo Huang , Yue Qiu

Modeling complex systems using standard neural ordinary differential equations (NODEs) often faces some essential challenges, including high computational costs and susceptibility to local optima. To address these challenges, we propose a…

Machine Learning · Computer Science 2024-05-24 Xin Li , Jingdong Zhang , Qunxi Zhu , Chengli Zhao , Xue Zhang , Xiaojun Duan , Wei Lin

Fourier Neural Operators (FNOs) excel on tasks using functional data, such as those originating from partial differential equations. Such characteristics render them an effective approach for simulating the time evolution of quantum…

Fourier Neural Operators are deep learning models that learn mappings between function spaces and can be used to learn and solve partial differential equations (PDEs), in some cases significantly faster than traditional PDE solvers. Within…

Machine Learning · Computer Science 2026-05-05 Michael F. Staddon

Traditionally, classical numerical schemes have been employed to solve partial differential equations (PDEs) using computational methods. Recently, neural network-based methods have emerged. Despite these advancements, neural network-based…

Numerical Analysis · Mathematics 2024-05-14 Taeyoung Kim , Myungjoo Kang

Parameters in deep neural networks which are trained on large-scale databases can generalize across multiple domains, which is referred as "transferability". Unfortunately, the transferability is usually defined as discrete states and it…

Machine Learning · Computer Science 2018-04-25 Yinghua Zhang , Yu Zhang , Qiang Yang