English
Related papers

Related papers: Mitigating spectral bias for the multiscale operat…

200 papers

We propose the Inverse Neural Operator (INO), a two-stage framework for recovering hidden ODE parameters from sparse, partial observations. In Stage 1, a Conditional Fourier Neural Operator (C-FNO) with cross-attention learns a…

Machine Learning · Computer Science 2026-03-13 Zhi-Song Liu , Wenqing Peng , Helmi Toropainen , Ammar Kheder , Andreas Rupp , Holger Froning , Xiaojie Lin , Michael Boy

Neural operators are a type of deep architecture that learns to solve (i.e. learns the nonlinear solution operator of) partial differential equations (PDEs). The current state of the art for these models does not provide explicit…

Machine Learning · Computer Science 2022-08-03 Emilia Magnani , Nicholas Krämer , Runa Eschenhagen , Lorenzo Rosasco , Philipp Hennig

Developing fast surrogates for Partial Differential Equations (PDEs) will accelerate design and optimization in almost all scientific and engineering applications. Neural networks have been receiving ever-increasing attention and…

Machine Learning · Computer Science 2024-11-21 AmirPouya Hemmasian , Amir Barati Farimani

Learning solution operators of partial differential equations (PDEs) from data has emerged as a promising route to fast surrogate models in multi-query scientific workflows. However, for geometric PDEs whose inputs and outputs transform…

Artificial Intelligence · Computer Science 2026-03-17 Pengcheng Cheng

Neural operators have emerged as fast surrogate solvers for parametric partial differential equations (PDEs). However, purely data-driven models often require extensive training data and can generalize poorly, especially in small-data…

Machine Learning · Computer Science 2026-02-16 Heechang Kim , Qianying Cao , Hyomin Shin , Seungchul Lee , George Em Karniadakis , Minseok Choi

Neural operators have emerged as a powerful tool for solving partial differential equations (PDEs) and other complex scientific computing tasks. However, the performance of single operator block is often limited, thus often requiring…

Numerical Analysis · Mathematics 2025-07-18 Yichen Wang , Wenlian Lu

Neural networks (NNs) have been widely used to solve partial differential equations (PDEs) in the applications of physics, biology, and engineering. One effective approach for solving PDEs with a fixed differential operator is learning…

Numerical Analysis · Mathematics 2025-11-21 Wenrui Hao , Rui Peng Li , Yuanzhe Xi , Tianshi Xu , Yahong Yang

Quantum machine learning models based on parameterized circuits can be viewed as Fourier series approximators. However, they often struggle to learn functions with multiple frequency components, particularly high-frequency or non-dominant…

Quantum Physics · Physics 2026-05-06 Ammar Daskin

Neural operators have achieved strong performance in learning solution operators of partial differential equations (PDEs), but their inherently continuous representations struggle to capture discontinuities and sharp transitions. Existing…

Machine Learning · Computer Science 2026-05-20 Ha Dang , Sebastian Schmidt , Juergen Hesser

This focused review explores a range of neural operator architectures for approximating solutions to parametric partial differential equations (PDEs), emphasizing high-level concepts and practical implementation strategies. The study covers…

Computational Engineering, Finance, and Science · Computer Science 2025-03-10 Prashant K. Jha

Neural ordinary differential equations (NODE) have garnered significant attention for their design of continuous-depth neural networks and the ability to learn data/feature dynamics. However, for high-dimensional systems, estimating…

Machine Learning · Computer Science 2025-10-07 Muhao Guo , Haoran Li , Yang Weng

Uncertainty quantification in PDE inverse problems is essential in many applications. Scientific machine learning and AI enable data-driven learning of model components while preserving physical structure, and provide the scalability and…

Machine Learning · Computer Science 2026-01-12 Ray Zirui Zhang , Christopher E. Miles , Xiaohui Xie , John S. Lowengrub

We introduce Neural Parameter Regression (NPR), a novel framework specifically developed for learning solution operators in Partial Differential Equations (PDEs). Tailored for operator learning, this approach surpasses traditional DeepONets…

Machine Learning · Computer Science 2024-03-20 Konrad Mundinger , Max Zimmer , Sebastian Pokutta

Multi-objective optimization (MOO) problems are prevalent in machine learning. These problems have a set of optimal solutions, called the Pareto front, where each point on the front represents a different trade-off between possibly…

Machine Learning · Computer Science 2021-04-27 Aviv Navon , Aviv Shamsian , Gal Chechik , Ethan Fetaya

Operator learning has emerged as a powerful tool in scientific computing for approximating mappings between infinite-dimensional function spaces. A primary application of operator learning is the development of surrogate models for the…

Machine Learning · Statistics 2025-04-07 Unique Subedi , Ambuj Tewari

The physics-informed neural operator (PINO) is a machine learning paradigm that has demonstrated promising results for learning solutions to partial differential equations (PDEs). It leverages the Fourier Neural Operator to learn solution…

Discovering hidden physical laws and identifying governing system parameters from sparse observations are central challenges in computational science and engineering. Existing data-driven methods, such as physics-informed neural networks…

Machine Learning · Computer Science 2026-04-16 Dibakar Roy Sarkar , Vijay Kag , Birupaksha Pal , Somdatta Goswami

Polynomial neural networks (PNNs) have been recently shown to be particularly effective at image generation and face recognition, where high-frequency information is critical. Previous studies have revealed that neural networks demonstrate…

Machine Learning · Computer Science 2022-03-01 Moulik Choraria , Leello Tadesse Dadi , Grigorios Chrysos , Julien Mairal , Volkan Cevher

Engineering design problems often involve solving parametric Partial Differential Equations (PDEs) under variable PDE parameters and domain geometry. Recently, neural operators have shown promise in learning PDE operators and quickly…

Machine Learning · Computer Science 2024-11-14 Weiheng Zhong , Hadi Meidani

Deep learning-based methods have shown remarkable effectiveness in solving PDEs, largely due to their ability to enable fast simulations once trained. However, despite the availability of high-performance computing infrastructure, many…

Machine Learning · Computer Science 2026-02-23 Pietro Sittoni , Emanuele Zangrando , Angelo A. Casulli , Nicola Guglielmi , Francesco Tudisco