English
Related papers

Related papers: Mitigating spectral bias for the multiscale operat…

200 papers

Pretraining methods gain increasing attraction recently for solving PDEs with neural operators. It alleviates the data scarcity problem encountered by neural operator learning when solving single PDE via training on large-scale datasets…

Machine Learning · Computer Science 2024-11-28 Tian Wang , Chuang Wang

Stochastic differential equations (SDEs) and stochastic partial differential equations (SPDEs) are fundamental for modeling stochastic dynamics across the natural sciences and modern machine learning. Learning their solution operators with…

Machine Learning · Computer Science 2026-01-30 Dai Shi , Lequan Lin , Andi Han , Luke Thompson , José Miguel Hernández-Lobato , Zhiyong Wang , Junbin Gao

Recently, researchers have utilized neural networks to accurately solve partial differential equations (PDEs), enabling the mesh-free method for scientific computation. Unfortunately, the network performance drops when encountering a high…

Machine Learning · Computer Science 2021-09-29 Pongpisit Thanasutives , Masayuki Numao , Ken-ichi Fukui

Scientific machine learning is an emerging field that broadly describes the combination of scientific computing and machine learning to address challenges in science and engineering. Within the context of differential equations, this has…

Machine Learning · Computer Science 2026-04-03 Laurens R. Lueg , Victor Alves , Daniel Schicksnus , John R. Kitchin , Carl D. Laird , Lorenz T. Biegler

Holographic multiple-input multiple-output (HMIMO) is a potential technique for improving spectral efficiency (SE) while maintaining low hardware cost and power consumption. Although conventional alternating optimization (AO) methods are…

Signal Processing · Electrical Eng. & Systems 2026-01-29 Shiyong Chen , Shengqian Han

Accurate and efficient solutions of spatiotemporal partial differential equations (PDEs), such as phase-field models, are fundamental for understanding interfacial dynamics and microstructural evolution in materials science and fluid…

Computational Physics · Physics 2026-02-19 Mostafa Bamdad , Mohammad Sadegh Eshaghi , Cosmin Anitescu , Navid Valizadeh , Timon Rabczuk

Partial differential equations (PDEs) govern a wide range of physical phenomena, but their numerical solution remains computationally demanding, especially when repeated simulations are required across many parameter settings. Recent…

Machine Learning · Computer Science 2026-05-13 Hamda Hmida , Hsiu-Wen Chang Joly , Youssef Mesri

Operator learning techniques have recently emerged as a powerful tool for learning maps between infinite-dimensional Banach spaces. Trained under appropriate constraints, they can also be effective in learning the solution operator of…

Machine Learning · Computer Science 2021-10-13 Sifan Wang , Hanwen Wang , Paris Perdikaris

We present Neural Spectral Methods, a technique to solve parametric Partial Differential Equations (PDEs), grounded in classical spectral methods. Our method uses orthogonal bases to learn PDE solutions as mappings between spectral…

Machine Learning · Computer Science 2024-01-22 Yiheng Du , Nithin Chalapathi , Aditi Krishnapriyan

Solving partial differential equations (PDEs) efficiently and accurately remains a cornerstone challenge in science and engineering, especially for problems involving complex geometries and limited labeled data. We introduce a Physics- and…

Machine Learning · Computer Science 2025-08-14 Subhankar Sarkar , Souvik Chakraborty

We propose a novel machine learning framework for solving optimization problems governed by large-scale partial differential equations (PDEs) with high-dimensional random parameters. Such optimization under uncertainty (OUU) problems may be…

Optimization and Control · Mathematics 2023-06-01 Dingcheng Luo , Thomas O'Leary-Roseberry , Peng Chen , Omar Ghattas

Neural operators have emerged as powerful surrogates for partial differential equation (PDE) solvers, yet they are typically trained as monolithic models for individual PDEs, require energy-intensive GPU hardware, and must be retrained from…

Machine Learning · Computer Science 2026-04-14 Samrendra Roy , Souvik Chakraborty , Rizwan-uddin , Syed Bahauddin Alam

We propose the Factorized Fourier Neural Operator (F-FNO), a learning-based approach for simulating partial differential equations (PDEs). Starting from a recently proposed Fourier representation of flow fields, the F-FNO bridges the…

Machine Learning · Computer Science 2023-03-03 Alasdair Tran , Alexander Mathews , Lexing Xie , Cheng Soon Ong

Deep neural networks achieve state-of-the-art performance in a variety of tasks by extracting a rich set of features from unstructured data, however this performance is closely tied to model size. Modern techniques for inducing sparsity and…

Machine Learning · Computer Science 2021-03-02 Skyler Seto , Martin T. Wells , Wenyu Zhang

We propose derivative-informed neural operators (DINOs), a general family of neural networks to approximate operators as infinite-dimensional mappings from input function spaces to output function spaces or quantities of interest. After…

Numerical Analysis · Mathematics 2023-10-18 Thomas O'Leary-Roseberry , Peng Chen , Umberto Villa , Omar Ghattas

We introduce a novel Multimodal Neural Operator (MNO) architecture designed to learn solution operators for multi-parameter nonlinear boundary value problems (BVPs). Traditional neural operators primarily map either the PDE coefficients or…

Computational Engineering, Finance, and Science · Computer Science 2025-07-17 Vamshi C. Madala , Nithin Govindarajan , Shivkumar Chandrasekaran

Engineering problems frequently require solution of governing equations with spatially-varying discontinuous coefficients. Even for linear elliptic problems, mapping large ensembles of coefficient fields to solutions can become a major…

Machine Learning · Computer Science 2024-11-12 Conlain Kelly , Surya R. Kalidindi

Partial differential equations (PDEs) are widely used to model complex physical systems, but solving them efficiently remains a significant challenge. Recently, Transformers have emerged as the preferred architecture for PDEs due to their…

Machine Learning · Computer Science 2026-03-12 Chun-Wun Cheng , Jiahao Huang , Yi Zhang , Guang Yang , Carola-Bibiane Schönlieb , Angelica I. Aviles-Rivero

Operator learning has emerged as a promising paradigm for developing efficient surrogate models to solve partial differential equations (PDEs). However, existing approaches often overlook the domain knowledge inherent in the underlying PDEs…

Machine Learning · Computer Science 2025-10-20 Ziqian Li , Kang Liu , Yongcun Song , Hangrui Yue , Enrique Zuazua

This work presents a finite element-guided physics-informed operator learning framework for multiphysics problems with coupled partial differential equations (PDEs) on arbitrary domains. The proposed framework learns an operator from the…

Machine Learning · Computer Science 2026-04-22 Yusuke Yamazaki , Reza Najian Asl , Markus Apel , Mayu Muramatsu , Shahed Rezaei