English
Related papers

Related papers: Variationally correct operator learning: Reduced b…

200 papers

DeepONet has recently been proposed as a representative framework for learning nonlinear mappings between function spaces. However, when it comes to approximating solution operators of partial differential equations (PDEs) with…

Numerical Analysis · Mathematics 2024-08-09 Yameng Zhu , Jingrun Chen , Weibing Deng

Classical sequential models employed in time-series prediction rely on learning the mappings from the past to the future instances by way of a hidden state. The Hidden states characterise the historical information and encode the required…

Machine Learning · Computer Science 2023-02-14 Vignesh Gopakumar , Stanislas Pamela , Lorenzo Zanisi

Deep learning has been proposed as an efficient alternative for the numerical approximation of PDE solutions, offering fast, iterative simulation of PDEs through the approximation of solution operators. However, deep learning solutions have…

Machine Learning · Computer Science 2026-02-02 Sean Current , Chandan Kumar , Datta Gaitonde , Srinivasan Parthasarathy

Partial Differential Equation (PDE) problems often exhibit strong local spatial structures, and effectively capturing these structures is critical for approximating their solutions. Recently, the Fourier Neural Operator (FNO) has emerged as…

Machine Learning · Computer Science 2025-06-05 Chaoyu Liu , Davide Murari , Lihao Liu , Yangming Li , Chris Budd , Carola-Bibiane Schönlieb

We propose a new approach to learning the subgrid-scale model when simulating partial differential equations (PDEs) solved by the method of lines and their representation in chaotic ordinary differential equations, based on neural ordinary…

Numerical Analysis · Mathematics 2023-04-14 Shinhoo Kang , Emil M. Constantinescu

For numerical approximation the reformulation of a PDE as a residual minimisation problem has the advantages that the resulting linear system is symmetric positive definite, and that the norm of the residual provides an a posteriori error…

Numerical Analysis · Mathematics 2023-05-29 Harald Monsuur , Rob Stevenson , Johannes Storn

The numerical approximation of the Boltzmann collision operator presents significant challenges arising from its high dimensionality, nonlinear structure, and nonlocal integral form. In this work, we propose a Fourier Neural Operator (FNO)…

Numerical Analysis · Mathematics 2025-10-16 Boyun Hu , Kunlun Qi

We present a method for computing the inverse parameters and the solution field to inverse parametric PDEs based on randomized neural networks. This extends the local extreme learning machine technique originally developed for forward PDEs…

Numerical Analysis · Mathematics 2023-06-28 Suchuan Dong , Yiran Wang

Training neural PDE solvers is often bottlenecked by expensive data generation or unstable physics-informed neural network (PINN) involving challenging optimization landscapes due to higher-order derivatives. To tackle this issue, we…

Machine Learning · Computer Science 2026-03-04 Hrishikesh Viswanath , Hong Chul Nam , Xi Deng , Julius Berner , Anima Anandkumar , Aniket Bera

Neural networks can be used to learn the solution of partial differential equations (PDEs) on arbitrary domains without requiring a computational mesh. Common approaches integrate differential operators in training neural networks using a…

Machine Learning · Computer Science 2022-07-07 Shamsulhaq Basir , Inanc Senocak

The computational overhead of traditional numerical solvers for partial differential equations (PDEs) remains a critical bottleneck for large-scale parametric studies and design optimization. We introduce a Minimal-Data Parametric Neural…

Machine Learning · Computer Science 2026-05-15 Qiyun Cheng , Md Hossain Sahadath , Huihua Yang , Shaowu Pan , Wei Ji

Optimization-based PDE solvers that minimize scalar loss functions have gained increasing attention in recent years. These methods either define the loss directly over discrete variables, as in Optimizing a Discrete Loss (ODIL), or…

Computational Engineering, Finance, and Science · Computer Science 2025-08-06 Wenbo Cao , Weiwei Zhang

Solving partial differential equations (PDEs) by neural networks as well as Kolmogorov-Arnold Networks (KANs), including physics-informed neural networks (PINNs), physics-informed KANs (PIKANs), and neural operators, are known to exhibit…

In the wake of the explosive growth in smartphones and cyberphysical systems, there has been an accelerating shift in how data is generated away from centralised data towards on-device generated data. In response, machine learning…

Machine Learning · Computer Science 2021-12-09 Ross Drummond , Mathew C. Turner , Stephen R. Duncan

Physics-informed neural operators have emerged as a powerful paradigm for solving parametric partial differential equations (PDEs), particularly in the aerospace field, enabling the learning of solution operators that generalize across…

Machine Learning · Computer Science 2025-06-24 Jing Wang , Biao Chen , Hairun Xie , Rui Wang , Yifan Xia , Jifa Zhang , Hui Xu

We propose an approach to solving partial differential equations (PDEs) using a set of neural networks which we call Neural Basis Functions (NBF). This NBF framework is a novel variation of the POD DeepONet operator learning approach where…

Machine Learning · Computer Science 2022-08-04 David Witman , Alexander New , Hicham Alkendry , Honest Mrema

Laplace Neural Operators (LNOs) have recently emerged as a promising approach in scientific machine learning due to the ability to learn nonlinear maps between functional spaces. However, this framework often requires substantial amounts of…

Machine Learning · Computer Science 2025-02-04 Haoyang Zheng , Guang Lin

Off-policy updates are inevitable in reinforcement learning (RL) for large language models (LLMs) due to rollout staleness from asynchronous training and mismatches between training and inference engines. Naive importance sampling gives an…

Machine Learning · Computer Science 2026-05-11 Guobin Shen , Chenxiao Zhao , Xiang Cheng , Lei Huang , Xing Yu

A kernel-based approach for the learning of the solution operator of general nonhomogeneous partial differential equations (PDEs) is proposed. The method incorporates physical priors, typically encoded through the PDE operator, into a…

Numerical Analysis · Mathematics 2026-05-12 Jianyu Hu , Juan-Pablo Ortega

Unconstrained Online Linear Optimization (OLO) is a practical problem setting to study the training of machine learning models. Existing works proposed a number of potential-based algorithms, but in general the design of these potential…

Machine Learning · Computer Science 2022-06-16 Zhiyu Zhang , Ashok Cutkosky , Ioannis Paschalidis