English
Related papers

Related papers: Solver-in-the-Loop: Learning from Differentiable P…

200 papers

Pretraining for partial differential equation (PDE) modeling has recently shown promise in scaling neural operators across datasets to improve generalizability and performance. Despite these advances, our understanding of how pretraining…

Machine Learning · Computer Science 2024-10-03 Anthony Zhou , Cooper Lorsung , AmirPouya Hemmasian , Amir Barati Farimani

Neural networks have emerged as powerful surrogates for solving partial differential equations (PDEs), offering significant computational speedups over traditional methods. However, these models suffer from a critical limitation: error…

Machine Learning · Computer Science 2025-12-29 Xinquan Huang , Paris Perdikaris

Machine learning techniques have recently been of great interest for solving differential equations. Training these models is classically a data-fitting task, but knowledge of the expression of the differential equation can be used to…

Dynamical Systems · Mathematics 2024-07-26 James H. Adler , Samuel Hocking , Xiaozhe Hu , Shafiqul Islam

Solving partial differential equations (PDEs) is a required step in the simulation of natural and engineering systems. The associated computational costs significantly increase when exploring various scenarios, such as changes in initial or…

Neural surrogate solvers of partial differential equations (PDEs) promise dramatic speedups over numerical methods, especially in scenarios requiring many solves. However, current accuracy-based evaluations do not fully consider two central…

Machine Learning · Computer Science 2026-05-18 Yijing Zhang , Nicholas Roberts , Tanya Marwah , Mikhail Khodak

Partial differential equations (PDEs) underpin the modeling of many natural and engineered systems. It can be convenient to express such models as neural PDEs rather than using traditional numerical PDE solvers by replacing part or all of…

Machine Learning · Computer Science 2025-09-26 Sanket Jantre , Deepak Akhare , Zhiyuan Wang , Xiaoning Qian , Nathan M. Urban

The solution for non-linear, complex partial differential Equations (PDEs) is achieved through numerical approximations, which yield a linear system of equations. This approach is prevalent in Computational Fluid Dynamics (CFD), but it…

Fluid Dynamics · Physics 2024-09-06 Ferdin Sagai Don Bosco , Dhamotharan S , Rut Lineswala , Abhishek Chopra

Simulating the time evolution of Partial Differential Equations (PDEs) of large-scale systems is crucial in many scientific and engineering domains such as fluid dynamics, weather forecasting and their inverse optimization problems.…

Machine Learning · Computer Science 2022-10-13 Tailin Wu , Takashi Maruyama , Jure Leskovec

We develop a framework for estimating unknown partial differential equations from noisy data, using a deep learning approach. Given noisy samples of a solution to an unknown PDE, our method interpolates the samples using a neural network,…

Machine Learning · Computer Science 2019-10-24 Ali Hasan , João M. Pereira , Robert Ravier , Sina Farsiu , Vahid Tarokh

Recent advances in operator learning have produced two distinct approaches for solving partial differential equations (PDEs): attention-based methods offering point-level adaptability but lacking spectral constraints, and spectral-based…

Machine Learning · Computer Science 2025-06-24 Xihang Yue , Yi Yang , Linchao Zhu

Deep models have achieved impressive progress in solving partial differential equations (PDEs). A burgeoning paradigm is learning neural operators to approximate the input-output mappings of PDEs. While previous deep models have explored…

Machine Learning · Computer Science 2023-05-30 Haixu Wu , Tengge Hu , Huakun Luo , Jianmin Wang , Mingsheng Long

Gradient-based meta-learning methods have primarily been applied to classical machine learning tasks such as image classification. Recently, PDE-solving deep learning methods, such as neural operators, are starting to make an important…

Machine Learning · Computer Science 2023-02-06 Lu Zhang , Huaiqian You , Tian Gao , Mo Yu , Chung-Hao Lee , Yue Yu

Harnessing data to discover the underlying governing laws or equations that describe the behavior of complex physical systems can significantly advance our modeling, simulation and understanding of such systems in various science and…

Machine Learning · Computer Science 2021-11-17 Zhao Chen , Yang Liu , Hao Sun

Deep models have recently emerged as promising tools to solve partial differential equations (PDEs), known as neural PDE solvers. While neural solvers trained from either simulation data or physics-informed loss can solve PDEs reasonably…

Machine Learning · Computer Science 2025-09-05 Hang Zhou , Yuezhou Ma , Haixu Wu , Haowen Wang , Mingsheng Long

Partial differential equations (PDEs) are central to describing and modelling complex physical systems that arise in many disciplines across science and engineering. However, in many realistic applications PDE modelling provides an…

Machine Learning · Computer Science 2023-04-04 Nacime Bouziani , David A. Ham

We introduce the Optimizing a Discrete Loss (ODIL) framework for the numerical solution of Partial Differential Equations (PDE) using machine learning tools. The framework formulates numerical methods as a minimization of discrete residuals…

Numerical Analysis · Mathematics 2024-01-23 Petr Karnakov , Sergey Litvinov , Petros Koumoutsakos

We present a lightweighted neural PDE representation to discover the hidden structure and predict the solution of different nonlinear PDEs. Our key idea is to leverage the prior of ``translational similarity'' of numerical PDE differential…

Machine Learning · Computer Science 2023-03-14 Ziqian Wu , Xingzhe He , Yijun Li , Cheng Yang , Rui Liu , Shiying Xiong , Bo Zhu

The least squares method with deep neural networks as function parametrization has been applied to solve certain high-dimensional partial differential equations (PDEs) successfully; however, its convergence is slow and might not be…

Numerical Analysis · Mathematics 2021-12-30 Yiqi Gu , Haizhao Yang , Chao Zhou

We propose a methodology that combines generative latent diffusion models with physics-informed machine learning to generate solutions of parametric partial differential equations (PDEs) conditioned on partial observations, which includes,…

Machine Learning · Computer Science 2026-02-11 Davide Gallon , Philippe von Wurstemberger , Patrick Cheridito , Arnulf Jentzen

Transformers have empowered many milestones across various fields and have recently been applied to solve partial differential equations (PDEs). However, since PDEs are typically discretized into large-scale meshes with complex geometries,…

Machine Learning · Computer Science 2024-06-04 Haixu Wu , Huakun Luo , Haowen Wang , Jianmin Wang , Mingsheng Long