English
Related papers

Related papers: Towards Multi-spatiotemporal-scale Generalized PDE…

200 papers

Despite the promise of scientific machine learning (SciML) in combining data-driven techniques with mechanistic modeling, existing approaches for incorporating hard constraints in neural differential equations (NDEs) face significant…

Machine Learning · Computer Science 2025-05-28 Avik Pal , Alan Edelman , Christopher Rackauckas

Computationally efficient surrogates for parametrized physical models play a crucial role in science and engineering. Operator learning provides data-driven surrogates that map between function spaces. However, instead of full-field…

Machine Learning · Computer Science 2024-12-31 Daniel Zhengyu Huang , Nicholas H. Nelsen , Margaret Trautner

Physics-Informed Neural Networks (PINNs) are machine learning tools that approximate the solution of general partial differential equations (PDEs) by adding them in some form as terms of the loss/cost function of a Neural Network. Most…

Numerical Analysis · Mathematics 2022-08-29 Antonio Tadeu Azevedo Gomes , Larissa Miguez da Silva , Frederic Valentin

Fourier Neural Operators (FNO) have emerged as promising solutions for efficiently solving partial differential equations (PDEs) by learning infinite-dimensional function mappings through frequency domain transformations. However, the…

Machine Learning · Computer Science 2025-05-22 Tianyu Chen , Haoyi Zhou , Ying Li , Hao Wang , Zhenzhe Zhang , Tianchen Zhu , Shanghang Zhang , Jianxin Li

The neural operator has emerged as a powerful tool in learning mappings between function spaces in PDEs. However, when faced with real-world physical data, which are often highly non-uniformly distributed, it is challenging to use…

Machine Learning · Computer Science 2023-06-01 Songming Liu , Zhongkai Hao , Chengyang Ying , Hang Su , Ze Cheng , Jun Zhu

Partial differential equations play a fundamental role in the mathematical modelling of many processes and systems in physical, biological and other sciences. To simulate such processes and systems, the solutions of PDEs often need to be…

Numerical Analysis · Mathematics 2023-02-09 Tamara G. Grossmann , Urszula Julia Komorowska , Jonas Latz , Carola-Bibiane Schönlieb

Neural ordinary differential equations (NODE) have been proposed as a continuous depth generalization to popular deep learning models such as Residual networks (ResNets). They provide parameter efficiency and automate the model selection…

Machine Learning · Computer Science 2021-12-24 Srinivas Anumasa , P. K. Srijith

The computational complexity of classical numerical methods for solving Partial Differential Equations (PDE) scales significantly as the resolution increases. As an important example, climate predictions require fine spatio-temporal…

Machine Learning · Computer Science 2022-10-12 Oussama Boussif , Dan Assouline , Loubna Benabbou , Yoshua Bengio

In this paper we propose a new model-based unsupervised learning method, called VarNet, for the solution of partial differential equations (PDEs) using deep neural networks (NNs). Particularly, we propose a novel loss function that relies…

Machine Learning · Computer Science 2019-12-17 Reza Khodayi-Mehr , Michael M. Zavlanos

Neural operators have emerged as powerful deep learning frameworks for approximating solution operators of parameterized partial differential equations (PDE). However, current methods predominantly rely on multilayer perceptrons (MLPs) for…

Fluid Dynamics · Physics 2026-02-03 Biao Chen , Jing Wang , Hairun Xie , Qineng Wang , Shuai Zhang , Yifan Xia , Jifa Zhang

We present Mechanistic PDE Networks -- a model for discovery of governing partial differential equations from data. Mechanistic PDE Networks represent spatiotemporal data as space-time dependent linear partial differential equations in…

Machine Learning · Computer Science 2025-06-12 Adeel Pervez , Efstratios Gavves , Francesco Locatello

Transfer learning for partial differential equations (PDEs) is to develop a pre-trained neural network that can be used to solve a wide class of PDEs. Existing transfer learning approaches require much information of the target PDEs such as…

Numerical Analysis · Mathematics 2023-01-30 Zezhong Zhang , Feng Bao , Lili Ju , Guannan Zhang

A computed approximation of the solution operator to a system of partial differential equations (PDEs) is needed in various areas of science and engineering. Neural operators have been shown to be quite effective at predicting these…

Machine Learning · Computer Science 2024-12-02 Zan Ahmad , Shiyi Chen , Minglang Yin , Avisha Kumar , Nicolas Charon , Natalia Trayanova , Mauro Maggioni

Neural networks have been applied to control problems, typically by combining data, differential equation residuals, and objective costs in the training loss or by incorporating auxiliary architectural components. Instead, we propose a…

Optimization and Control · Mathematics 2026-04-10 Oliver G. S. Lundqvist , Fabricio Oliveira

Neural operators have shown great potential in surrogate modeling. However, training a well-performing neural operator typically requires a substantial amount of data, which can pose a major challenge in complex applications. In such…

Machine Learning · Computer Science 2026-02-05 Keyan Chen , Yile Li , Da Long , Zhitong Xu , Wei Xing , Jacob Hochhalter , Shandian Zhe

Neural differential equations offer a powerful approach for learning dynamics from data. However, they do not impose known constraints that should be obeyed by the learned model. It is well-known that enforcing constraints in surrogate…

Deep surrogate models for parametric partial differential equations (PDEs) can deliver high-fidelity approximations but remain prohibitively data-hungry: training often requires thousands of fine-grid simulations, each incurring substantial…

Machine Learning · Computer Science 2026-03-03 Yang Meng , Ruoxi Jiang , Zhuokai Zhao , Chong Liu , Rebecca Willett , Yuxin Chen

Recently, a lot of papers proposed to use neural networks to approximately solve partial differential equations (PDEs). Yet, there has been a lack of flexible framework for convenient experimentation. In an attempt to fill the gap, we…

Machine Learning · Computer Science 2019-09-26 Alexander Koryagin , Roman Khudorozkov , Sergey Tsimfer

In certain practical engineering applications, there is an urgent need to perform repetitive solving of partial differential equations (PDEs) in a short period. This paper primarily considers three scenarios requiring extensive repetitive…

Numerical Analysis · Mathematics 2025-08-06 Bo Yang , Xingquan Li , Jie Zhao , Ying Jiang

Physics-informed neural networks (PINNs) have emerged as a promising approach to solving partial differential equations (PDEs) using neural networks, particularly in data-scarce scenarios, due to their unsupervised training capability.…

Machine Learning · Computer Science 2025-03-25 Edgar Torres , Jonathan Schiefer , Mathias Niepert