English
Related papers

Related papers: PDE-Refiner: Achieving Accurate Long Rollouts with…

200 papers

We introduce PDE-Transformer, an improved transformer-based architecture for surrogate modeling of physics simulations on regular grids. We combine recent architectural improvements of diffusion transformers with adjustments specific for…

Machine Learning · Computer Science 2025-06-02 Benjamin Holzschuh , Qiang Liu , Georg Kohl , Nils Thuerey

Neural ordinary differential equations (NODE) have been proposed as a continuous depth generalization to popular deep learning models such as Residual networks (ResNets). They provide parameter efficiency and automate the model selection…

Machine Learning · Computer Science 2021-12-24 Srinivas Anumasa , P. K. Srijith

Spatiotemporal partial differential equations (PDEs) underpin a wide range of scientific and engineering applications. Neural PDE solvers offer a promising alternative to classical numerical methods. However, existing approaches typically…

Machine Learning · Computer Science 2026-03-03 Yingjie Tan , Quanming Yao , Yaqing Wang

Accurately learning solution operators for time-dependent partial differential equations (PDEs) from sparse and irregular data remains a challenging task. Recurrent DeepONet extensions inherit the discrete-time limitations of…

Computational Engineering, Finance, and Science · Computer Science 2025-07-04 Diab W. Abueidda , Mbebo Nonna , Panos Pantidis , Mostafa E. Mobasher

In this work, we study physics-informed neural networks (PINNs) constrained by partial differential equations (PDEs) and their application in approximating PDEs with two characteristic scales. From a continuous perspective, our formulation…

Optimization and Control · Mathematics 2024-09-06 Michael Hintermüller , Denis Korolev

Partial differential equations (PDEs) are central to scientific modeling. Modern workflows increasingly rely on learning-based components to support model reuse, inference, and integration across large computational processes. Despite the…

Machine Learning · Computer Science 2026-02-20 Yilong Dai , Shengyu Chen , Ziyi Wang , Xiaowei Jia , Yiqun Xie , Vipin Kumar , Runlong Yu

Physics-informed neural networks (PINNs) have shown promising potential for solving partial differential equations (PDEs) using deep learning. However, PINNs face training difficulties for evolutionary PDEs, particularly for dynamical…

Neural and Evolutionary Computing · Computer Science 2023-12-25 Siqi Chen , Bin Shan , Ye Li

Partial Differential Equations (PDE) are fundamental to model different phenomena in science and engineering mathematically. Solving them is a crucial step towards a precise knowledge of the behaviour of natural and engineered systems. In…

Deep learning has been proposed as an efficient alternative for the numerical approximation of PDE solutions, offering fast, iterative simulation of PDEs through the approximation of solution operators. However, deep learning solutions have…

Machine Learning · Computer Science 2026-02-02 Sean Current , Chandan Kumar , Datta Gaitonde , Srinivasan Parthasarathy

Machine learning for scientific applications faces the challenge of limited data. We propose a framework that leverages a priori known physics to reduce overfitting when training on relatively small datasets. A deep neural network is…

Machine Learning · Computer Science 2019-11-22 Jonathan B. Freund , Jonathan F. MacArt , Justin Sirignano

Physics-Informed Neural Networks (PINNs) are machine learning tools that approximate the solution of general partial differential equations (PDEs) by adding them in some form as terms of the loss/cost function of a Neural Network. Most…

Numerical Analysis · Mathematics 2022-08-29 Antonio Tadeu Azevedo Gomes , Larissa Miguez da Silva , Frederic Valentin

Inverse problems in partial differential equations (PDEs) involve estimating the physical parameters of a system from observed spatiotemporal solution fields. Neural networks are well-suited for PDE parameter estimation due to their…

Machine Learning · Computer Science 2026-05-27 Divyam Goel , Nithin Chalapathi , Sanjeev Raja , Aditi S. Krishnapriyan

Identifying parameters in partial differential equations (PDEs) represents a very broad class of applied inverse problems. In recent years, several unsupervised learning approaches using (deep) neural networks have been developed to solve…

Numerical Analysis · Mathematics 2025-08-22 Siyu Cen , Bangti Jin , Qimeng Quan , Zhi Zhou

Traditional data-driven deep learning models often struggle with high training costs, error accumulation, and poor generalizability in complex physical processes. Physics-informed deep learning (PiDL) addresses these challenges by…

Machine Learning · Computer Science 2024-01-17 Xin-Yang Liu , Min Zhu , Lu Lu , Hao Sun , Jian-Xun Wang

We propose a novel machine learning framework for solving optimization problems governed by large-scale partial differential equations (PDEs) with high-dimensional random parameters. Such optimization under uncertainty (OUU) problems may be…

Optimization and Control · Mathematics 2023-06-01 Dingcheng Luo , Thomas O'Leary-Roseberry , Peng Chen , Omar Ghattas

We present approximation theories and efficient training methods for derivative-informed Fourier neural operators (DIFNOs) with applications to PDE-constrained optimization. A DIFNO is an FNO trained by minimizing its prediction error…

Machine Learning · Computer Science 2026-03-17 Boyuan Yao , Dingcheng Luo , Lianghao Cao , Nikola Kovachki , Thomas O'Leary-Roseberry , Omar Ghattas

Solving time-dependent partial differential equations (PDEs) that exhibit sharp gradients or local singularities is computationally demanding, as traditional physics-informed neural networks (PINNs) often suffer from inefficient point…

Numerical Analysis · Mathematics 2026-01-27 Beining Xu , Haijun Yu , Jiayu Zhai , Kejun Tang , Xiaoliang Wan

Solving Partial Differential Equations (PDEs) is a cornerstone of engineering and scientific research. Traditional methods for PDE solving are cumbersome, relying on manual setup and domain expertise. While Physics-Informed Neural Network…

Artificial Intelligence · Computer Science 2025-12-23 Jianming Liu , Ren Zhu , Jian Xu , Kun Ding , Xu-Yao Zhang , Gaofeng Meng , Cheng-Lin Liu

Partial differential equations (PDEs) play a fundamental role in modeling and simulating problems across a wide range of disciplines. Recent advances in deep learning have shown the great potential of physics-informed neural networks…

Machine Learning · Computer Science 2022-01-31 Pu Ren , Chengping Rao , Yang Liu , Jianxun Wang , Hao Sun

A computed approximation of the solution operator to a system of partial differential equations (PDEs) is needed in various areas of science and engineering. Neural operators have been shown to be quite effective at predicting these…

Machine Learning · Computer Science 2024-12-02 Zan Ahmad , Shiyi Chen , Minglang Yin , Avisha Kumar , Nicolas Charon , Natalia Trayanova , Mauro Maggioni