English
Related papers

Related papers: Training Deep Surrogate Models with Large Scale On…

200 papers

Deep models have recently emerged as promising tools to solve partial differential equations (PDEs), known as neural PDE solvers. While neural solvers trained from either simulation data or physics-informed loss can solve PDEs reasonably…

Machine Learning · Computer Science 2025-09-05 Hang Zhou , Yuezhou Ma , Haixu Wu , Haowen Wang , Mingsheng Long

Neural networks can be used as surrogates for PDE models. They can be made physics-aware by penalizing underlying equations or the conservation of physical properties in the loss function during training. Current approaches allow to…

Machine Learning · Computer Science 2022-07-01 Raphael Leiteritz , Patrick Buchfink , Bernard Haasdonk , Dirk Pflüger

High-performance scientific simulations, important for comprehension of complex systems, encounter computational challenges especially when exploring extensive parameter spaces. There has been an increasing interest in developing deep…

Machine Learning · Computer Science 2024-07-15 Pradeep Bajracharya , Javier Quetzalcóatl Toledo-Marín , Geoffrey Fox , Shantenu Jha , Linwei Wang

Neural network surrogate models have emerged as a promising approach to model solution fields for a wide variety of boundary value problems encountered in physical modeling. Stochastic problems represent an area of particularly high…

Machine Learning · Statistics 2026-05-18 Noah Wade , Kirubel Teferra

We propose a novel type of nonlinear solver acceleration for systems of nonlinear partial differential equations (PDEs) that is based on online/adaptive learning. It is applied in the context of multiphase flow in porous media. The proposed…

Machine Learning · Computer Science 2025-04-28 Vinicius L S Silva , Pablo Salinas , Claire E Heaney , Matthew Jackson , Christopher C Pain

High-fidelity simulation of complex physical systems is exorbitantly expensive and inaccessible across spatiotemporal scales. Recently, there has been an increasing interest in leveraging deep learning to augment scientific data based on…

Machine Learning · Computer Science 2022-08-03 Pu Ren , Chengping Rao , Yang Liu , Zihan Ma , Qi Wang , Jian-Xun Wang , Hao Sun

Surrogate modeling is of great practical significance for parametric differential equation systems. In contrast to classical numerical methods, using physics-informed deep learning methods to construct simulators for such systems is a…

Numerical Analysis · Mathematics 2025-01-03 Xili Wang , Kejun Tang , Jiayu Zhai , Xiaoliang Wan , Chao Yang

We present a scalable framework for learning deterministic and probabilistic neural surrogates for high-resolution 3D physics simulations. We introduce a hybrid CNN-Transformer backbone architecture targeted for 3D physics simulations,…

Machine Learning · Computer Science 2025-10-09 Benjamin Holzschuh , Georg Kohl , Florian Redinger , Nils Thuerey

Diffusion models have recently emerged as powerful stochastic frameworks for high-dimensional inference and generation. However, existing applications to partial differential equations (PDEs) predominantly rely on physics-informed training…

Numerical Analysis · Mathematics 2026-04-03 Yi Bing , Liu Jia , Fu Jinyang , Peng Xiang

Machine learning (ML) models have emerged as a promising approach for solving partial differential equations (PDEs) in science and engineering. Previous ML models typically cannot generalize outside the training data; for example, a trained…

Machine Learning · Computer Science 2025-07-28 Zongyi Li , Samuel Lanthaler , Catherine Deng , Michael Chen , Yixuan Wang , Kamyar Azizzadenesheli , Anima Anandkumar

Multiscale modeling is an effective approach for investigating multiphysics systems with largely disparate size features, where models with different resolutions or heterogeneous descriptions are coupled together for predicting the system's…

Computational Engineering, Finance, and Science · Computer Science 2022-12-07 Minglang Yin , Enrui Zhang , Yue Yu , George Em Karniadakis

Neural networks have shown significant potential in solving partial differential equations (PDEs). While deep networks are capable of approximating complex functions, direct one-shot training often faces limitations in both accuracy and…

Numerical Analysis · Mathematics 2025-03-10 Mingxing Weng , Zhiping Mao , Jie Shen

Neural networks have shown great potential in accelerating the solution of partial differential equations (PDEs). Recently, there has been a growing interest in introducing physics constraints into training neural PDE solvers to reduce the…

Machine Learning · Computer Science 2023-05-30 Xinquan Huang , Wenlei Shi , Qi Meng , Yue Wang , Xiaotian Gao , Jia Zhang , Tie-Yan Liu

The computational resources required to solve the full 3D inversion of time-domain electromagnetic data are immense. To overcome the time-consuming 3D simulations, we construct a surrogate model, more precisely, a data-driven statistical…

Geophysics · Physics 2024-07-10 Wouter Deleersnyder , David Dudal , Thomas Hermans

Deep neural operators can learn nonlinear mappings between infinite-dimensional function spaces via deep neural networks. As promising surrogate solvers of partial differential equations (PDEs) for real-time prediction, deep neural…

Machine Learning · Computer Science 2023-05-17 Min Zhu , Handi Zhang , Anran Jiao , George Em Karniadakis , Lu Lu

Modern computational methods, involving highly sophisticated mathematical formulations, enable several tasks like modeling complex physical phenomenon, predicting key properties and design optimization. The higher fidelity in these computer…

Computational Engineering, Finance, and Science · Computer Science 2023-04-13 Lele Luan , Nesar Ramachandra , Sandipp Krishnan Ravi , Anindya Bhaduri , Piyush Pandita , Prasanna Balaprakash , Mihai Anitescu , Changjie Sun , Liping Wang

Can neural networks learn to solve partial differential equations (PDEs)? We investigate this question for two (systems of) PDEs, namely, the Poisson equation and the steady Navier--Stokes equations. The contributions of this paper are…

Machine Learning · Computer Science 2019-04-16 Tim Dockhorn

We propose a non-intrusive method to build surrogate models that approximate the solution of parameterized partial differential equations (PDEs), capable of taking into account the dependence of the solution on the shape of the…

Numerical Analysis · Mathematics 2024-09-20 Linying Zhang , Stefano Pagani , Jun Zhang , Francesco Regazzoni

Neural operators have achieved strong performance in learning solution operators of partial differential equations (PDEs), but their inherently continuous representations struggle to capture discontinuities and sharp transitions. Existing…

Machine Learning · Computer Science 2026-05-20 Ha Dang , Sebastian Schmidt , Juergen Hesser

Accurate yet efficient surrogate models are essential for large-scale simulations of partial differential equations (PDEs), particularly for uncertainty quantification (UQ) tasks that demand hundreds or thousands of evaluations. We develop…