English
Related papers

Related papers: Training Deep Surrogate Models with Large Scale On…

200 papers

Embedding physical knowledge into neural network (NN) training has been a hot topic. However, when facing the complex real-world, most of the existing methods still strongly rely on the quantity and quality of observation data. Furthermore,…

Fluid Dynamics · Physics 2024-11-20 Dashan Zhang , Yuntian Chen , Shiyi Chen

A common trend in simulation-driven engineering applications is the ever-increasing size and complexity of the problem, where classical numerical methods typically suffer from significant computational time and huge memory cost. Methods…

Computational Engineering, Finance, and Science · Computer Science 2025-10-28 Jiachen Guo , Chanwook Park , Xiaoyu Xie , Zhongsheng Sang , Gregory J. Wagner , Wing Kam Liu

Neural networks (NNs) are often used as surrogates or emulators of partial differential equations (PDEs) that describe the dynamics of complex systems. A virtually negligible computational cost of such surrogates renders them an attractive…

Numerical Analysis · Mathematics 2021-05-04 Dong H. Song , Daniel M. Tartakovsky

Accurately solving partial differential equations (PDEs) is critical to understanding complex scientific and engineering phenomena, yet traditional numerical solvers are computationally expensive. Surrogate models offer a more efficient…

Machine Learning · Computer Science 2026-04-17 Yegon Kim , Hyunsu Kim , Gyeonghoon Ko , Juho Lee

Solving partial differential equations (PDEs) can be prohibitively expensive using traditional numerical methods. Deep learning-based surrogate models typically specialize in a single PDE with fixed parameters. We present a framework for…

Machine Learning · Computer Science 2025-11-14 Qian-Ze Zhu , Paul Raccuglia , Michael P. Brenner

Simulating the time evolution of Partial Differential Equations (PDEs) of large-scale systems is crucial in many scientific and engineering domains such as fluid dynamics, weather forecasting and their inverse optimization problems.…

Machine Learning · Computer Science 2022-10-13 Tailin Wu , Takashi Maruyama , Jure Leskovec

Finding accurate solutions to partial differential equations (PDEs) is a crucial task in all scientific and engineering disciplines. It has recently been shown that machine learning methods can improve the solution accuracy by correcting…

Computational Physics · Physics 2021-01-06 Kiwon Um , Robert Brand , Yun , Fei , Philipp Holl , Nils Thuerey

The development of efficient surrogates for partial differential equations (PDEs) is a critical step towards scalable modeling of complex, multiscale systems-of-systems. Convolutional neural networks (CNNs) have gained popularity as the…

Machine Learning · Computer Science 2025-06-04 Adrienne M. Propp , Daniel M. Tartakovsky

Recent years have witnessed the promise of coupling machine learning methods and physical domain-specific insights for solving scientific problems based on partial differential equations (PDEs). However, being data-intensive, these methods…

Machine Learning · Computer Science 2025-06-03 Wuyang Chen , Jialin Song , Pu Ren , Shashank Subramanian , Dmitriy Morozov , Michael W. Mahoney

Modeling the evolution of physical systems is critical to many applications in science and engineering. As the evolution of these systems is governed by partial differential equations (PDEs), there are a number of computational simulations…

Machine Learning · Computer Science 2025-03-17 Bharat Srikishan , Daniel O'Malley , Mohamed Mehana , Nicholas Lubbers , Nikhil Muralidhar

Sparse regression on a library of candidate features has developed as the prime method to discover the partial differential equation underlying a spatio-temporal data-set. These features consist of higher order derivatives, limiting model…

Machine Learning · Computer Science 2021-05-05 Gert-Jan Both , Gijs Vermarien , Remy Kusters

The data-driven discovery of partial differential equations (PDEs) consistent with spatiotemporal data is experiencing a rebirth in machine learning research. Training deep neural networks to learn such data-driven partial differential…

Numerical Analysis · Mathematics 2020-11-10 Hassan Arbabi , Judith E. Bunder , Giovanni Samaey , Anthony J. Roberts , Ioannis G. Kevrekidis

Machine learning for differential equations paves the way for computationally efficient alternatives to numerical solvers, with potentially broad impacts in science and engineering. Though current algorithms typically require simulated…

Machine Learning · Computer Science 2024-02-15 Grégoire Mialon , Quentin Garrido , Hannah Lawrence , Danyal Rehman , Yann LeCun , Bobak T. Kiani

We propose a machine learning framework to accelerate numerical computations of time-dependent ODEs and PDEs. Our method is based on recasting (generalizations of) existing numerical methods as artificial neural networks, with a set of…

Numerical Analysis · Mathematics 2019-03-08 Siddhartha Mishra

Data-driven discovery of partial differential equations (PDEs) has attracted increasing attention in recent years. Although significant progress has been made, certain unresolved issues remain. For example, for PDEs with high-order…

Machine Learning · Computer Science 2021-09-14 Hao Xu , Dongxiao Zhang , Nanzhe Wang

Learning underlying dynamics from data is important and challenging in many real-world scenarios. Incorporating differential equations (DEs) to design continuous networks has drawn much attention recently, however, most prior works make…

Machine Learning · Computer Science 2023-02-03 Yesom Park , Jaemoo Choi , Changyeon Yoon , Chang hoon Song , Myungjoo Kang

Partial Differential Equations (PDEs) are central to science and engineering. Since solving them is computationally expensive, a lot of effort has been put into approximating their solution operator via both traditional and recently…

Machine Learning · Computer Science 2025-02-14 Alessandro Longhi , Danny Lathouwers , Zoltán Perkó

Developing accurate, data-efficient surrogate models is central to advancing AI for Science. Neural operators (NOs), which approximate mappings between infinite-dimensional function spaces using conventional neural architectures, have…

Machine Learning · Computer Science 2025-09-26 Dibyajyoti Nayak , Somdatta Goswami

Surrogate models are used to alleviate the computational burden in engineering tasks, which require the repeated evaluation of computationally demanding models of physical systems, such as the efficient propagation of uncertainties. For…

Machine Learning · Statistics 2022-09-28 Felix Schneider , Iason Papaioannou , Gerhard Müller

Neural surrogate solvers of partial differential equations (PDEs) promise dramatic speedups over numerical methods, especially in scenarios requiring many solves. However, current accuracy-based evaluations do not fully consider two central…

Machine Learning · Computer Science 2026-05-18 Yijing Zhang , Nicholas Roberts , Tanya Marwah , Mikhail Khodak