English
Related papers

Related papers: NOWS: Neural Operator Warm Starts for Accelerating…

200 papers

Stochastic differential equations (SDEs) and stochastic partial differential equations (SPDEs) are fundamental for modeling stochastic dynamics across the natural sciences and modern machine learning. Learning their solution operators with…

Machine Learning · Computer Science 2026-01-30 Dai Shi , Lequan Lin , Andi Han , Luke Thompson , José Miguel Hernández-Lobato , Zhiyong Wang , Junbin Gao

Rapid and reliable solvers for parametric partial differential equations (PDEs) are needed in many scientific and engineering disciplines. For example, there is a growing demand for composites and architected materials with heterogeneous…

Numerical Analysis · Mathematics 2026-02-05 Julius Herb , Felix Fritzen

Partial differential equations (PDEs) are ubiquitous in the world around us, modelling phenomena from heat and sound to quantum systems. Recent advances in deep learning have resulted in the development of powerful neural solvers; however,…

Artificial Intelligence · Computer Science 2023-11-13 Yolanne Yi Ran Lee

Interfacial dynamics underlie a wide range of phenomena, including phase transitions, microstructure coarsening, pattern formation, and thin-film growth, and are typically described by stiff, time-dependent nonlinear partial differential…

Fourier neural operators (FNOs) are a recently introduced neural network architecture for learning solution operators of partial differential equations (PDEs), which have been shown to perform significantly better than comparable deep…

The term `surrogate modeling' in computational science and engineering refers to the development of computationally efficient approximations for expensive simulations, such as those arising from numerical solution of partial differential…

Numerical Analysis · Mathematics 2022-08-12 Maarten V. de Hoop , Daniel Zhengyu Huang , Elizabeth Qian , Andrew M. Stuart

The precise simulation of turbulent flows is of immense importance in a variety of scientific and engineering fields, including climate science, freshwater science, and the development of energy-efficient manufacturing processes. Within the…

Fluid Dynamics · Physics 2024-06-10 Shengyu Chen , Peyman Givi , Can Zheng , Xiaowei Jia

Stochastic partial differential equations (SPDEs) are significant tools for modeling dynamics in many areas including atmospheric sciences and physics. Neural Operators, generations of neural networks with capability of learning maps…

Machine Learning · Computer Science 2022-07-19 Peiyan Hu , Qi Meng , Bingguang Chen , Shiqi Gong , Yue Wang , Wei Chen , Rongchan Zhu , Zhi-Ming Ma , Tie-Yan Liu

Many problems in science and engineering can be represented by a set of partial differential equations (PDEs) through mathematical modeling. Mechanism-based computation following PDEs has long been an essential paradigm for studying topics…

Machine Learning · Computer Science 2022-11-21 Shudong Huang , Wentao Feng , Chenwei Tang , Jiancheng Lv

Partial differential equations (PDEs) are fundamental to modeling complex and nonlinear physical phenomena, but their numerical solution often requires significant computational resources, particularly when a large number of forward full…

Computational Physics · Physics 2025-07-08 Qibang Liu , Seid Koric

Designing universal artificial intelligence (AI) solver for partial differential equations (PDEs) is an open-ended problem and a significant challenge in science and engineering. Currently, data-driven solvers have achieved great success,…

Machine Learning · Computer Science 2025-02-24 Qinglong Ma , Peizhi Zhao , Sen Wang , Tao Song

The numerical solution of partial differential equations (PDEs) is difficult, having led to a century of research so far. Recently, there have been pushes to build neural--numerical hybrid solvers, which piggy-backs the modern trend towards…

Machine Learning · Computer Science 2023-03-21 Johannes Brandstetter , Daniel Worrall , Max Welling

The advent of deep learning has yielded powerful tools to automatically compute gradients of computations. This is because training a neural network equates to iteratively updating its parameters using gradient descent to find the minimum…

Data Analysis, Statistics and Probability · Physics 2023-03-01 Nathan Simpson , Lukas Heinrich

Learning partial differential equations' (PDEs) solution operators is an essential problem in machine learning. However, there are several challenges for learning operators in practical applications like the irregular mesh, multiple input…

Machine Learning · Computer Science 2023-06-16 Zhongkai Hao , Zhengyi Wang , Hang Su , Chengyang Ying , Yinpeng Dong , Songming Liu , Ze Cheng , Jian Song , Jun Zhu

Neural surrogate solvers of partial differential equations (PDEs) promise dramatic speedups over numerical methods, especially in scenarios requiring many solves. However, current accuracy-based evaluations do not fully consider two central…

Machine Learning · Computer Science 2026-05-18 Yijing Zhang , Nicholas Roberts , Tanya Marwah , Mikhail Khodak

Neural Operators (NOs) are a leading method for surrogate modeling of partial differential equations. Unlike traditional neural networks, which approximate individual functions, NOs learn the mappings between function spaces. While NOs have…

Astrophysics of Galaxies · Physics 2025-08-01 Keith Poletti , Stella S. R. Offner , Rachel A. Ward

With massive advancements in sensor technologies and Internet-of-things, we now have access to terabytes of historical data; however, there is a lack of clarity in how to best exploit the data to predict future events. One possible…

Computational Physics · Physics 2022-05-05 Tapas Tripura , Souvik Chakraborty

Neural networks suffer from spectral bias having difficulty in representing the high frequency components of a function while relaxation methods can resolve high frequencies efficiently but stall at moderate to low frequencies. We exploit…

Neural operators have emerged as fast surrogate solvers for parametric partial differential equations (PDEs). However, purely data-driven models often require extensive training data and can generalize poorly, especially in small-data…

Machine Learning · Computer Science 2026-02-16 Heechang Kim , Qianying Cao , Hyomin Shin , Seungchul Lee , George Em Karniadakis , Minseok Choi

Learning dynamics governed by differential equations is crucial for predicting and controlling the systems in science and engineering. Neural Ordinary Differential Equation (NODE), a deep learning model integrated with differential…

Machine Learning · Computer Science 2021-11-09 Shiqi Gong , Qi Meng , Yue Wang , Lijun Wu , Wei Chen , Zhi-Ming Ma , Tie-Yan Liu