English
Related papers

Related papers: Test-time Generalization for Physics through Neura…

200 papers

Gaussian curvature is an important geometric property of surfaces, which has been used broadly in mathematical modeling. Due to the full nonlinearity of the Gaussian curvature, efficient numerical methods for models based on it are uncommon…

Computer Vision and Pattern Recognition · Computer Science 2022-05-17 Hao Liu , Xue-Cheng Tai , Roland Glowinski

Simulating and controlling physical systems described by partial differential equations (PDEs) are crucial tasks across science and engineering. Recently, diffusion generative models have emerged as a competitive class of methods for these…

Machine Learning · Computer Science 2025-06-27 Peiyan Hu , Rui Wang , Xiang Zheng , Tao Zhang , Haodong Feng , Ruiqi Feng , Long Wei , Yue Wang , Zhi-Ming Ma , Tailin Wu

Modeling complex spatiotemporal dynamical systems, such as the reaction-diffusion processes, have largely relied on partial differential equations (PDEs). However, due to insufficient prior knowledge on some under-explored dynamical…

Machine Learning · Computer Science 2023-05-23 Chengping Rao , Pu Ren , Qi Wang , Oral Buyukozturk , Hao Sun , Yang Liu

Accurate modeling of spatiotemporal dynamics is crucial to understanding complex phenomena across science and engineering. However, this task faces a fundamental challenge when the governing equations are unknown and observational data are…

Computational Physics · Physics 2025-12-15 Rui Zhang , Han Wan , Yang Liu , Hao Sun

In this paper, we investigate the applications of operator learning, specifically DeepONet, for solving nonlinear partial differential equations (PDEs). Unlike conventional function learning methods that require training separate neural…

Machine Learning · Computer Science 2025-09-30 Yahong Yang

Operator learning aims to discover properties of an underlying dynamical system or partial differential equation (PDE) from data. Here, we present a step-by-step guide to operator learning. We explain the types of problems and PDEs amenable…

Numerical Analysis · Mathematics 2025-04-30 Nicolas Boullé , Alex Townsend

Scientific discovery and engineering design are currently limited by the time and cost of physical experiments, selected mostly through trial-and-error and intuition that require deep domain expertise. Numerical simulations present an…

Machine Learning · Computer Science 2024-01-08 Kamyar Azizzadenesheli , Nikola Kovachki , Zongyi Li , Miguel Liu-Schiaffini , Jean Kossaifi , Anima Anandkumar

Operator learning has become a powerful tool for accelerating the solution of parameterized partial differential equations (PDEs), enabling rapid prediction of full spatiotemporal fields for new initial conditions or forcing functions.…

Machine Learning · Computer Science 2025-12-18 Hongjin Mi , Huiqiang Lun , Changhong Mou , Yeyu Zhang

Deep learning methods have access to be employed for solving physical systems governed by parametric partial differential equations (PDEs) due to massive scientific data. It has been refined to operator learning that focuses on learning…

Machine Learning · Computer Science 2024-03-06 Chu Wang , Jinhong Wu , Yanzhi Wang , Zhijian Zha , Qi Zhou

A wide range of scientific problems, such as those described by continuous-time dynamical systems and partial differential equations (PDEs), are naturally formulated on function spaces. While function spaces are typically…

Although neural operators are widely used in data-driven physical simulations, their training remains computationally expensive. Recent advances address this issue via downstream learning, where a model pretrained on simpler problems is…

Machine Learning · Computer Science 2025-11-17 Mikhail Masliaev , Dmitry Gusarov , Ilya Markov , Alexander Hvatov

Background: Deep learning models are typically trained using stochastic gradient descent or one of its variants. These methods update the weights using their gradient, estimated from a small fraction of the training data. It has been…

Machine Learning · Statistics 2018-01-03 Elad Hoffer , Itay Hubara , Daniel Soudry

Numerical discretisations of partial differential equations (PDEs) can be written as discrete convolutions, which, themselves, are a key tool in AI libraries and used in convolutional neural networks (CNNs). We therefore propose to…

Fluid Dynamics · Physics 2025-11-06 Boyang Chen , Claire E. Heaney , Christopher C. Pain

The physics-informed neural operator (PINO) is a machine learning paradigm that has demonstrated promising results for learning solutions to partial differential equations (PDEs). It leverages the Fourier Neural Operator to learn solution…

Time series remains one of the most challenging modalities in machine learning research. The out-of-distribution (OOD) detection and generalization on time series tend to suffer due to its non-stationary property, i.e., the distribution…

Machine Learning · Computer Science 2023-08-07 Wang Lu , Jindong Wang , Xinwei Sun , Yiqiang Chen , Xiangyang Ji , Qiang Yang , Xing Xie

Extrapolation remains a grand challenge in deep neural networks across all application domains. We propose an operator learning method to solve time-dependent partial differential equations (PDEs) continuously and with extrapolation in time…

Machine Learning · Computer Science 2023-12-12 Oded Ovadia , Vivek Oommen , Adar Kahana , Ahmad Peyvan , Eli Turkel , George Em Karniadakis

Learning PDE dynamics from limited data with unknown physics is challenging. Existing neural PDE solvers either require large datasets or rely on known physics (e.g., PDE residuals or handcrafted stencils), leading to limited applicability.…

Machine Learning · Computer Science 2026-05-25 Han Wan , Rui Zhang , Hao Sun

Learning the solution of partial differential equations (PDEs) with a neural network is an attractive alternative to traditional solvers due to its elegance, greater flexibility and the ease of incorporating observed data. However, training…

Machine Learning · Computer Science 2024-07-18 Katsiaryna Haitsiukevich , Alexander Ilin

A primary challenge of physics-informed machine learning (PIML) is its generalization beyond the training domain, especially when dealing with complex physical problems represented by partial differential equations (PDEs). This paper aims…

Machine Learning · Computer Science 2023-12-19 Taniya Kapoor , Abhishek Chandra , Daniel M. Tartakovsky , Hongrui Wang , Alfredo Nunez , Rolf Dollevoet

Neural networks have emerged as powerful surrogates for solving partial differential equations (PDEs), offering significant computational speedups over traditional methods. However, these models suffer from a critical limitation: error…

Machine Learning · Computer Science 2025-12-29 Xinquan Huang , Paris Perdikaris