English
Related papers

Related papers: Out-of-Distribution Generalization for Neural Phys…

200 papers

In many real-world applications, deployed models encounter inputs that differ from the data seen during training. Out-of-distribution detection identifies whether an input stems from an unseen distribution, while open-world recognition…

Neural operators aim to approximate the solution operator of a system of differential equations purely from data. They have shown immense success in modeling complex dynamical systems across various domains. However, the occurrence of…

Machine Learning · Computer Science 2025-04-01 Christopher Bülte , Philipp Scholl , Gitta Kutyniok

Out-of-distribution generalization (OODG) is a longstanding challenge for neural networks. This challenge is quite apparent in tasks with well-defined variables and rules, where explicit use of the rules could solve problems independently…

Machine Learning · Computer Science 2022-12-14 Andrew J. Nam , Mustafa Abdool , Trevor Maxfield , James L. McClelland

Deep learning has been demonstrated with tremendous success in recent years. Despite so, its performance in practice often degenerates drastically when encountering out-of-distribution (OoD) data, i.e. training and test data are sampled…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Haoyue Bai

Neural operators have shown promise in learning solution maps of partial differential equations (PDEs), but they often struggle to generalize when test inputs lie outside the training distribution, such as novel initial conditions, unseen…

Machine Learning · Computer Science 2026-02-03 Louis Serrano , Jiequn Han , Edouard Oyallon , Shirley Ho , Rudy Morel

Out-of-distribution (OOD) generalization is critical for machine learning models deployed in the real world. However, achieving this can be fundamentally challenging, as it requires the ability to learn invariant features across different…

Machine Learning · Computer Science 2024-11-05 Haoyue Bai , Yifei Ming , Julian Katz-Samuels , Yixuan Li

This work presents a deep learning-based framework for the solution of partial differential equations on complex computational domains described with computer-aided design tools. To account for the underlying distribution of the training…

Computational Engineering, Finance, and Science · Computer Science 2022-03-18 Moritz von Tresckow , Stefan Kurz , Herbert De Gersem , Dimitrios Loukrezis

Modern foundation models exhibit remarkable out-of-distribution (OOD) generalization, solving tasks far beyond the support of their training data. However, the theoretical principles underpinning this phenomenon remain elusive. This paper…

Machine Learning · Statistics 2025-05-29 Jiawei Ge , Amanda Wang , Shange Tang , Chi Jin

Neural PDE solvers are increasingly used as learned surrogates for families of partial differential equations, where the key machine learning challenge is not only interpolation on a fixed benchmark distribution but generalization under…

Machine Learning · Computer Science 2026-05-26 Lennon Shikhman

We introduce NewPINNs, a physics-informing learning framework that couples neural networks with conventional numerical solvers for solving differential equations. Rather than enforcing governing equations and boundary conditions through…

Machine Learning · Computer Science 2026-01-27 Maedeh Makki , Satish Chandran , Maziar Raissi , Adrien Grenier , Behzad Mohebbi

Neural Operators (NOs) are a leading method for surrogate modeling of partial differential equations. Unlike traditional neural networks, which approximate individual functions, NOs learn the mappings between function spaces. While NOs have…

Astrophysics of Galaxies · Physics 2025-08-01 Keith Poletti , Stella S. R. Offner , Rachel A. Ward

Neural operators have emerged as promising surrogate models for solving partial differential equations (PDEs), but struggle to generalise beyond training distributions and are often constrained to a fixed temporal discretisation. This work…

For partial differential equations on domains of arbitrary shapes, existing works of neural operators attempt to learn a mapping from geometries to solutions. It often requires a large dataset of geometry-solution pairs in order to obtain a…

Machine Learning · Computer Science 2024-05-29 Ze Cheng , Zhongkai Hao , Xiaoqiang Wang , Jianing Huang , Youjia Wu , Xudan Liu , Yiru Zhao , Songming Liu , Hang Su

Machine learning-based simulators offer the potential to model the dynamics of complex systems more efficiently than classical approaches, while retaining differentiability, a key property for materials design. Graph neural network…

Chemical Physics · Physics 2026-05-12 S. A. Shteingolts , Salman N. Salman , Dan Mendels

Time series frequently manifest distribution shifts, diverse latent features, and non-stationary learning dynamics, particularly in open and evolving environments. These characteristics pose significant challenges for out-of-distribution…

Machine Learning · Computer Science 2026-05-20 Xin Wu , Fei Teng , Xingwang Li , Ji Zhang , Tianrui Li , Qiang Duan

Current neural operators often struggle to generalize to complex, out-of-distribution conditions, limiting their ability in seismic wavefield representation. To address this, we propose a generative neural operator (GNO) that leverages…

Geophysics · Physics 2025-03-11 Shijun Cheng , Mohammad H. Taufik , Tariq Alkhalifah

Despite their remarkable success in approximating a wide range of operators defined by PDEs, existing neural operators (NOs) do not necessarily perform well for all physics problems. We focus here on high-frequency waves to highlight…

Over the last few years, Neural Processes have become a useful modelling tool in many application areas, such as healthcare and climate sciences, in which data are scarce and prediction uncertainty estimates are indispensable. However, the…

Machine Learning · Computer Science 2023-11-17 Lorenzo Bonito , James Requeima , Aliaksandra Shysheya , Richard E. Turner

Neural operators have been applied in various scientific fields, such as solving parametric partial differential equations, dynamical systems with control, and inverse problems. However, challenges arise when dealing with input functions…

Numerical Analysis · Mathematics 2023-10-31 Zecheng Zhang , Christian Moya , Lu Lu , Guang Lin , Hayden Schaeffer

Partial differential equations (PDEs) are central to scientific modeling. Modern workflows increasingly rely on learning-based components to support model reuse, inference, and integration across large computational processes. Despite the…

Machine Learning · Computer Science 2026-02-20 Yilong Dai , Shengyu Chen , Ziyi Wang , Xiaowei Jia , Yiqun Xie , Vipin Kumar , Runlong Yu
‹ Prev 1 2 3 10 Next ›