English
Related papers

Related papers: Predicting Change, Not States: An Alternate Framew…

200 papers

Simulating the time evolution of Partial Differential Equations (PDEs) of large-scale systems is crucial in many scientific and engineering domains such as fluid dynamics, weather forecasting and their inverse optimization problems.…

Machine Learning · Computer Science 2022-10-13 Tailin Wu , Takashi Maruyama , Jure Leskovec

Neural networks are one tool for approximating non-linear differential equations used in scientific computing tasks such as surrogate modeling, real-time predictions, and optimal control. PDE foundation models utilize neural networks to…

Machine Learning · Computer Science 2025-02-11 Elisa Negrini , Yuxuan Liu , Liu Yang , Stanley J. Osher , Hayden Schaeffer

The solution of partial differential equations (PDEs) plays a central role in numerous applications in science and engineering, particularly those involving multiphase flow in porous media. Complex, nonlinear systems govern these problems…

Stochastic partial differential equations (SPDEs) are the mathematical tool of choice for modelling spatiotemporal PDE-dynamics under the influence of randomness. Based on the notion of mild solution of an SPDE, we introduce a novel neural…

Machine Learning · Computer Science 2022-09-27 Cristopher Salvi , Maud Lemercier , Andris Gerasimovics

Neural surrogates for Partial Differential Equations (PDEs) often suffer significant performance degradation when evaluated on problem configurations outside their training distribution, such as new initial conditions or structural…

Machine Learning · Computer Science 2026-02-11 Paul Setinek , Gianluca Galletti , Thomas Gross , Dominik Schnürer , Johannes Brandstetter , Werner Zellinger

The existing Neural ODE formulation relies on an explicit knowledge of the termination time. We extend Neural ODEs to implicitly defined termination criteria modeled by neural event functions, which can be chained together and…

Machine Learning · Computer Science 2021-10-28 Ricky T. Q. Chen , Brandon Amos , Maximilian Nickel

Neural Ordinary Differential Equations (NODEs) use a neural network to model the instantaneous rate of change in the state of a system. However, despite their apparent suitability for dynamics-governed time-series, NODEs present a few…

Machine Learning · Computer Science 2021-08-18 Alexander Norcliffe , Cristian Bodnar , Ben Day , Jacob Moss , Pietro Liò

Fast and accurate solutions of time-dependent partial differential equations (PDEs) are of pivotal interest to many research fields, including physics, engineering, and biology. Generally, implicit/semi-implicit schemes are preferred over…

Pretraining for partial differential equation (PDE) modeling has recently shown promise in scaling neural operators across datasets to improve generalizability and performance. Despite these advances, our understanding of how pretraining…

Machine Learning · Computer Science 2024-10-03 Anthony Zhou , Cooper Lorsung , AmirPouya Hemmasian , Amir Barati Farimani

Physics simulators are essential in science and engineering, enabling the analysis, control, and design of complex systems. In experimental sciences, they are increasingly used to automate experimental design, often via combinatorial search…

Solving time-dependent Partial Differential Equations (PDEs) using a densely discretized spatial domain is a fundamental problem in various scientific and engineering disciplines, including modeling climate phenomena and fluid dynamics.…

Machine Learning · Computer Science 2025-10-24 Jan Hagnberger , Daniel Musekamp , Mathias Niepert

By interpreting the forward dynamics of the latent representation of neural networks as an ordinary differential equation, Neural Ordinary Differential Equation (Neural ODE) emerged as an effective framework for modeling a system dynamics…

Machine Learning · Computer Science 2020-10-19 Daehoon Gwak , Gyuhyeon Sim , Michael Poli , Stefano Massaroli , Jaegul Choo , Edward Choi

Many physical processes such as weather phenomena or fluid mechanics are governed by partial differential equations (PDEs). Modelling such dynamical systems using Neural Networks is an active research field. However, current methods are…

Machine Learning · Computer Science 2022-10-12 Andrzej Dulny , Andreas Hotho , Anna Krause

We propose a non-intrusive method to build surrogate models that approximate the solution of parameterized partial differential equations (PDEs), capable of taking into account the dependence of the solution on the shape of the…

Numerical Analysis · Mathematics 2024-09-20 Linying Zhang , Stefano Pagani , Jun Zhang , Francesco Regazzoni

Partial Differential Equations (PDEs) are central to science and engineering. Since solving them is computationally expensive, a lot of effort has been put into approximating their solution operator via both traditional and recently…

Machine Learning · Computer Science 2025-02-14 Alessandro Longhi , Danny Lathouwers , Zoltán Perkó

Neural PDE surrogates can improve the cost-accuracy tradeoff of classical solvers, but often generalize poorly to new initial conditions and accumulate errors over time. Physical and symmetry constraints have shown promise in closing this…

Machine Learning · Computer Science 2025-06-09 Yunfei Huang , David S. Greenberg

Neural solvers for partial differential equations (PDEs) have great potential to generate fast and accurate physics solutions, yet their practicality is currently limited by their generalizability. PDEs evolve over broad scales and exhibit…

Machine Learning · Computer Science 2024-12-06 Anthony Zhou , Amir Barati Farimani

Neural ordinary differential equations describe how values change in time. This is the reason why they gained importance in modeling sequential data, especially when the observations are made at irregular intervals. In this paper we propose…

Machine Learning · Computer Science 2021-10-26 Marin Biloš , Johanna Sommer , Syama Sundar Rangapuram , Tim Januschowski , Stephan Günnemann

The ongoing development of quantum processors is driving breakthroughs in scientific discovery. Despite this progress, the formidable cost of fabricating large-scale quantum processors means they will remain rare for the foreseeable future,…

Quantum Physics · Physics 2025-07-24 Wei-You Liao , Yuxuan Du , Xinbiao Wang , Tian-Ci Tian , Yong Luo , Bo Du , Dacheng Tao , He-Liang Huang

Neural networks are a popular tool for modeling sequential data but they generally do not treat time as a continuous variable. Neural ODEs represent an important exception: they parameterize the time derivative of a hidden state with a…

Machine Learning · Computer Science 2021-06-15 Sam Greydanus , Stefan Lee , Alan Fern