English
Related papers

Related papers: Predicting Change, Not States: An Alternate Framew…

200 papers

Partial differential equations (PDEs) are a central tool for modeling the dynamics of physical, engineering, and materials systems, but high-fidelity simulations are often computationally expensive. At the same time, many scientific…

Machine Learning · Computer Science 2026-01-14 Binh Duong Nguyen , Stefan Sandfeld

Neural Ordinary Differential Equations model dynamical systems with ODEs learned by neural networks. However, ODEs are fundamentally inadequate to model systems with long-range dependencies or discontinuities, which are common in…

Machine Learning · Computer Science 2022-06-15 Samuel Holt , Zhaozhi Qian , Mihaela van der Schaar

Data-driven surrogate models are widely used for applications such as design optimization and uncertainty quantification, where repeated evaluations of an expensive simulator are required. For most partial differential equation (PDE)…

Computational Physics · Physics 2019-10-18 Wei Xing , Robert M. Kirby , Shandian Zhe

One of the most popular recent areas of machine learning predicates the use of neural networks augmented by information about the underlying process in the form of Partial Differential Equations (PDEs). These physics-informed neural…

Fluid Dynamics · Physics 2025-06-17 Luca Menicali , David H. Richter , Stefano Castruccio

A computed approximation of the solution operator to a system of partial differential equations (PDEs) is needed in various areas of science and engineering. Neural operators have been shown to be quite effective at predicting these…

Machine Learning · Computer Science 2024-12-02 Zan Ahmad , Shiyi Chen , Minglang Yin , Avisha Kumar , Nicolas Charon , Natalia Trayanova , Mauro Maggioni

Specifying a governing physical model in the presence of missing physics and recovering its parameters are two intertwined and fundamental problems in science. Modern machine learning allows one to circumvent these, via emulators and…

Machine Learning · Computer Science 2020-06-30 Daniel J. Tait , Theodoros Damoulas

The development of efficient surrogates for partial differential equations (PDEs) is a critical step towards scalable modeling of complex, multiscale systems-of-systems. Convolutional neural networks (CNNs) have gained popularity as the…

Machine Learning · Computer Science 2025-06-04 Adrienne M. Propp , Daniel M. Tartakovsky

Neural ordinary differential equations (ODEs) have attracted much attention as continuous-time counterparts of deep residual neural networks (NNs), and numerous extensions for recurrent NNs have been proposed. Since the 1980s, ODEs have…

Machine Learning · Computer Science 2022-10-17 Kazuki Irie , Francesco Faccio , Jürgen Schmidhuber

The paper addresses Bayesian inferences in inverse problems with uncertainty quantification involving a computationally expensive forward map associated with solving a partial differential equations. To mitigate the computational cost, the…

Methodology · Statistics 2023-12-18 A. Galaviz , J. A. Christen , A. Capella

We introduce a novel grid-independent model for learning partial differential equations (PDEs) from noisy and partial observations on irregular spatiotemporal grids. We propose a space-time continuous latent neural PDE model with an…

Machine Learning · Computer Science 2023-10-27 Valerii Iakovlev , Markus Heinonen , Harri Lähdesmäki

Accurate yet efficient surrogate models are essential for large-scale simulations of partial differential equations (PDEs), particularly for uncertainty quantification (UQ) tasks that demand hundreds or thousands of evaluations. We develop…

Recently, using neural networks to simulate spatio-temporal dynamics has received a lot of attention. However, most existing methods adopt pure data-driven black-box models, which have limited accuracy and interpretability. By combining…

Machine Learning · Computer Science 2023-07-28 Xiang Huang , Zhuoyuan Li , Hongsheng Liu , Zidong Wang , Hongye Zhou , Bin Dong , Bei Hua

Neural Ordinary Differential Equations replace the right-hand side of a conventional ODE with a neural net, which by virtue of the universal approximation theorem, can be trained to the representation of any function. When we do not know…

Neurons and Cognition · Quantitative Biology 2020-08-25 Robert Strauss

The treatment of Hall-effect thrusters as nonlinear, dynamical systems has emerged as a new perspective to understand and analyze data acquired from the thrusters. The acquisition of high-speed data that can resolve the characteristic…

Chaotic Dynamics · Physics 2024-08-14 Adrian S Wong , Christine M Greve , Daniel Q Eckhardt

Developing efficient numerical algorithms for the solution of high dimensional random Partial Differential Equations (PDEs) has been a challenging task due to the well-known curse of dimensionality. We present a new solution framework for…

Machine Learning · Computer Science 2019-10-17 Mohammad Amin Nabian , Hadi Meidani

In this paper we introduce a novel way of estimating prediction uncertainty in deep networks through the use of uncertainty surrogates. These surrogates are features of the penultimate layer of a deep network that are forced to match…

Machine Learning · Computer Science 2021-04-19 Radhakrishna Achanta , Natasa Tagasovska

Neural networks have promise as surrogate partial differential equation (PDE) solvers, but it remains a challenge to use these concepts to solve problems with high accuracy and scalability. In this work, we show that neural network…

Computational Physics · Physics 2025-09-05 Chenkai Mao , Jonathan A. Fan

Recent breakthroughs in artificial intelligence (AI) are reshaping the way we construct computational counterparts of the brain, giving rise to a new class of ``surrogate brains''. In contrast to conventional hypothesis-driven biophysical…

Neurons and Cognition · Quantitative Biology 2025-10-14 Yinuo Zhang , Demao Liu , Zhichao Liang , Jiani Cheng , Kexin Lou , Jinqiao Duan , Ting Gao , Bin Hu , Quanying Liu

Deep operator network (DeepONet) has shown significant promise as surrogate models for systems governed by partial differential equations (PDEs), enabling accurate mappings between infinite-dimensional function spaces. However, when applied…

Machine Learning · Computer Science 2025-10-29 Sharmila Karumuri , Lori Graham-Brady , Somdatta Goswami

We introduce a local surrogate approach for explainable time-series forecasting. An initially non-interpretable predictive model to improve the forecast of a classical time-series 'base model' is used. 'Explainability' of the correction is…

Machine Learning · Statistics 2025-01-17 Alfredo Lopez , Florian Sobieczky