English
Related papers

Related papers: Probabilistic Retrofitting of Learned Simulators

200 papers

Machine learning based partial differential equations (PDEs) solvers have received great attention in recent years. Most progress in this area has been driven by deep neural networks such as physics-informed neural networks (PINNs) and…

Numerical Analysis · Mathematics 2025-09-23 Chunyang Liao

Probabilistic survival predictions from models trained with Maximum Likelihood Estimation (MLE) can have high, and sometimes unacceptably high variance. The field of meteorology, where the paradigm of maximizing sharpness subject to…

Machine Learning · Computer Science 2019-06-20 Anand Avati , Tony Duan , Sharon Zhou , Kenneth Jung , Nigam H. Shah , Andrew Ng

We present a deep learning emulator for stochastic and chaotic spatio-temporal systems, explicitly conditioned on the parameter values of the underlying partial differential equations (PDEs). Our approach involves pre-training the model on…

Machine Learning · Computer Science 2025-09-12 Ira J. S. Shokar , Rich R. Kerswell , Peter H. Haynes

The paper proposes and optimizes a partial recovery training system, CPR, for recommendation models. CPR relaxes the consistency requirement by enabling non-failed nodes to proceed without loading checkpoints when a node fails during…

Partial-differential-equation (PDE)-constrained optimization is a well-worn technique for acquiring optimal parameters of systems governed by PDEs. However, this approach is limited to providing a single set of optimal parameters per…

Computational Physics · Physics 2024-10-17 Archis S. Joglekar

Probabilistic modeling enables combining domain knowledge with learning from data, thereby supporting learning from fewer training instances than purely data-driven methods. However, learning probabilistic models is difficult and has not…

Machine Learning · Computer Science 2017-05-17 Avi Pfeffer

Solving partial differential equations (PDEs) within the framework of probabilistic numerics offers a principled approach to quantifying epistemic uncertainty arising from discretization. By leveraging Gaussian process regression and…

Machine Learning · Statistics 2025-08-18 Akshay Thakur , Sawan Kumar , Matthew Zahr , Souvik Chakraborty

The recent revolution in data-driven methods for weather forecasting has lead to a fragmented landscape of complex, bespoke architectures and training strategies, obscuring the fundamental drivers of forecast accuracy. Here, we demonstrate…

State-dependent parameter identification, where unknown model parameters depend on one or more state variables in partial differential equations (PDEs) or coupled PDE systems, is fundamental to a wide range of problems in physics,…

Optimization and Control · Mathematics 2026-01-19 Vladislav Bukshtynov

Foundation models for partial differential equations (PDEs) have emerged as powerful surrogates pre-trained on diverse physical systems, but adapting them to new downstream tasks remains challenging due to limited task-specific data and…

Machine Learning · Computer Science 2026-03-17 Vlad Medvedev , Leon Armbruster , Christopher Straub , Georg Kruse , Andreas Rosskopf

Recent research has used deep learning to develop partial differential equation (PDE) models in science and engineering. The functional form of the PDE is determined by a neural network, and the neural network parameters are calibrated to…

Machine Learning · Computer Science 2023-10-17 Justin Sirignano , Jonathan MacArt , Konstantinos Spiliopoulos

(Partial) differential equations (PDEs) are fundamental tools for describing natural phenomena, making their solution crucial in science and engineering. While traditional methods, such as the finite element method, provide reliable…

Machine Learning · Computer Science 2025-03-11 Viggo Moro , Luiz F. O. Chamon

We present an algorithm for arc reversal in Bayesian networks with tree-structured conditional probability tables, and consider some of its advantages, especially for the simulation of dynamic probabilistic networks. In particular, the…

Artificial Intelligence · Computer Science 2013-02-08 Adrian Y. W. Cheuk , Craig Boutilier

Partial Differential Equations (PDEs) are the bedrock for modern computational sciences and engineering, and inherently computationally expensive. While PDE foundation models have shown much promise for simulating such complex…

This work proposes a systematic model reduction approach based on rank adaptive tensor recovery for partial differential equation (PDE) models with high-dimensional random parameters. Since the standard outputs of interest of these models…

Numerical Analysis · Mathematics 2019-02-15 Kejun Tang , Qifeng Liao

We propose a novel framework for adaptively learning the time-evolving solutions of stochastic partial differential equations (SPDEs) using score-based diffusion models within a recursive Bayesian inference setting. SPDEs play a central…

Computation · Statistics 2025-08-12 Toan Huynh , Ruth Lopez Fajardo , Guannan Zhang , Lili Ju , Feng Bao

Probabilistic Time Series Forecasting (PTSF) plays a critical role in domains requiring accurate and uncertainty-aware predictions for decision-making. However, existing methods offer suboptimal distribution modeling and suffer from a…

Machine Learning · Computer Science 2025-09-03 Chih-Yu Lai , Yu-Chien Ning , Duane S. Boning

Although sparse training has been successfully used in various resource-limited deep learning tasks to save memory, accelerate training, and reduce inference time, the reliability of the produced sparse models remains unexplored. Previous…

Machine Learning · Computer Science 2023-03-02 Bowen Lei , Ruqi Zhang , Dongkuan Xu , Bani Mallick

A novel extension of the Probabilistic Learning on Manifolds (PLoM) is presented. It makes it possible to synthesize solutions to a wide range of nonlinear stochastic boundary value problems described by partial differential equations…

Machine Learning · Statistics 2021-04-07 Christian Soize , Roger Ghanem

Fair scores reward ensemble forecast members that behave like samples from the same distribution as the verifying observations. They are therefore an attractive choice as loss functions to train data-driven ensemble forecasts or…

Atmospheric and Oceanic Physics · Physics 2026-02-18 Christopher David Roberts