English
Related papers

Related papers: Neural variational Data Assimilation with Uncertai…

200 papers

Systems involving Partial Differential Equations (PDEs) have recently become more popular among the machine learning community. However prior methods usually treat infinite dimensional problems in finite dimensions with Reduced Order…

Optimization and Control · Mathematics 2020-06-08 Ethan N. Evans , Marcus A. Pereira , George I. Boutselis , Evangelos A. Theodorou

In the task of predicting spatio-temporal fields in environmental science using statistical methods, introducing statistical models inspired by the physics of the underlying phenomena that are numerically efficient is of growing interest.…

Methodology · Statistics 2024-07-23 Lucia Clarotto , Denis Allard , Thomas Romary , Nicolas Desassis

In image reconstruction, an accurate quantification of uncertainty is of great importance for informed decision making. Here, the Bayesian approach to inverse problems can be used: the image is represented through a random function that…

Numerical Analysis · Mathematics 2025-04-24 Jonas Latz , Aretha L. Teckentrup , Simon Urbainczyk

We introduce variational spectral learning (VSL), a machine learning framework for solving partial differential equations (PDEs) that operates directly in the coefficient space of spectral expansions. VSL offers a principled bridge between…

Numerical Analysis · Mathematics 2026-01-07 M. M. Hammad

This study proposes a theory of unsupervised super-resolution data assimilation (SRDA) using conditional variational autoencoders (CVAEs). We derive an evidence lower bound for unsupervised learning, showing that our theory is an extension…

Atmospheric and Oceanic Physics · Physics 2025-04-17 Yuki Yasuda , Ryo Onishi

Prediction of the state evolution of complex high-dimensional nonlinear systems is challenging due to the nonlinear sensitivity of the evolution to small inaccuracies in the model. Data Assimilation (DA) techniques improve state estimates…

Data Analysis, Statistics and Probability · Physics 2023-07-10 Aishah Albarakati , Marko Budisic , Erik Van Vleck

Bayesian inference for high-dimensional inverse problems is computationally costly and requires selecting a suitable prior distribution. Amortized variational inference addresses these challenges via a neural network that approximates the…

Machine Learning · Statistics 2023-01-19 Ali Siahkoohi , Gabrio Rizzuti , Rafael Orozco , Felix J. Herrmann

The use of neural networks to approximate partial differential equations (PDEs) has gained significant attention in recent years. However, the approximation of PDEs with localised phenomena, e.g., sharp gradients and singularities, remains…

Numerical Analysis · Mathematics 2025-01-30 Santiago Badia , Wei Li , Alberto F. Martín

This paper presents a reduced-order approach for four-dimensional variational data assimilation, based on a prior EO F analysis of a model trajectory. This method implies two main advantages: a natural model-based definition of a mul…

A method of data assimilation (DA) is employed to estimate electrophysiological parameters of neurons simultaneously with their synaptic connectivity in a small model biological network. The DA procedure is cast as an optimization, with a…

Neurons and Cognition · Quantitative Biology 2020-02-05 Eve Armstrong

This paper provides a detailed theoretical analysis of methods to approximate the solutions of high-dimensional (>10^6) linear Bayesian problems. An optimal low-rank projection that maximizes the information content of the Bayesian…

Data Analysis, Statistics and Probability · Physics 2019-10-28 Nicolas Bousserez , Daven K. Henze

We introduce a novel grid-independent model for learning partial differential equations (PDEs) from noisy and partial observations on irregular spatiotemporal grids. We propose a space-time continuous latent neural PDE model with an…

Machine Learning · Computer Science 2023-10-27 Valerii Iakovlev , Markus Heinonen , Harri Lähdesmäki

Multivariate time series with missing values are common in areas such as healthcare and finance, and have grown in number and complexity over the years. This raises the question whether deep learning methodologies can outperform classical…

Machine Learning · Statistics 2020-02-21 Vincent Fortuin , Dmitry Baranchuk , Gunnar Rätsch , Stephan Mandt

A challenge in multivariate problems with discrete structures is the inclusion of prior information that may differ in each separate structure. A particular example of this is seismic amplitude versus angle (AVA) inversion to elastic…

Methodology · Statistics 2012-08-09 Erlend Aune , Daniel Simpson

This paper proposes a novel low-rank approximation to the multivariate State-Space Model. The Stochastic Partial Differential Equation (SPDE) approach is applied component-wise to the independent-in-time Mat\'ern Gaussian innovation term in…

We present a new deep primal-dual backward stochastic differential equation framework based on stopping time iteration to solve optimal stopping problems. A novel loss function is proposed to learn the conditional expectation, which…

Computational Finance · Quantitative Finance 2024-09-12 Jiefei Yang , Guanglian Li

Data assimilation is a method that combines observations (that is, real world data) of a state of a system with model output for that system in order to improve the estimate of the state of the system and thereby the model output. The model…

Numerical Analysis · Mathematics 2020-05-18 Melina A. Freitag

Gradient matching with Gaussian processes is a promising tool for learning parameters of ordinary differential equations (ODE's). The essence of gradient matching is to model the prior over state variables as a Gaussian process which…

Machine Learning · Statistics 2016-10-25 Nico S. Gorbach , Stefan Bauer , Joachim M. Buhmann

Long-range geophysical forecasts are fundamentally limited by chaotic dynamics and numerical errors. While data assimilation can mitigate these issues, classical variational smoothers require computationally expensive tangent-linear and…

Machine Learning · Computer Science 2026-02-24 Phillip Si , Peng Chen

Data assimilation (DA) is a fundamental computational technique that integrates numerical simulation models and observation data on the basis of Bayesian statistics. Originally developed for meteorology, especially weather forecasting, DA…