English
Related papers

Related papers: Neural variational Data Assimilation with Uncertai…

200 papers

This paper proposes an extension to the classical 3D variational data assimilation approach by explicitly incorporating as a prior information, the transform-domain sparsity observed in a large class of geophysical signals. In particular,…

Data Analysis, Statistics and Probability · Physics 2012-07-03 Ardeshir M. Ebtehaj , Efi Foufoula-Georgiou , Sara Q. Zhang , Arthur Y. Hou

Data assimilation addresses the problem of identifying plausible state trajectories of dynamical systems given noisy or incomplete observations. In geosciences, it presents challenges due to the high-dimensionality of geophysical dynamical…

Machine Learning · Statistics 2023-11-03 François Rozet , Gilles Louppe

Data assimilation is an iterative approach to the problem of estimating the state of a dynamical system using both current and past observations of the system together with a model for the system's time evolution. Rather than solving the…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Brian R. Hunt , Eric J. Kostelich , Istvan Szunyogh

Data assimilation is the process of fusing information from imperfect computer simulations with noisy, sparse measurements of reality to obtain improved estimates of the state or parameters of a dynamical system of interest. The data…

A new knowledge-based and machine learning hybrid modeling approach, called conditional Gaussian neural stochastic differential equation (CGNSDE), is developed to facilitate modeling complex dynamical systems and implementing analytic…

Machine Learning · Computer Science 2024-10-15 Chuanqi Chen , Nan Chen , Jin-Long Wu

We develop innovative algorithms for solving the strong-constraint formulation of four-dimensional variational data assimilation in large-scale applications. We present a space-time decomposition approach that employs domain decomposition…

Numerical Analysis · Mathematics 2022-05-16 Luisa D'Amore. Emil Constantinescu , Luisa Carracciuolo

Variational data assimilation is a technique for combining measured data with dynamical models. It is a key component of Earth system state estimation and is commonly used in weather and ocean forecasting. The approach involves a…

Numerical Analysis · Mathematics 2026-04-30 I. Daužickaitė , M. A. Freitag , S. Gürol , A. S. Lawless , A. Ramage , J. A. Scott , J. M. Tabeart

Information-theoretic generalization bounds analyze stochastic optimization by relating expected generalization error to the mutual information between learned parameters and training data. Virtual perturbation analyses of SGD add auxiliary…

Machine Learning · Computer Science 2026-05-04 Mohammad Partohaghighi

Graph Neural Networks have achieved impressive results across diverse network modeling tasks, but accurately estimating uncertainty on graphs remains difficult, especially under distributional shifts. Unlike traditional uncertainty…

Machine Learning · Computer Science 2025-10-15 Fred Xu , Thomas Markovich

High-fidelity simulation of complex physical systems is exorbitantly expensive and inaccessible across spatiotemporal scales. Recently, there has been an increasing interest in leveraging deep learning to augment scientific data based on…

Machine Learning · Computer Science 2022-08-03 Pu Ren , Chengping Rao , Yang Liu , Zihan Ma , Qi Wang , Jian-Xun Wang , Hao Sun

This paper studies the role of sparse regularization in a properly chosen basis for variational data assimilation (VDA) problems. Specifically, it focuses on data assimilation of noisy and down-sampled observations while the state variable…

Data Analysis, Statistics and Probability · Physics 2014-06-25 A. M. Ebtehaj , M. Zupanski , G. Lerman , E. Foufoula-Georgiou

The continuous representation of spatiotemporal data commonly relies on using abstract data types, such as \textit{moving regions}, to represent entities whose shape and position continuously change over time. Creating this representation…

Databases · Computer Science 2023-08-29 Tiago F. R. Ribeiro , Fernando Silva , Rogério Luís de C. Costa

In this paper we propose a new model-based unsupervised learning method, called VarNet, for the solution of partial differential equations (PDEs) using deep neural networks (NNs). Particularly, we propose a novel loss function that relies…

Machine Learning · Computer Science 2019-12-17 Reza Khodayi-Mehr , Michael M. Zavlanos

Data assimilation (DA) provides a general framework for estimation in dynamical systems based on the concepts of Bayesian inference. This constitutes a common basis for the different linear and nonlinear filtering and smoothing techniques…

Optimization and Control · Mathematics 2023-03-08 Tarek Diaa-Eldeen , Marcus Krogh Nielsen , Carl Fredrik Berg , Morten Hovd , John Bagterp Jørgensen

We propose a novel framework for discovering Stochastic Partial Differential Equations (SPDEs) from data. The proposed approach combines the concepts of stochastic calculus, variational Bayes theory, and sparse learning. We propose the…

Machine Learning · Statistics 2023-06-29 Yogesh Chandrakant Mathpati , Tapas Tripura , Rajdip Nayek , Souvik Chakraborty

A state-space model is a statistical framework for inferring latent states from observed time-series data. However, inference with nonlinear and high-dimensional state-space models remains challenging. To this end, an approach based on…

Computational Engineering, Finance, and Science · Computer Science 2026-04-02 Yuma Yamaoka , Seiichi Uchida , Shoji Toyota

Most scientific machine learning (SciML) applications of neural networks involve hundreds to thousands of parameters, and hence, uncertainty quantification for such models is plagued by the curse of dimensionality. Using physical…

Machine Learning · Computer Science 2024-07-02 Govinda Anantha Padmanabha , Jan Niklas Fuhg , Cosmin Safta , Reese E. Jones , Nikolaos Bouklas

We introduce a new class of spatially stochastic physics and data informed deep latent models for parametric partial differential equations (PDEs) which operate through scalable variational neural processes. We achieve this by assigning…

Machine Learning · Computer Science 2023-06-08 Arnaud Vadeboncoeur , Ieva Kazlauskaite , Yanni Papandreou , Fehmi Cirak , Mark Girolami , Ömer Deniz Akyildiz

I propose a novel framework that integrates stochastic differential equations (SDEs) with deep generative models to improve uncertainty quantification in machine learning applications involving structured and temporal data. This approach,…

Machine Learning · Statistics 2026-01-09 James Rice

Solving partial differential equations (PDEs) efficiently and accurately remains a cornerstone challenge in science and engineering, especially for problems involving complex geometries and limited labeled data. We introduce a Physics- and…

Machine Learning · Computer Science 2025-08-14 Subhankar Sarkar , Souvik Chakraborty