English
Related papers

Related papers: Scalable Data Assimilation with Message Passing

200 papers

This paper develops a computational framework for optimizing the parameters of data assimilation systems in order to improve their performance. The approach formulates a continuous meta-optimization problem for parameters; the…

Computational Engineering, Finance, and Science · Computer Science 2015-06-16 Alexandru Cioaca , Adrian Sandu

Spatially misaligned data can be fused by using a Bayesian melding model that assumes that underlying all observations there is a spatially continuous Gaussian random field process. This model can be used, for example, to predict air…

Methodology · Statistics 2024-06-06 Ruiman Zhong , André Victor Ribeiro Amaral , Paula Moraga

Data assimilation is a vital component in modern global medium-range weather forecasting systems to obtain the best estimation of the atmospheric state by combining the short-term forecast and observations. Recently, AI-based data…

Machine Learning · Computer Science 2024-06-05 Kun Chen , Tao Chen , Peng Ye , Hao Chen , Kang Chen , Tao Han , Wanli Ouyang , Lei Bai

In this study, we explore data assimilation for the Stochastic Camassa-Holm equation through the application of the particle filtering framework. Specifically, our approach integrates adaptive tempering, jittering, and nudging techniques to…

Numerical Analysis · Mathematics 2024-02-13 Colin John Cotter , Dan Crisan , Maneesh Kumar Singh

Data assimilation (DA) in the geophysical sciences remains the cornerstone of robust forecasts from numerical models. Indeed, DA plays a crucial role in the quality of numerical weather prediction, and is a crucial building block that has…

Many dynamical systems are difficult or impossible to model using high fidelity physics based models. Consequently, researchers are relying more on data driven models to make predictions and forecasts. Based on limited training data,…

Chaotic Dynamics · Physics 2025-04-09 Max M. Chumley , Firas A. Khasawneh

We formulate a strong equivalence between machine learning, artificial intelligence methods and the formulation of statistical data assimilation as used widely in physical and biological sciences. The correspondence is that layer number in…

Artificial Intelligence · Computer Science 2017-07-06 Henry Abarbanel , Paul Rozdeba , Sasha Shirman

Message-passing algorithms based on the Belief Propagation (BP) equations constitute a well-known distributed computational scheme. It is exact on tree-like graphical models and has also proven to be effective in many problems defined on…

Machine Learning · Computer Science 2022-07-20 Carlo Lucibello , Fabrizio Pittorino , Gabriele Perugini , Riccardo Zecchina

We propose a Bayesian framework for the received-signal-strength-based cooperative localization problem with unknown path loss exponent. Our purpose is to infer the marginal posterior of each unknown parameter: the position or the path loss…

Signal Processing · Electrical Eng. & Systems 2020-04-22 Di Jin , Feng Yin , Carsten Fritsche , Fredrik Gustafsson , Abdelhak M. Zoubir

We study prediction-assimilation systems, which have become routine in meteorology and oceanography and are rapidly spreading to other areas of the geosciences and of continuum physics. The long-term, nonlinear stability of such a system…

Chaotic Dynamics · Physics 2009-11-13 Alberto Carrassi , Michael Ghil , Anna Trevisan , Francesco Uboldi

High resolution geospatial data are challenging because standard geostatistical models based on Gaussian processes are known to not scale to large data sizes. While progress has been made towards methods that can be computed more…

Methodology · Statistics 2020-12-03 Michele Peruzzi , David B. Dunson

A generic algorithm for the extraction of probabilistic (Bayesian) information about model parameters from data is presented. The algorithm propagates an ensemble of particles in the product space of model parameters and outputs. Each…

Computation · Statistics 2015-09-18 Carlo Albert

In this article, we prove that data assimilation by feedback nudging can be achieved for the three-dimensional quasi-geostrophic equation in a simplified scenario using only large spatial scale observables on the dynamical boundary. On this…

Analysis of PDEs · Mathematics 2016-12-12 Michael S. Jolly , Vincent R. Martinez , Edriss S. Titi

With continued advances in Geographic Information Systems and related computational technologies, statisticians are often required to analyze very large spatial datasets. This has generated substantial interest over the last decade, already…

Methodology · Statistics 2019-05-14 Lu Zhang , Abhirup Datta , Sudipto Banerjee

We consider the estimation of an i.i.d.\ random vector observed through a linear transform followed by a componentwise, probabilistic (possibly nonlinear) measurement channel. A novel algorithm, called generalized approximate message…

Information Theory · Computer Science 2012-08-15 Sundeep Rangan

We consider the estimation of an i.i.d. (possibly non-Gaussian) vector $\xbf \in \R^n$ from measurements $\ybf \in \R^m$ obtained by a general cascade model consisting of a known linear transform followed by a probabilistic componentwise…

Information Theory · Computer Science 2012-12-04 Ulugbek S. Kamilov , Sundeep Rangan , Alyson K. Fletcher , Michael Unser

Bayesian computational algorithms tend to scale poorly as data size increases. This has motivated divide-and-conquer-based approaches for scalable inference. These divide the data into subsets, perform inference for each subset in parallel,…

Methodology · Statistics 2025-10-22 Rihui Ou , Lachlan Astfalck , Deborshee Sen , David Dunson

Graphical models use the intuitive and well-studied methods of graph theory to implicitly represent dependencies between variables in large systems. They can model the global behaviour of a complex system by specifying only local factors.…

Artificial Intelligence · Computer Science 2015-08-21 Siamak Ravanbakhsh

In this paper we propose the use of a continuous data assimilation algorithm for miscible flow models in a porous medium. In the absence of initial conditions for the model, observed sparse measurements are used to generate an approximation…

Numerical Analysis · Mathematics 2022-06-23 Hakima Bessaih , Victor Ginting , Bradley McCaskill

Ensemble data assimilation is a problem in determining the most likely phase space trajectory of a model of an observed dynamical sys- tem as it receives inputs from measurements passing information to the model. Using methods developed in…

Chaotic Dynamics · Physics 2015-05-13 Henry D. I. Abarbanel