English
Related papers

Related papers: Conditions for successful data assimilation

200 papers

Variational data assimilation optimizes for an initial state of a dynamical system such that its evolution fits observational data. The physical model can subsequently be evolved into the future to make predictions. This principle is a…

Machine Learning · Computer Science 2021-05-21 Thomas Frerix , Dmitrii Kochkov , Jamie A. Smith , Daniel Cremers , Michael P. Brenner , Stephan Hoyer

We design a primal-dual stabilized finite element method for the numerical approximation of a data assimilation problem subject to the acoustic wave equation. For the forward problem, piecewise affine, continuous, finite element functions…

Numerical Analysis · Mathematics 2023-05-10 Erik Burman , Ali Feizmohammadi , Lauri Oksanen

High-dimensional limit theorems have been shown useful to derive tuning rules for finding the optimal scaling in random-walk Metropolis algorithms. The assumptions under which weak convergence results are proved are however restrictive: the…

Methodology · Statistics 2022-02-16 Sebastian M Schmon , Philippe Gagnon

The implicit particle filter is a sequential Monte Carlo method for data assimilation that guides the particles to the high-probability regions via a sequence of steps that includes minimizations. We present a new and more general…

Data Analysis, Statistics and Probability · Physics 2017-02-01 Ethan Atkins , Matthias Morzfeld , Alexandre J. Chorin

Adaptive filters are at the core of many signal processing applications, ranging from acoustic noise supression to echo cancelation, array beamforming, channel equalization, to more recent sensor network applications in surveillance, target…

Systems and Control · Electrical Eng. & Systems 2021-12-24 Jerónimo Arenas-García , Luis A. Azpicueta-Ruiz , Magno T. M. Silva , Vitor H. Nascimento , Ali H. Sayed

Ensemble data assimilation is a problem in determining the most likely phase space trajectory of a model of an observed dynamical sys- tem as it receives inputs from measurements passing information to the model. Using methods developed in…

Chaotic Dynamics · Physics 2015-05-13 Henry D. I. Abarbanel

With the increasing penetration of high-frequency sensors across a number of biological and physical systems, the abundance of the resulting observations offers opportunities for higher statistical accuracy of down-stream estimates, but…

Optimization and Control · Mathematics 2020-11-06 Shushu Zhang , Vivak Patel

Particle filters for data assimilation in nonlinear problems use "particles" (replicas of the underlying system) to generate a sequence of probability density functions (pdfs) through a Bayesian process. This can be expensive because a…

Numerical Analysis · Mathematics 2009-05-15 Alexandre J. Chorin , Xuemin Tu

Continuous data assimilation addresses time-dependent problems with unknown initial conditions by incorporating observations of the solution into a nudging term. For the prototypical heat equation with variable conductivity and the Neumann…

Numerical Analysis · Mathematics 2025-04-01 Vladimir Yushutin

The accuracy of simulation-based forecasting in chaotic systems is heavily dependent on high-quality estimates of the system state at the time the forecast is initialized. Data assimilation methods are used to infer these initial conditions…

Machine Learning · Computer Science 2021-11-02 Michael McCabe , Jed Brown

In this paper, we study the pooled data problem of identifying the labels associated with a large collection of items, based on a sequence of pooled tests revealing the counts of each label within the pool. In the noiseless setting, we…

Machine Learning · Statistics 2017-10-19 Jonathan Scarlett , Volkan Cevher

In this article we develop algorithms for data assimilation based upon a computational time dependent stable/unstable splitting. Our particular method is based upon shadowing refinement and synchronization techniques and is motivated by…

Dynamical Systems · Mathematics 2017-07-31 Bart de Leeuw , Svetlana Dubinkina , Jason Frank , Andrew Steyer , Xuemin Tu , Erik Van Vleck

This article develops a novel data assimilation methodology, addressing challenges that are common in real-world settings, such as severe sparsity of observations, lack of reliable models, and non-stationarity of the system dynamics. These…

Optimization and Control · Mathematics 2024-11-05 David J. Abers , George Hripcsak , Lena Mamykina , Melike Sirlanci , Esteban G. Tabak

Data assimilation is uniquely challenging in weather forecasting due to the high dimensionality of the employed models and the nonlinearity of the governing equations. Although current operational schemes are used successfully, our…

Atmospheric and Oceanic Physics · Physics 2018-05-09 Lea Oljača , Jochen Bröcker , Tobias Kuna

Data assimilation is an iterative approach to the problem of estimating the state of a dynamical system using both current and past observations of the system together with a model for the system's time evolution. Rather than solving the…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Brian R. Hunt , Eric J. Kostelich , Istvan Szunyogh

Variational data assimilation is a technique for combining measured data with dynamical models. It is a key component of Earth system state estimation and is commonly used in weather and ocean forecasting. The approach involves a…

Numerical Analysis · Mathematics 2026-04-30 I. Daužickaitė , M. A. Freitag , S. Gürol , A. S. Lawless , A. Ramage , J. A. Scott , J. M. Tabeart

Data assimilation combines (imperfect) knowledge of a flow's physical laws with (noisy, time-lagged, and otherwise imperfect) observations to produce a more accurate prediction of flow statistics. Assimilation by nudging (from 1964), while…

Numerical Analysis · Mathematics 2024-07-31 Aytekin Çıbık , Rui Fang , William Layton , Farjana Siddiqua

The advent of modern technology, permitting the measurement of thousands of characteristics simultaneously, has given rise to floods of data characterized by many large or even huge datasets. This new paradigm presents extraordinary…

Methodology · Statistics 2019-02-14 A. M. Pires , J. A. Branco

In noisy evolutionary optimization, sampling is a common strategy to deal with noise. By the sampling strategy, the fitness of a solution is evaluated multiple times (called \emph{sample size}) independently, and its true fitness is then…

Neural and Evolutionary Computing · Computer Science 2022-11-29 Chao Qian , Chao Bian , Yang Yu , Ke Tang , Xin Yao

Clustering algorithms remain valuable tools for grouping and summarizing the most important aspects of data. Example areas where this is the case include image segmentation, dimension reduction, signals analysis, model order reduction,…

Numerical Analysis · Mathematics 2024-12-24 Guy B. Oldaker , Maria Emelianenko