English
Related papers

Related papers: Ensemble filter techniques for intermittent data a…

200 papers

Advances in digital sensors, digital data storage and communications have resulted in systems being capable of accumulating large collections of data. In the light of dealing with the challenges that massive data present, this work proposes…

Computation · Statistics 2015-12-09 Allan De Freitas , François Septier , Lyudmila Mihaylova

Filtering is concerned with the sequential estimation of the state, and uncertainties, of a Markovian system, given noisy observations. It is particularly difficult to achieve accurate filtering in complex dynamical systems, such as those…

Probability · Mathematics 2015-12-14 Wonjung Lee , Andrew Stuart

In recent years, several ensemble-based filtering methods have been proposed and studied. The main challenge in such procedures is the updating of a prior ensemble to a posterior ensemble at every step of the filtering recursions. In the…

Methodology · Statistics 2019-04-11 Margrethe Kvale Loe , Håkon Tjelmeland

The understanding of nonlinear, high dimensional flows, e.g, atmospheric and ocean flows, is critical to address the impacts of global climate change. Data Assimilation techniques combine physical models and observational data, often in a…

This study presents a novel approach to applying data assimilation techniques for particle-based simulations using the Ensemble Kalman Filter. While data assimilation methods have been effectively applied to Eulerian simulations, their…

Numerical Analysis · Mathematics 2024-12-10 Marius Duvillard , Loïc Giraldi , Olivier Le Maître

Data assimilation (DA) has increasingly emerged as a critical tool for state estimation across a wide range of applications. It is significantly challenging when the governing equations of the underlying dynamics are unknown. To this end,…

Machine Learning · Computer Science 2026-01-13 Ziyi Wang , Lijian Jiang

We consider filtering in high-dimensional non-Gaussian state-space models with intractable transition kernels, nonlinear and possibly chaotic dynamics, and sparse observations in space and time. We propose a novel filtering methodology that…

Methodology · Statistics 2022-04-07 Alessio Spantini , Ricardo Baptista , Youssef Marzouk

Data assimilation (DA) estimates a dynamical system's state from noisy observations. Recent generative models like the ensemble score filter (EnSF) improve DA in high-dimensional nonlinear settings but are computationally expensive. We…

Machine Learning · Statistics 2025-09-30 Taos Transue , Bohan Chen , So Takao , Bao Wang

This paper contains the latest installment of the authors' project on developing ensemble based data assimilation methodology for high dimensional fluid dynamics models. The algorithm presented here is a particle filter that combines model…

Numerical Analysis · Mathematics 2020-04-22 Colin Cotter , Dan Crisan , Darryl Holm , Wei Pan , Igor Shevchenko

This paper is a contribution in the context of variational data assimilation combined with statistical learning. The framework of data assimilation traditionally uses data collected at sensor locations in order to bring corrections to a…

Numerical Analysis · Mathematics 2023-05-09 Amina Benaceur , Barbara Verfürth

Data assimilation is a core component of numerical weather prediction systems. The large quantity of data processed during assimilation requires the computation to be distributed across increasingly many compute nodes, yet existing…

Machine Learning · Computer Science 2025-01-15 Oscar Key , So Takao , Daniel Giles , Marc Peter Deisenroth

This paper introduces score-based sequential Langevin sampling (SSLS), a novel approach to nonlinear data assimilation within a recursive Bayesian filtering framework. The proposed method decomposes the assimilation process into alternating…

Numerical Analysis · Mathematics 2026-04-07 Zhao Ding , Chenguang Duan , Yuling Jiao , Jerry Zhijian Yang , Cheng Yuan , Pingwen Zhang

This study proposes a materials search method combining a data assimilation technique based on a multivariate Gaussian distribution with Bayesian optimization. The efficiency of the search using this method was demonstrated using a pair of…

Many problems in the geophysical sciences demand the ability to calibrate the parameters and predict the time evolution of complex dynamical models using sequentially-collected data. Here we introduce a general methodology for the joint…

Computation · Statistics 2018-12-12 Sara Pérez-Vieites , Inés P. Mariño , Joaquín Míguez

The recent development of compressed sensing has led to spectacular advances in the understanding of sparse linear estimation problems as well as in algorithms to solve them. It has also triggered a new wave of developments in the related…

Information Theory · Computer Science 2016-07-05 Christophe Schülke

We focus on an interpolation method referred to Bayesian reconstruction in this paper. Whereas in standard interpolation methods missing data are interpolated deterministically, in Bayesian reconstruction, missing data are interpolated…

Machine Learning · Statistics 2015-03-27 Shun Kataoka , Muneki Yasuda , Kazuyuki Tanaka

In population studies, it is standard to sample data via designs in which the population is divided into strata, with the different strata assigned different probabilities of inclusion. Although there have been some proposals for including…

Methodology · Statistics 2014-09-29 T. Kunihama , A. H. Herring , C. T. Halpern , D. B. Dunson

Understanding and predicting people flow in urban areas is useful for decision-making in urban planning and marketing strategies. Traditional methods for understanding people flow can be divided into measurement-based approaches and…

Human-Computer Interaction · Computer Science 2024-01-18 Ryo Murata , Kenji Tanaka

We commonly refer to state-estimation theory in geosciences as data assimilation. This term encompasses the entire sequence of operations that, starting from the observations of a system, and from additional statistical and dynamical…

Atmospheric and Oceanic Physics · Physics 2018-06-11 Alberto Carrassi , Marc Bocquet , Laurent Bertino , Geir Evensen

This paper offers a comprehensive introduction to Bayesian inference, combining historical context, theoretical foundations, and core analytical examples. Beginning with Bayes' theorem and the philosophical distinctions between Bayesian and…

Methodology · Statistics 2025-12-08 Juan Sosa , Carlos A. Martínez , Danna Cruz