English
Related papers

Related papers: Feature preserving data assimilation via feature a…

200 papers

Implicit particle filters for data assimilation generate high-probability samples by representing each particle location as a separate function of a common reference variable. This representation requires that a certain underdetermined…

Numerical Analysis · Mathematics 2015-05-27 Matthias Morzfeld , Xuemin Tu , Ethan Atkins , Alexandre J. Chorin

Many real-world machine learning applications are characterized by a huge number of features, leading to computational and memory issues, as well as the risk of overfitting. Ideally, only relevant and non-redundant features should be…

Machine Learning · Computer Science 2023-06-21 Paolo Bonetti , Alberto Maria Metelli , Marcello Restelli

State-space models can be used to incorporate subject knowledge on the underlying dynamics of a time series by the introduction of a latent Markov state-process. A user can specify the dynamics of this process together with how the state…

Computation · Statistics 2017-09-14 Paul Fearnhead , Hans Künsch

We identify a strong equivalence between neural network based machine learning (ML) methods and the formulation of statistical data assimilation (DA), known to be a problem in statistical physics. DA, as used widely in physical and…

Machine Learning · Computer Science 2017-10-23 H. D. I. Abarbanel , P. J. Rozdeba , S. Shirman

In applications such as free-space optical communication, a signal is often recovered after propagation through a turbulent medium. In this setting, it is common to assume that limited information is known about the turbulent medium, such…

Optics · Physics 2025-10-13 Anjali Nair , Qin Li , Samuel N. Stechmann

The accuracy of simulation-based forecasting in chaotic systems is heavily dependent on high-quality estimates of the system state at the time the forecast is initialized. Data assimilation methods are used to infer these initial conditions…

Machine Learning · Computer Science 2021-11-02 Michael McCabe , Jed Brown

Data assimilation is widely used in many disciplines such as meteorology, oceanography, and robotics to estimate the state of a dynamical system from noisy observations. In this work, we propose a lightweight and general method to perform…

Machine Learning · Computer Science 2025-10-02 Thomas Savary , François Rozet , Gilles Louppe

Complex nonlinear turbulent dynamical systems are ubiquitous in many areas. Recovering unobserved state variables is an important topic for the data assimilation of turbulent systems. In this article, an efficient continuous in time data…

Fluid Dynamics · Physics 2021-11-03 Nan Chen , Yuchen Li , Evelyn Lunasin

This work introduces a novel nonlinear optimal filtering method, termed the Ensemble Schr{\"o}dinger Bridge nonlinear filter. The proposed filter combines the standard prediction step with a diffusion-generative-modeling-based analysis…

Machine Learning · Computer Science 2026-05-12 Hui Sun

One way to interject knowledge into clinically impactful forecasting is to use data assimilation, a nonlinear regression that projects data onto a mechanistic physiologic model, instead of a set of functions, such as neural networks. Such…

Quantitative Methods · Quantitative Biology 2019-02-07 DJ Albers , M Levine , L Mamykina , G Hripcsak

This paper addresses variational data assimilation from a learning point of view. Data assimilation aims to reconstruct the time evolution of some state given a series of observations, possibly noisy and irregularly-sampled. Using automatic…

Computational Physics · Physics 2021-11-10 Ronan Fablet , Bertrand Chapron , Lucas. Drumetz , Etienne Memin , Olivier Pannekoucke , Francois Rousseau

This article develops a novel data assimilation methodology, addressing challenges that are common in real-world settings, such as severe sparsity of observations, lack of reliable models, and non-stationarity of the system dynamics. These…

Optimization and Control · Mathematics 2024-11-05 David J. Abers , George Hripcsak , Lena Mamykina , Melike Sirlanci , Esteban G. Tabak

We address data assimilation for linear and nonlinear dynamical systems via the so-called \emph{model reference adaptive system}. Continuing our theoretical developments in \cite{Tram_Kaltenbacher_2021}, we deliver the first practical…

Optimization and Control · Mathematics 2026-02-12 Benedikt Kaltenbach , Christian Aarset , Tram Thi Ngoc Nguyen

A thermal convection loop is a annular chamber filled with water, heated on the bottom half and cooled on the top half. With sufficiently large forcing of heat, the direction of fluid flow in the loop oscillates chaotically, dynamics…

Dynamical Systems · Mathematics 2016-06-24 Andrew J. Reagan , Yves Dubief , Peter Sheridan Dodds , Christopher M. Danforth

Feature selection methods have an important role on the readability of data and the reduction of complexity of learning algorithms. In recent years, a variety of efforts are investigated on feature selection problems based on unsupervised…

Machine Learning · Computer Science 2019-12-12 Mohsen Ghassemi Parsa , Hadi Zare , Mehdi Ghatee

Many problems in the geophysical sciences demand the ability to calibrate the parameters and predict the time evolution of complex dynamical models using sequentially-collected data. Here we introduce a general methodology for the joint…

Computation · Statistics 2018-12-12 Sara Pérez-Vieites , Inés P. Mariño , Joaquín Míguez

Ensemble learning that can be used to combine the predictions from multiple learners has been widely applied in pattern recognition, and has been reported to be more robust and accurate than the individual learners. This ensemble logic has…

Machine Learning · Computer Science 2020-02-12 Xiaokang Zhang , Inge Jonassen

To analyze the topological properties of the given discrete data, one needs to consider a continuous transform called filtration. Persistent homology serves as a tool to track changes of homology in the filtration. The outcome of the…

Optimization and Control · Mathematics 2024-10-08 Keunsu Kim , Jae-Hun Jung

State estimation that combines observational data with mathematical models is central to many applications and is commonly addressed through filtering methods, such as ensemble Kalman filters. In this article, we examine the signal-tracking…

Numerical Analysis · Mathematics 2025-09-08 Nazanin Abedini , Jana de Wiljes , Svetlana Dubinkina

In a previous work \citep{luo2016sparse2d_spej}, the authors proposed an ensemble-based 4D seismic history matching (SHM) framework, which has some relatively new ingredients, in terms of the type of seismic data in choice, the way to…

Data Analysis, Statistics and Probability · Physics 2018-03-13 Xiaodong Luo , Tuhin Bhakta , Morten Jakobsen , Geir Nævdal