English
Related papers

Related papers: A data-driven method for improving the correlation…

200 papers

It was recently found with the aid of machine learning that for a variety of toy data assimilation systems with chaotic Lorenz-96 model it is possible to achieve a nearly-optimal data assimilation without carrying the state error covariance…

Chaotic Dynamics · Physics 2025-01-24 Pavel Sakov

The filtering distribution captures the statistics of the state of a dynamical system from partial and noisy observations. Classical particle filters provably approximate this distribution in quite general settings; however they behave…

Statistics Theory · Mathematics 2025-02-10 Edoardo Calvello , Pierre Monmarché , Andrew M. Stuart , Urbain Vaes

Filtering is concerned with online estimation of the state of a dynamical system from partial and noisy observations. In applications where the state is high dimensional, ensemble Kalman filters are often the method of choice. This paper…

Dynamical Systems · Mathematics 2024-12-20 Daniel Sanz-Alonso , Nathan Waniorek

We study the use of novel techniques arising in machine learning for inverse problems. Our approach replaces the complex forward model by a neural network, which is trained simultaneously in a one-shot sense when estimating the unknown…

Numerical Analysis · Mathematics 2020-09-15 Philipp A. Guth , Claudia Schillings , Simon Weissmann

Data assimilation (DA) aims at forecasting the state of a dynamical system by combining a mathematical representation of the system with noisy observations taking into account their uncertainties. State of the art methods are based on the…

Machine Learning · Computer Science 2023-05-26 Pierre Boudier , Anthony Fillion , Serge Gratton , Selime Gürol , Sixin Zhang

In this paper, we focus on sensor placement in linear dynamic estimation, where the objective is to place a small number of sensors in a system of interdependent states so to design an estimator with a desired estimation performance. In…

Optimization and Control · Mathematics 2020-05-18 Vasileios Tzoumas , Ali Jadbabaie , George J. Pappas

This paper is concerned with the problem of distributed Kalman filtering in a network of interconnected subsystems with distributed control protocols. We consider networks, which can be either homogeneous or heterogeneous, of linear…

Systems and Control · Computer Science 2017-11-22 Damian Marelli , Mohsen Zamani , Minyue Fu

The dramatic growth of big datasets presents a new challenge to data storage and analysis. Data reduction, or subsampling, that extracts useful information from datasets is a crucial step in big data analysis. We propose an orthogonal…

Methodology · Statistics 2021-06-01 Lin Wang , Jake Elmstedt , Weng Kee Wong , Hongquan Xu

We develop an algebraic framework for sequential data assimilation of partially observed dynamical systems. In this framework, Bayesian data assimilation is embedded in a non-abelian operator algebra, which provides a representation of…

Statistics Theory · Mathematics 2023-03-29 David Freeman , Dimitrios Giannakis , Brian Mintz , Abbas Ourmazd , Joanna Slawinska

Filtering is a widely used methodology for the incorporation of observed data into time-evolving systems. It provides an online approach to state estimation inverse problems when data is acquired sequentially. The Kalman filter plays a…

Probability · Mathematics 2015-05-27 Wonjung Lee , Damon McDougall , Andrew Stuart

In recent years, machine learning (ML) has been proposed to devise data-driven parametrisations of unresolved processes in dynamical numerical models. In most cases, the ML training leverages high-resolution simulations to provide a dense,…

Computational Physics · Physics 2020-12-09 Julien Brajard , Alberto Carrassi , Marc Bocquet , Laurent Bertino

Prediction error and maximum likelihood methods are powerful tools for identifying linear dynamical systems and, in particular, enable the joint estimation of model parameters and the Kalman filter used for state estimation. A key…

Systems and Control · Electrical Eng. & Systems 2026-04-21 Léo Simpson , Moritz Diehl

Estimating the statistics of the state of a dynamical system, from partial and noisy observations, is both mathematically challenging and finds wide application. Furthermore, the applications are of great societal importance, including…

Numerical Analysis · Mathematics 2025-06-03 J. A. Carrillo , F. Hoffmann , A. M. Stuart , U. Vaes

This paper presents an innovative Reduced-Order Model (ROM) for merging experimental and simulation data using Data Assimilation (DA) to estimate the "True" state of a fluid dynamics system, leading to more accurate predictions. Our…

Computational Engineering, Finance, and Science · Computer Science 2025-07-03 Paul Jeanney , Ashton Hetherington , Shady E. Ahmed , David Lanceta , Susana Saiz , José Miguel Perez , Soledad Le Clainche

We consider the problem of an ensemble Kalman filter when only partial observations are available. In particular we consider the situation where the observational space consists of variables which are directly observable with known…

Data Analysis, Statistics and Probability · Physics 2011-08-31 Georg A. Gottwald , Lewis Mitchell , Sebastian Reich

We are interested in ensemble methods to solve multi-objective optimization problems. An ensemble Kalman method is proposed to solve a formulation of the nonlinear problem using a weighted function approach. An analysis of the mean field…

Numerical Analysis · Mathematics 2022-03-21 Michael Herty , Elisa Iacomini

In this paper, we present a new ensemble-based filter method by reconstructing the analysis step of the particle filter through a transport map, which directly transports prior particles to posterior particles. The transport map is…

Machine Learning · Statistics 2026-05-14 Dengfei Zeng , Lijian Jiang

Ensemble data assimilation techniques form an indispensable part of numerical weather prediction. As the ensemble size grows and model resolution increases, the amount of required storage becomes a major issue. Data compression schemes may…

Numerical solvers using adaptive meshes can focus computational power on important regions of a model domain capturing important or unresolved physics. The adaptation can be informed by the model state, external information, or made to…

Applications · Statistics 2021-05-12 Christian Sampson , Alberto Carrassi , Ali Aydoğdu , Chris K. R. T Jones

Reconstruction of turbulent flow based on data assimilation methods is of significant importance for improving the estimation of flow characteristics by incorporating limited observations. Existing works mainly focus on using only one…

Fluid Dynamics · Physics 2021-03-30 Xin-Lei Zhang , Heng Xiao , Guo-Wei He , Shi-Zhao Wang
‹ Prev 1 3 4 5 6 7 10 Next ›