English
Related papers

Related papers: The Deep Latent Space Particle Filter for Real-Tim…

200 papers

Data assimilation techniques, such as ensemble Kalman filtering, have been shown to be a highly effective and efficient way to combine noisy data with a mathematical model to track and forecast dynamical systems. However, when dealing with…

Dynamical Systems · Mathematics 2023-05-17 Stephen A Falconer , David J. B. Lloyd , Naratip Santitissadeekorn

Accurate and efficient global ocean state estimation remains a grand challenge for Earth system science, hindered by the dual bottlenecks of computational scalability and degraded data fidelity in traditional data assimilation (DA) and deep…

Machine Learning · Computer Science 2025-11-11 Yanfei Xiang , Yuan Gao , Hao Wu , Quan Zhang , Ruiqi Shu , Xiao Zhou , Xi Wu , Xiaomeng Huang

Differentiable particle filters are an emerging class of models that combine sequential Monte Carlo techniques with the flexibility of neural networks to perform state space inference. This paper concerns the case where the system may…

Machine Learning · Computer Science 2024-12-19 John-Joseph Brady , Yuhui Luo , Wenwu Wang , Victor Elvira , Yunpeng Li

We present HyperFLINT (Hypernetwork-based FLow estimation and temporal INTerpolation), a novel deep learning-based approach for estimating flow fields, temporally interpolating scalar fields, and facilitating parameter space exploration in…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Hamid Gadirov , Qi Wu , David Bauer , Kwan-Liu Ma , Jos Roerdink , Steffen Frey

A Bayesian data assimilation scheme is formulated for advection-dominated or hyperbolic evolutionary problems, and observations. The method is referred to as the dynamic likelihood filter because it exploits the model physics to dynamically…

Dynamical Systems · Mathematics 2017-04-26 Juan M. Restrepo

Differentiable particle filters are an emerging class of particle filtering methods that use neural networks to construct and learn parametric state-space models. In real-world applications, both the state dynamics and measurements can…

Signal Processing · Electrical Eng. & Systems 2023-05-04 Wenhan Li , Xiongjie Chen , Wenwu Wang , Víctor Elvira , Yunpeng Li

The weather and climate domains are undergoing a significant transformation thanks to advances in AI-based foundation models such as FourCastNet, GraphCast, ClimaX and Pangu-Weather. While these models show considerable potential, they are…

Machine Learning · Computer Science 2024-07-18 Junqi Yin , Siming Liang , Siyan Liu , Feng Bao , Hristo G. Chipilski , Dan Lu , Guannan Zhang

As the model size continuously increases, pipeline parallelism shows great promise in throughput-oriented LLM inference due to its low demand on communications. However, imbalanced pipeline workloads and complex data dependencies in the…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-13 Hongbin Zhang , Taosheng Wei , Zhenyi Zheng , Jiangsu Du , Zhiguang Chen , Yutong Lu

The Distributed Adaptive Signal Fusion (DASF) framework is a meta-algorithm for computing data-driven spatial filters in a distributed sensing platform with limited bandwidth and computational resources, such as a wireless sensor network.…

Signal Processing · Electrical Eng. & Systems 2024-05-07 Charles Hovine , Alexander Bertrand

This paper is concerned with dynamic system state estimation based on a series of noisy measurement with the presence of outliers. An incremental learning assisted particle filtering (ILAPF) method is presented, which can learn the value…

Methodology · Statistics 2018-02-02 Bin Liu

Particle filters contain the promise of fully nonlinear data assimilation. They have been applied in numerous science areas, but their application to the geosciences has been limited due to their inefficiency in high-dimensional systems in…

Applications · Statistics 2019-04-16 Peter Jan van Leeuwen , Hans R. Künsch , Lars Nerger , Roland Potthast , Sebastian Reich

This study presents a novel approach to applying data assimilation techniques for particle-based simulations using the Ensemble Kalman Filter. While data assimilation methods have been effectively applied to Eulerian simulations, their…

Numerical Analysis · Mathematics 2024-12-10 Marius Duvillard , Loïc Giraldi , Olivier Le Maître

Ensemble transform Kalman filtering (ETKF) data assimilation is often used to combine available observations with numerical simulations to obtain statistically accurate and reliable state representations in dynamical systems. However, it is…

Numerical Analysis · Mathematics 2024-03-07 Tongtong Li , Anne Gelb , Yoonsang Lee

Discriminative correlation filters (DCF) with deep convolutional features have achieved favorable performance in recent tracking benchmarks. However, most of existing DCF trackers only consider appearance features of current frame, and…

Computer Vision and Pattern Recognition · Computer Science 2018-02-28 Zheng Zhu , Wei Wu , Wei Zou , Junjie Yan

Data assimilation has been applied to coastal hydrodynamic models to better estimate system states or parameters by incorporating observed data into the model. Kalman Filter (KF) is one of the most studied data assimilation methods whose…

Atmospheric and Oceanic Physics · Physics 2016-07-05 Milad Hooshyar , Stephen C. Medeiros , Dingbao Wang , Scott C. Hagen

Particle filters (also called sequential Monte Carlo methods) are widely used for state and parameter estimation problems in the context of nonlinear evolution equations. The recently proposed ensemble transform particle filter (ETPF)…

Numerical Analysis · Mathematics 2017-04-11 Walter Acevedo , Jana de Wiljes , Sebastian Reich

Complex systems are often described with competing models. Such divergence of interpretation on the system may stem from model fidelity, mathematical simplicity, and more generally, our limited knowledge of the underlying processes.…

Numerical Analysis · Mathematics 2017-07-21 Lun Yang , Akil Narayan , Peng Wang

In this paper, we consider the filtering problem for partially observed diffusions, which are regularly observed at discrete times. We are concerned with the case when one must resort to time-discretization of the diffusion process if the…

Numerical Analysis · Mathematics 2020-04-09 Marco Ballesio , Ajay Jasra , Erik von Schwerin , Raul Tempone

This paper presents an innovative Reduced-Order Model (ROM) for merging experimental and simulation data using Data Assimilation (DA) to estimate the "True" state of a fluid dynamics system, leading to more accurate predictions. Our…

Computational Engineering, Finance, and Science · Computer Science 2025-07-03 Paul Jeanney , Ashton Hetherington , Shady E. Ahmed , David Lanceta , Susana Saiz , José Miguel Perez , Soledad Le Clainche

Data assimilation combines information from models, measurements, and priors to estimate the state of a dynamical system such as the atmosphere. The Ensemble Kalman filter (EnKF) is a family of ensemble-based data assimilation approaches…

Computational Engineering, Finance, and Science · Computer Science 2014-12-09 Ahmed Attia , Adrian Sandu