English
Related papers

Related papers: Auto-differentiable data assimilation: Co-learning…

200 papers

This work is about low dimensional reduction for a slow-fast data assimilation system with non-Gaussian $\alpha-$stable L\'evy noise via stochastic averaging. When the observations are only available for slow components, we show that the…

Dynamical Systems · Mathematics 2018-01-10 Yanjie Zhang , Zhuan Cheng , Xinyong Zhang , Xiaoli Chen , Jinqiao Duan , Xiaofan Li

With the increasing penetration of high-frequency sensors across a number of biological and physical systems, the abundance of the resulting observations offers opportunities for higher statistical accuracy of down-stream estimates, but…

Optimization and Control · Mathematics 2020-11-06 Shushu Zhang , Vivak Patel

Recent advances in incorporating neural networks into particle filters provide the desired flexibility to apply particle filters in large-scale real-world applications. The dynamic and measurement models in this framework are learnable…

Machine Learning · Computer Science 2021-03-30 Hao Wen , Xiongjie Chen , Georgios Papagiannis , Conghui Hu , Yunpeng Li

This chapter describes a novel approach for the treatment of model error in geophysical data assimilation. In this method, model error is treated as a deterministic process fully correlated in time. This allows for the derivation of the…

Atmospheric and Oceanic Physics · Physics 2015-11-11 Alberto Carrassi , Stéphane Vannitsem

Imagine a smart camera trap selectively clicking pictures to understand animal movement patterns within a particular habitat. These "snapshots", or pieces of data captured from a data stream at adaptively chosen times, provide a glimpse of…

Machine Learning · Computer Science 2024-12-10 Pramith Devulapalli , Steve Hanneke

Data assimilation (DA) methods use priors arising from differential equations to robustly interpolate and extrapolate data. Popular techniques such as ensemble methods that handle high-dimensional, nonlinear PDE priors focus mostly on state…

Machine Learning · Statistics 2024-06-05 Rafael Anderka , Marc Peter Deisenroth , So Takao

This work proposes a training algorithm based on adaptive random Fourier features (ARFF) with Metropolis sampling and resampling \cite{kammonen2024adaptiverandomfourierfeatures} for learning drift and diffusion components of stochastic…

Machine Learning · Computer Science 2025-07-22 Owen Douglas , Aku Kammonen , Anamika Pandey , Raúl Tempone

Shallow water equations are extensively considered in the domains of oceans, atmospheric modelling, and engineering research (Franca et al., 2022), which play significant roles in floods and tsunami governance. Nonetheless, the accurate…

Fluid Dynamics · Physics 2023-09-22 Ruijia Yu

Data Assimilation (DA) is a computational tool that uses value from the model and the real measurement to arrive to an optimally acceptable value. Rather, this technique relies on the idea of Kalman gain. We point out that DA has two…

Optimization and Control · Mathematics 2020-12-15 Mohammad N. Murshed , Zarin Subah , M. Monir Uddin

We propose a framework for learning discrete deterministic planning domains. In this framework, an agent learns the domain by observing the action effects through continuous features that describe the state of the environment after the…

Artificial Intelligence · Computer Science 2019-04-22 Luciano Serafini , Paolo Traverso

Recently, there has been a surge of interest in incorporating neural networks into particle filters, e.g. differentiable particle filters, to perform joint sequential state estimation and model learning for non-linear non-Gaussian…

Machine Learning · Computer Science 2025-01-07 Xiongjie Chen , Yunpeng Li

This chapter provides various perspective on an important challenge in data assimilation: model error. While the overall goal is to understand the implication of model error of any type in data assimilation, we emphasize on the effect of…

Dynamical Systems · Mathematics 2015-07-02 John Harlim

Adaptive filtering algorithms are pervasive throughout signal processing and have had a material impact on a wide variety of domains including audio processing, telecommunications, biomedical sensing, astrophysics and cosmology, seismology,…

Sound · Computer Science 2022-11-23 Jonah Casebeer , Nicholas J. Bryan , Paris Smaragdis

Data assimilation (DA) is a cornerstone of scientific and engineering applications, combining model forecasts with sparse and noisy observations to estimate latent system states. Classical high-dimensional DA methods, such as the ensemble…

Machine Learning · Statistics 2026-05-28 Martin Andrae , Erik Wikingsson , So Takao , Tomas Landelius , Fredrik Lindsten

Reconstructing the equation of motion and thus the network topology of a system from time series is a very important problem. Although many powerful methods have been developed, it remains a great challenge to deal with systems in high…

Adaptation and Self-Organizing Systems · Physics 2023-08-16 Zishuo Yan , Lili Gui , Kun Xu , Yueheng Lan

The problem of state estimation has a long history with many successful algorithms that allow analytical derivation or approximation of posterior filtering distribution given the noisy observations. This report tries to conclude previous…

Machine Learning · Computer Science 2025-01-06 Nikita Kostin

This paper presents a novel methodology to tackle feedback optimal control problems in scenarios where the exact state of the controlled process is unknown. It integrates data assimilation techniques and optimal control solvers to manage…

Optimization and Control · Mathematics 2024-04-10 Siming Liang , Ruoyu Hu , Feng Bao , Richard Archibald , Guannan Zhang

The use of data assimilation technique to identify optimal topography is discussed in frames of time-dependent motion governed by non-linear barotropic ocean model. Assimilation of artificially generated data allows to measure the influence…

Atmospheric and Oceanic Physics · Physics 2009-12-08 Eugene Kazantsev

Accurate state estimation requires careful consideration of uncertainty surrounding the process and measurement models; these characteristics are usually not well-known and need an experienced designer to select the covariance matrices. An…

Machine Learning · Statistics 2025-07-18 Pardha Sai Krishna Ala , Ameya Salvi , Venkat Krovi , Matthias Schmid

Modern learning systems increasingly interact with data that evolve over time and depend on hidden internal state. We ask a basic question: when is such a dynamical system learnable from observations alone? This paper proposes a research…

Machine Learning · Computer Science 2025-12-23 Elad Hazan , Shai Shalev Shwartz , Nathan Srebro
‹ Prev 1 8 9 10 Next ›