English
Related papers

Related papers: Accurate deep learning-based filtering for chaotic…

200 papers

Data assimilation (DA) integrates observational information with model predictions to improve state estimation in complex systems. While filtering provides the basis for online forecasts by using only past and present observations, it can…

Numerical Analysis · Mathematics 2026-05-05 Zhang Jiang , Marios Andreou , Sebastian Reich , Nan Chen

The real-time prediction of chaotic systems requires a nonlinear-reduced order model (ROM) to forecast the dynamics, and a stream of data from sensors to update the ROM. Data-driven ROMs are typically built with a two-step strategy: data…

Chaotic Dynamics · Physics 2026-01-19 Elise Özalp , Andrea Nóvoa , Luca Magri

Learning dynamics from dissipative chaotic systems is notoriously difficult due to their inherent instability, as formalized by their positive Lyapunov exponents, which exponentially amplify errors in the learned dynamics. However, many of…

Machine Learning · Computer Science 2024-06-07 Yair Schiff , Zhong Yi Wan , Jeffrey B. Parker , Stephan Hoyer , Volodymyr Kuleshov , Fei Sha , Leonardo Zepeda-Núñez

We propose a hybrid meta-learning framework for forecasting and anomaly detection in nonlinear dynamical systems characterized by nonstationary and stochastic behavior. The approach integrates a physics-inspired simulator that captures…

Machine Learning · Computer Science 2025-06-18 Abdullah Burkan Bereketoglu

A data-driven method for improving the correlation estimation in serial ensemble Kalman filters is introduced. The method finds a linear map that transforms, at each assimilation cycle, the poorly estimated sample correlation into an…

Statistics Theory · Mathematics 2017-04-05 Michèle De La Chevrotière , John Harlim

Data assimilation (DA) aims to optimally combine model forecasts and observations that are both partial and noisy. Multi-model DA generalizes the variational or Bayesian formulation of the Kalman filter, and we prove that it is also the…

Methodology · Statistics 2023-01-23 Eviatar Bach , Michael Ghil

Spatiotemporal chaotic systems are difficult to characterize in a model-free manner because of their high dimensionality, strong nonlinearity, and sensitivity to initial conditions. Coupled map lattices, as a representative class of…

Chaotic Dynamics · Physics 2026-04-15 Xiaoqi Lei , Zixiang Yan , Jian Gao , Yueheng Lan , Jinghua Xiao

Data-driven prediction and physics-agnostic machine-learning methods have attracted increased interest in recent years achieving forecast horizons going well beyond those to be expected for chaotic dynamical systems. In a separate strand of…

Data Analysis, Statistics and Probability · Physics 2021-05-19 Georg A. Gottwald , Sebastian Reich

This paper addresses the data-driven identification of latent dynamical representations of partially-observed systems, i.e., dynamical systems for which some components are never observed, with an emphasis on forecasting applications,…

Marine biogeochemistry models are critical for forecasting, as well as estimating ecosystem responses to climate change and human activities. Data assimilation (DA) improves these models by aligning them with real-world observations, but…

Atmospheric and Oceanic Physics · Physics 2025-04-08 Ieuan Higgs , Ross Bannister , Jozef Skákala , Alberto Carrassi , Stefano Ciavatta

In this computational paper, we perform sensitivity analysis of long-time (or ensemble) averages in the chaotic regime using the shadowing algorithm. We introduce automatic differentiation to eliminate the tangent/adjoint equation solvers…

Dynamical Systems · Mathematics 2020-11-18 Nisha Chandramoorthy , Luca Magri , Qiqi Wang

We review the field of data assimilation (DA) from a Bayesian perspective and show that, in addition to its by now common application to state estimation, DA may be used for model selection. An important special case of the latter is the…

Applications · Statistics 2017-04-05 Alberto Carrassi , Marc Bocquet , Alexis Hannart , Michael Ghil

Recent advances in data assimilation (DA) have focused on developing more flexible approaches that can better accommodate nonlinearities in models and observations. However, it remains unclear how the performance of these advanced methods…

Atmospheric and Oceanic Physics · Physics 2025-05-08 Zixiang Xiong , Siming Liang , Feng Bao , Guannan Zhang , Hristo G. Chipilski

Chaotic systems are intrinsically sensitive to small errors, challenging efforts to construct predictive data-driven models of real-world dynamical systems such as fluid flows or neuronal activity. Prior efforts comprise either specialized…

Machine Learning · Computer Science 2026-03-12 Jeffrey Lai , Anthony Bao , William Gilpin

Linear dynamical systems are a fundamental and powerful parametric model class. However, identifying the parameters of a linear dynamical system is a venerable task, permitting provably efficient solutions only in special cases. This work…

Machine Learning · Computer Science 2020-03-03 Chloe Ching-Yun Hsu , Michaela Hardt , Moritz Hardt

We consider the problem of forecasting complex, nonlinear space-time processes when observations provide only partial information of on the system's state. We propose a natural data-driven framework, where the system's dynamics are modelled…

Systems and Control · Computer Science 2019-03-01 Ibrahim Ayed , Emmanuel de Bézenac , Arthur Pajot , Julien Brajard , Patrick Gallinari

In stochastic systems, numerically sampling the relevant trajectories for the estimation of the large deviation statistics of time-extensive observables requires overcoming their exponential (in space and time) scarcity. The optimal way to…

Statistical Mechanics · Physics 2021-01-14 Tom H. E. Oakes , Adam Moss , Juan P. Garrahan

Data assimilation (DA) addresses the problem of sequentially estimating the state of a dynamical system from noisy and incomplete observations. In this work, we employ a diffusion model as a world model to simulate and predict the system's…

Machine Learning · Statistics 2026-05-26 Lifu Wei , Yinuo Ren , Naichen Shi , Yiping Lu

By modeling quantum chaotic dynamics with ensembles of random operators, we explore howmachine learning learning algorithms can be used to detect pseudorandom behavior in qubit systems.We analyze samples consisting of pieces of correlation…

Quantum Physics · Physics 2020-08-27 Daniel W. F. Alves , Michael O. Flynn

Many natural systems exhibit chaotic behaviour such as the weather, hydrology, neuroscience and population dynamics. Although many chaotic systems can be described by relatively simple dynamical equations, characterizing these systems can…

Dynamical Systems · Mathematics 2022-06-15 H. Ribera , S. Shirman , A. V. Nguyen , N. M. Mangan