English
Related papers

Related papers: TorchDA: A Python package for performing data assi…

200 papers

Python has become the de-facto language for training deep neural networks, coupling a large suite of scientific computing libraries with efficient libraries for tensor computation such as PyTorch or TensorFlow. However, when models are used…

Machine Learning · Computer Science 2021-04-02 Zachary DeVito , Jason Ansel , Will Constable , Michael Suo , Ailing Zhang , Kim Hazelwood

Data assimilation (DA) integrates observations with model forecasts to produce optimized atmospheric states, whose physical consistency is critical for stable weather forecasting and reliable climate research. Traditional Bayesian DA…

Atmospheric and Oceanic Physics · Physics 2026-03-05 Hang Fan , Lei Bai , Ben Fei , Yi Xiao , Kun Chen , Yubao Liu , Yongquan Qu , Fenghua Ling , Pierre Gentine

Hyperdimensional computing (HD), also known as vector symbolic architectures (VSA), is a framework for computing with distributed representations by exploiting properties of random high-dimensional vector spaces. The commitment of the…

Ensemble-based data assimilation (DA) methods have become increasingly popular due to their inherent ability to address nonlinear dynamic problems. However, these methods often face a trade-off between analysis accuracy and computational…

Machine Learning · Computer Science 2026-05-26 Zhilin Li , Zhou Yao , Xianglong Li , Zeng Liu , Zhaokuan Lu , Shanlin Xu , Seungnam Kim , Guangyao Wang

Nonlinear/non-Gaussian filtering has broad applications in many areas of life sciences where either the dynamic is nonlinear and/or the probability density function of uncertain state is non-Gaussian. In such problems, the accuracy of the…

Computation · Statistics 2012-08-02 Hatef Monajemi , Peter K. Kitanidis

Practical data assimilation algorithms often contain hyper-parameters, which may arise due to, for instance, the use of certain auxiliary techniques like covariance inflation and localization in an ensemble Kalman filter, the…

Computation · Statistics 2022-06-08 Xiaodong Luo , Chuan-An Xia

In this paper, we introduce a scanner package enhanced by deep learning (DL) techniques. The proposed package addresses two significant challenges associated with previously developed DL-based methods: slow convergence in high-dimensional…

High Energy Physics - Phenomenology · Physics 2024-12-30 A. Hammad , Raymundo Ramos

We introduce a data assimilation strategy aimed at accurately capturing key non-Gaussian structures in probability distributions using a small ensemble size. A major challenge in statistical forecasting of nonlinearly coupled multiscale…

Numerical Analysis · Mathematics 2025-04-01 Di Qi , Jian-Guo Liu

Data assimilation (DA) is a fundamental component of modern weather prediction, yet it remains a major computational bottleneck in machine learning (ML)-based forecasting pipelines due to reliance on traditional variational methods. Recent…

Machine Learning · Computer Science 2026-02-09 Ran Cheng , Lailai Zhu

This paper presents TorchNWP, a compilation library tool for the efficient coupling of artificial intelligence components and traditional numerical models. It aims to address the issues of poor cross-language compatibility, insufficient…

Mathematical Software · Computer Science 2026-03-19 Sa Xiao , Hao Jing , Honglu Sun , Haoyu Li

A hybrid data assimilation algorithm is developed for complex dynamical systems with partial observations. The method starts with applying a spectral decomposition to the entire spatiotemporal fields, followed by creating a machine learning…

Computational Physics · Physics 2022-12-27 Changhong Mou , Leslie M. Smith , Nan Chen

The freud Python package is a powerful library for analyzing simulation data. Written with modern simulation and data analysis workflows in mind, freud provides a Python interface to fast, parallelized C++ routines that run efficiently on…

A thermal convection loop is a annular chamber filled with water, heated on the bottom half and cooled on the top half. With sufficiently large forcing of heat, the direction of fluid flow in the loop oscillates chaotically, dynamics…

Dynamical Systems · Mathematics 2016-06-24 Andrew J. Reagan , Yves Dubief , Peter Sheridan Dodds , Christopher M. Danforth

Over the last few years, with the growth of time-series collecting and storing, there has been a great demand for tools and software for temporal data engineering and modeling. This paper presents a generic workflow for time series data…

Computational Engineering, Finance, and Science · Computer Science 2023-10-24 Pejman Farhadi Ghalati , Andreas Schuppert

PyKoopman is a Python package for the data-driven approximation of the Koopman operator associated with a dynamical system. The Koopman operator is a principled linear embedding of nonlinear dynamics and facilitates the prediction,…

Systems and Control · Electrical Eng. & Systems 2023-06-23 Shaowu Pan , Eurika Kaiser , Brian M. de Silva , J. Nathan Kutz , Steven L. Brunton

Variational data assimilation and machine-learning based super-resolution are two alternative approaches to state estimation in turbulent flows. The former is an optimisation problem featuring a time series of coarse observations, the…

Fluid Dynamics · Physics 2025-10-21 Markus Weyrauch , Moritz Linkmann , Jacob Page

Ensemble data assimilation methods such as the Ensemble Kalman Filter (EnKF) are a key component of probabilistic weather forecasting. They represent the uncertainty in the initial conditions by an ensemble which incorporates information…

Applications · Statistics 2018-10-17 Sylvain Robert , Daniel Leuenberger , Hans R. Künsch

Ensemble methods such as the Ensemble Kalman Filter (EnKF) are widely used for data assimilation in large-scale geophysical applications, as for example in numerical weather prediction (NWP). There is a growing interest for physical models…

Applications · Statistics 2018-08-01 Sylvain Robert , Hans R. Künsch

The analysis of high-dimensional dynamical systems generally requires the integration of simulation data with experimental measurements. Experimental data often has substantial amounts of measurement noise that compromises the ability to…

Numerical Analysis · Mathematics 2019-10-02 Samuel Rudy , Steven Brunton , J. Nathan Kutz

The potential for data-driven applications to scale-resolving simulations of turbulent flows is assessed herein. Multigrid sequential data assimilation algorithms have been used to calibrate solvers for Large Eddy Simulation for the…