English
Related papers

Related papers: An elastic framework for ensemble-based large-scal…

200 papers

Accurate data assimilation (DA) for systems with piecewise-smooth or discontinuous state variables remains a significant challenge, as conventional covariance-based ensemble Kalman filter approaches often fail to effectively balance…

Numerical Analysis · Mathematics 2025-10-09 Tongtong Li , Anne Gelb , Yoonsang Lee

Data assimilation (DA) addresses the problem of sequentially estimating the state of a dynamical system from noisy and incomplete observations. In this work, we employ a diffusion model as a world model to simulate and predict the system's…

Machine Learning · Statistics 2026-05-26 Lifu Wei , Yinuo Ren , Naichen Shi , Yiping Lu

We apply two data assimilation (DA) methods, a smoother and a filter, and a model-free machine learning (ML) shallow network to forecast two weakly turbulent systems. We analyse the effect of the spatial sparsity of observations on accuracy…

Fluid Dynamics · Physics 2024-07-16 Vikrant Gupta , Yuanqing Chen , Minping Wan

Data assimilation (DA) methods combine model predictions with observational data to improve state estimation in dynamical systems, inspiring their increasingly prominent role in geophysical and climate applications. Classical DA methods…

Numerical Analysis · Mathematics 2025-10-23 Lizuo Liu , Tongtong Li , Anne Gelb

This paper introduces a data assimilation (DA) framework based on the extended Kalman filter-cell transmission model, designed to assist jam-absorption driving (JAD) operation to alleviate sag traffic congestion. To ascertain and…

Systems and Control · Electrical Eng. & Systems 2024-09-09 Siyu Li , Ryosuke Nishi , Daichi Yanagisawa , Katsuhiro Nishinari

The need for accurate and fast scale-resolving simulations of fluid flows, where turbulent dispersion is a crucial physical feature, is evident. Large-eddy simulations (LES) are computationally more affordable than direct numerical…

Fluid Dynamics · Physics 2025-12-30 Justin Plogmann , Oliver Brenner , Patrick Jenny

A non-intrusive data assimilation methodology is developed to improve the statistical predictions of large-eddy simulations (LES). The ensemble-variational (EnVar) approach aims to minimize a cost function that is defined as the discrepancy…

Fluid Dynamics · Physics 2021-09-28 Vincent Mons , Yifan Du , Tamer A. Zaki

Data assimilation (DA) combines model forecasts and observations to estimate the optimal state of the atmosphere with its uncertainty, providing initial conditions for weather prediction and reanalyses for climate research. Yet, existing…

Machine Learning · Computer Science 2026-03-05 Hang Fan , Juan Nathaniel , Yi Xiao , Ce Bian , Fenghua Ling , Ben Fei , Lei Bai , Pierre Gentine

Despite advances in test-time scaling and diffusion finetuning, guidance for Auto-Regressive Diffusion Models (ARDMs) remains underexplored. We introduce an amortized framework that augments a pretrained ARDM with an offline-trained…

Machine Learning · Computer Science 2026-05-12 Prakhar Srivastava , Farrin Marouf Sofian , Francesco Immorlano , Kushagra Pandey , Stephan Mandt

Ensemble-based data assimilation (DA) methods have become increasingly popular due to their inherent ability to address nonlinear dynamic problems. However, these methods often face a trade-off between analysis accuracy and computational…

Machine Learning · Computer Science 2026-05-26 Zhilin Li , Zhou Yao , Xianglong Li , Zeng Liu , Zhaokuan Lu , Shanlin Xu , Seungnam Kim , Guangyao Wang

A method of data assimilation (DA) is employed to estimate electrophysiological parameters of neurons simultaneously with their synaptic connectivity in a small model biological network. The DA procedure is cast as an optimization, with a…

Neurons and Cognition · Quantitative Biology 2020-02-05 Eve Armstrong

Using a very cheap Data Assimilation (DA) method, I show an alternative approach to classical DA for numerical climate models which produce a large amount of "big data". The problematic features of state-of-the-art high resolution Regional…

Applications · Statistics 2016-10-12 Bijan Fallah

Data Assimilation (DA) plays a critical role in atmospheric science by reconstructing spatially continous estimates of the system state, which serves as initial conditions for scientific analysis. While recent advances in diffusion models…

Machine Learning · Computer Science 2025-05-20 Hao Wang , Jindong Han , Wei Fan , Weijia Zhang , Hao Liu

Data assimilation (DA) methods use priors arising from differential equations to robustly interpolate and extrapolate data. Popular techniques such as ensemble methods that handle high-dimensional, nonlinear PDE priors focus mostly on state…

Machine Learning · Statistics 2024-06-05 Rafael Anderka , Marc Peter Deisenroth , So Takao

Training large language models (LLMs) at the network edge faces fundamental challenges arising from device resource constraints, severe data heterogeneity, and heightened privacy risks. To address these challenges, we propose ELSA…

Machine Learning · Computer Science 2026-03-10 Xiaohong Yang , Tong Xie , Minghui Liwang , Chikai Shang , Yang Lu , Zhenzhen Jiao , Liqun Fu , Seyyedali Hosseinalipour

Data assimilation (DA) integrates observational information with model predictions to improve state estimation in complex systems. While filtering provides the basis for online forecasts by using only past and present observations, it can…

Numerical Analysis · Mathematics 2026-05-05 Zhang Jiang , Marios Andreou , Sebastian Reich , Nan Chen

Recent researches on unsupervised domain adaptation (UDA) have demonstrated that end-to-end ensemble learning frameworks serve as a compelling option for UDA tasks. Nevertheless, these end-to-end ensemble learning methods often lack…

Computer Vision and Pattern Recognition · Computer Science 2021-04-30 Chen-Hao Chao , Bo-Wun Cheng , Chun-Yi Lee

Existing large language models (LLMs) that mainly focus on Standard American English (SAE) often lead to significantly worse performance when being applied to other English dialects. While existing mitigations tackle discrepancies for…

Computation and Language · Computer Science 2023-12-07 Yanchen Liu , William Held , Diyi Yang

Ensemble Machine Learning (EML) techniques, especially stacking, have been shown to improve predictive performance by combining multiple base models. However, they are often criticized for their lack of interpretability. In this paper, we…

Machine Learning · Computer Science 2025-09-16 Moncef Garouani , Ayah Barhrhouj , Olivier Teste

The classical approach for quantiles computation requires availability of the full sample before ranking it. In uncertainty quantification of numerical simulation models, this approach is not suitable at exascale as large ensembles of…

Statistics Theory · Mathematics 2019-05-13 Alejandro Ribes , Théophile Terraz , Bertrand Iooss , Yvan Fournier , Bruno Raffin