English
Related papers

Related papers: Data assimilation for energy-aware hybrid models

200 papers

Data assimilation of observational data into full atmospheric states is essential for weather forecast model initialization. Recently, methods for deep generative data assimilation have been proposed which allow for using new input data…

Data assimilation (DA) methods combine model predictions with observational data to improve state estimation in dynamical systems, inspiring their increasingly prominent role in geophysical and climate applications. Classical DA methods…

Numerical Analysis · Mathematics 2025-10-23 Lizuo Liu , Tongtong Li , Anne Gelb

Current state-of-the-art generative models map noise to data distributions by matching flows or scores. A key limitation of these models is their inability to readily integrate available partial observations and additional priors. In…

A large-scale, general-purpose data assimilation (DA) platform for materials modeling, douka, was developed and applied to nonlinear materials models. The platform demonstrated its effectiveness in estimating physical properties that cannot…

Materials Science · Physics 2025-04-16 Aoi Watanabe , Ryuhei Sato , Ikuya Kinefuchi , Yasushi Shibuta

We propose a novel hybrid quantum-classical framework that integrates the Quantum Approximate Optimization Algorithm (QAOA) and Quantum-enhanced Markov Chain Monte Carlo (QMCMC) with variational particle filters to tackle the computational…

Quantum Physics · Physics 2025-04-29 Abhiram Sripat

Accurate estimation and forecasting of energy consumption are important for power-system operation, planning, and demand-side management. In practice, however, complete and timely measurements may not always be available, and the observed…

Machine Learning · Computer Science 2026-05-29 Ruoyu Hu , Dahai Yu , Feng Bao , Guang Wang , Guannan Zhang

The generation of initial conditions via accurate data assimilation is crucial for weather forecasting and climate modeling. We propose DiffDA as a denoising diffusion model capable of assimilating atmospheric variables using predicted…

Computational Engineering, Finance, and Science · Computer Science 2024-06-11 Langwen Huang , Lukas Gianinazzi , Yuejiang Yu , Peter D. Dueben , Torsten Hoefler

In atmospheric and turbulent flow modeling, Large Eddy Simulation (LES) is often used to reduce computational cost, while observational data typically originates from the underlying physical system. Motivated by this setting, we study a…

Analysis of PDEs · Mathematics 2025-08-12 Adam Larios , Ali Pakzad , Nicholas White

Data assimilation is an iterative approach to the problem of estimating the state of a dynamical system using both current and past observations of the system together with a model for the system's time evolution. Rather than solving the…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Brian R. Hunt , Eric J. Kostelich , Istvan Szunyogh

Despite advances in test-time scaling and diffusion finetuning, guidance for Auto-Regressive Diffusion Models (ARDMs) remains underexplored. We introduce an amortized framework that augments a pretrained ARDM with an offline-trained…

Machine Learning · Computer Science 2026-05-12 Prakhar Srivastava , Farrin Marouf Sofian , Francesco Immorlano , Kushagra Pandey , Stephan Mandt

In recent years, the convergence of data-driven machine learning models with Data Assimilation (DA) offers a promising avenue for enhancing weather forecasting. This study delves into this emerging trend, presenting our methodologies and…

Atmospheric and Oceanic Physics · Physics 2024-01-17 Wenqi Wang , Jacob Bieker , Rossella Arcucci , César Quilodrán-Casas

This paper introduces a data assimilation (DA) framework based on the extended Kalman filter-cell transmission model, designed to assist jam-absorption driving (JAD) operation to alleviate sag traffic congestion. To ascertain and…

Systems and Control · Electrical Eng. & Systems 2024-09-09 Siyu Li , Ryosuke Nishi , Daichi Yanagisawa , Katsuhiro Nishinari

Data assimilation provides a systematic framework for combining dynamical models with partial and noisy observations to infer the evolving state of a system. In this work, we undertake a comparative study of Data Assimilation with Transfer…

Computational Engineering, Finance, and Science · Computer Science 2026-05-07 Emanuele Donno , Giovanni Conti , Paolo Oddo , Silvio Gualdi , Luca Mainetti , Giovanni Aloisio

Shallow water equations are extensively considered in the domains of oceans, atmospheric modelling, and engineering research (Franca et al., 2022), which play significant roles in floods and tsunami governance. Nonetheless, the accurate…

Fluid Dynamics · Physics 2023-09-22 Ruijia Yu

Data assimilation (DA) is a cornerstone of scientific and engineering applications, combining model forecasts with sparse and noisy observations to estimate latent system states. Classical high-dimensional DA methods, such as the ensemble…

Machine Learning · Statistics 2026-05-28 Martin Andrae , Erik Wikingsson , So Takao , Tomas Landelius , Fredrik Lindsten

The requirements of modern sensing are rapidly evolving, driven by increasing demands for data efficiency, real-time processing, and deployment under limited sensing coverage. Complex physical systems are often characterized through the…

Machine Learning · Computer Science 2025-12-02 Yuxuan Bao , J. Nathan Kutz

The forecasting skill of numerical weather prediction (NWP) models critically depends on the accurate initial conditions, also known as analysis, provided by data assimilation (DA). Traditional DA methods often face a trade-off between…

Atmospheric and Oceanic Physics · Physics 2024-11-28 Yanfei Xiang , Weixin Jin , Haiyu Dong , Mingliang Bai , Zuliang Fang , Pengcheng Zhao , Hongyu Sun , Kit Thambiratnam , Qi Zhang , Xiaomeng Huang

Advances in data assimilation (DA) methods have greatly improved the accuracy of Earth system predictions. To fuse multi-source data and reconstruct the nonlinear evolution missing from observations, geoscientists are developing…

Atmospheric and Oceanic Physics · Physics 2024-12-19 Qingyu Zheng , Guijun Han , Wei Li , Lige Cao , Gongfu Zhou , Haowen Wu , Qi Shao , Ru Wang , Xiaobo Wu , Xudong Cui , Hong Li , Xuan Wang

``Online" data assimilation (DA) is used to generate a new seasonal-resolution reanalysis dataset over the last millennium by combining forecasts from an ocean--atmosphere--sea-ice coupled linear inverse model with climate proxy records.…

Atmospheric and Oceanic Physics · Physics 2025-01-27 Zilu Meng , Gregory J. Hakim , Eric J. Steig

There is growing interest in data-driven weather prediction (DDWP), for example using convolutional neural networks such as U-NETs that are trained on data from models or reanalysis. Here, we propose 3 components to integrate with commonly…

Atmospheric and Oceanic Physics · Physics 2025-07-04 Ashesh Chattopadhyay , Mustafa Mustafa , Pedram Hassanzadeh , Eviatar Bach , Karthik Kashinath