English
Related papers

Related papers: LO-SDA: Latent Optimization for Score-based Atmosp…

200 papers

Data assimilation combines prior (or background) information with observations to estimate the initial state of a dynamical system over a given time-window. A common application is in numerical weather prediction where a previous forecast…

Optimization and Control · Mathematics 2021-07-27 Coralia Cartis , Maha H. Kaouri , Amos S. Lawless , Nancy K. Nichols

We identify a strong equivalence between neural network based machine learning (ML) methods and the formulation of statistical data assimilation (DA), known to be a problem in statistical physics. DA, as used widely in physical and…

Machine Learning · Computer Science 2017-10-23 H. D. I. Abarbanel , P. J. Rozdeba , S. Shirman

Weather data, comprising multiple variables, poses significant challenges due to its high dimensionality and multimodal nature. Creating low-dimensional embeddings requires compressing this data into a compact, shared latent space. This…

Machine Learning · Computer Science 2026-03-27 Nathan Bailey

The integration of observational data into numerical models, known as data assimilation (DA), is fundamental for making Numerical Weather Prediction (NWP) possible, with breathtaking success over the past 60 years (Bauer et al. 2015).…

Atmospheric and Oceanic Physics · Physics 2024-06-04 Jan D. Keller , Roland Potthast

Precipitation nowcasting is a critical spatio-temporal prediction task for society to prevent severe damage owing to extreme weather events. Despite the advances in this field, the complex and stochastic nature of this task still poses…

Machine Learning · Computer Science 2025-12-25 Shi Quan Foo , Chi-Ho Wong , Zhihan Gao , Dit-Yan Yeung , Ka-Hing Wong , Wai-Kin Wong

Domain adaptation (DA) aims to generalize a learning model across training and testing data despite the mismatch of their data distributions. In light of a theoretical estimation of upper error bound, we argue in this paper that an…

Computer Vision and Pattern Recognition · Computer Science 2018-01-01 Lingkun Luo , Liming Chen , Shiqiang Hu , Ying Lu , Xiaofang Wang

Diffusion-based methods represented as stochastic differential equations on a continuous-time domain have recently proven successful as a non-adversarial generative model. Training such models relies on denoising score matching, which can…

Machine Learning · Computer Science 2024-11-05 Sarthak Mittal , Korbinian Abstreiter , Stefan Bauer , Bernhard Schölkopf , Arash Mehrjou

Data assimilation (DA) integrates observational data with numerical models to improve the prediction of complex physical systems. However, traditional DA methods often struggle with nonlinear dynamics and multi-scale variability,…

Computational Engineering, Finance, and Science · Computer Science 2026-01-29 Hyeonggeun Yun , Quanling Deng

Deep learning-based domain adaptation (DA) methods have shown strong performance by learning transferable representations. However, their reliance on mini-batch training limits global distribution modeling, leading to unstable alignment and…

Machine Learning · Computer Science 2025-11-18 Lingkun Luo , Shiqiang Hu , Liming Chen

Diffusion models excel at generation, but their latent spaces are high dimensional and not explicitly organized for interpretation or control. We introduce ConDA (Contrastive Diffusion Alignment), a plug-and-play geometry layer that applies…

Variational data assimilation is a technique for combining measured data with dynamical models. It is a key component of Earth system state estimation and is commonly used in weather and ocean forecasting. The approach involves a…

Numerical Analysis · Mathematics 2026-04-30 I. Daužickaitė , M. A. Freitag , S. Gürol , A. S. Lawless , A. Ramage , J. A. Scott , J. M. Tabeart

Precipitation nowcasting, predicting future radar echo sequences from current observations, is a critical yet challenging task due to the inherently chaotic and tightly coupled spatio-temporal dynamics of the atmosphere. While recent…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Thao Nguyen , Jiaqi Ma , Fahad Shahbaz Khan , Souhaib Ben Taieb , Salman Khan

Accurate, high-resolution, and real-time DOA estimation is a cornerstone of environmental perception in automotive radar systems. While sparse signal recovery techniques offer super-resolution and high-precision estimation, their…

Signal Processing · Electrical Eng. & Systems 2026-02-19 Longxin Bai , Jingchao Zhang , Liyan Qiao

Data assimilation (DA) is widely used to combine physical knowledge and observations. It is nowadays commonly used in geosciences to perform parametric calibration. In a context of climate change, old calibrations can not necessarily be…

Machine Learning · Statistics 2021-06-23 Rem-Sophia Mouradi , Cédric Goeury , Olivier Thual , Fabrice Zaoui , Pablo Tassi

Deep learning has revolutionized weather forecasting, but many challenges remain, including climate modeling. Moreover, the current landscape remains fragmented: highly specialized models are typically trained individually for distinct…

Machine Learning · Computer Science 2026-05-20 Michael Aich , Andreas Fürst , Florian Sestak , Carlos Ruiz-Gonzalez , Niklas Boers , Johannes Brandstetter

Modeling the risk of extreme weather events in a changing climate is essential for developing effective adaptation and mitigation strategies. Although the available low-resolution climate models capture different scenarios, accurate risk…

Atmospheric and Oceanic Physics · Physics 2022-12-06 Anamitra Saha , Sai Ravela

Diffusion models have demonstrated exceptional capabilities in generating high-fidelity images but typically suffer from inefficient sampling. Many solver designs and noise scheduling strategies have been proposed to dramatically improve…

Machine Learning · Statistics 2025-10-01 Tianrong Chen , Huangjie Zheng , David Berthelot , Jiatao Gu , Josh Susskind , Shuangfei Zhai

Generative modeling of spatio-temporal fields is crucial for a variety of applications, including stochastic weather generators and climate-model surrogates. However, many such fields exhibit complex dependence structures that vary across…

Methodology · Statistics 2026-05-06 Carrie J. Lei-Cramer , Jian Cao , Matthias Katzfuss

Most environmental phenomena, such as wind profiles, ozone concentration and sunlight distribution under a forest canopy, exhibit nonstationary dynamics i.e. phenomenon variation change depending on the location and time of occurrence.…

Machine Learning · Computer Science 2018-04-30 Sahil Garg , Amarjeet Singh , Fabio Ramos

Any well-behaved generative model over a variable $\mathbf{x}$ can be expressed as a deterministic transformation of an exogenous ('outsourced') Gaussian noise variable $\mathbf{z}$: $\mathbf{x}=f_\theta(\mathbf{z})$. In such a model (\eg,…

Machine Learning · Computer Science 2025-05-29 Siddarth Venkatraman , Mohsin Hasan , Minsu Kim , Luca Scimeca , Marcin Sendera , Yoshua Bengio , Glen Berseth , Nikolay Malkin