English
Related papers

Related papers: Transforming Weather Data from Pixel to Latent Spa…

200 papers

Accurate weather and climate modeling is critical for both scientific advancement and safeguarding communities against environmental risks. Traditional approaches rely heavily on Numerical Weather Prediction (NWP) models, which simulate…

Machine Learning · Computer Science 2024-09-13 Muhammad Akhtar Munir , Fahad Shahbaz Khan , Salman Khan

This work describes a novel data-driven latent space inference framework built on paired autoencoders to handle observational inconsistencies when solving inverse problems. Our approach uses two autoencoders, one for the parameter space and…

Machine Learning · Computer Science 2026-01-19 Emma Hart , Bas Peters , Julianne Chung , Matthias Chung

The generation of initial conditions via accurate data assimilation is crucial for weather forecasting and climate modeling. We propose DiffDA as a denoising diffusion model capable of assimilating atmospheric variables using predicted…

Computational Engineering, Finance, and Science · Computer Science 2024-06-11 Langwen Huang , Lukas Gianinazzi , Yuejiang Yu , Peter D. Dueben , Torsten Hoefler

The success of deep learning techniques over the last decades has opened up a new avenue of research for weather forecasting. Here, we take the novel approach of using a neural network to predict full probability density functions at each…

Machine Learning · Statistics 2022-01-05 Mariana Clare , Omar Jamil , Cyril Morcrette

As Large Language Models (LLMs) scale to handle massive concurrent traffic, optimizing the infrastructure required for inference has become a primary challenge. To manage the high cost of GPU resources while ensuring strict service-level…

High-dimensional, heterogeneous data with complex feature interactions pose significant challenges for traditional predictive modeling approaches. While Projection to Latent Structures (PLS) remains a popular technique, it struggles to…

Machine Learning · Computer Science 2025-10-21 Farwa Abbas , Hussain Ahmad , Claudia Szabo

Due to climate change, heatwaves are becoming more frequent and intense, with western Europe experiencing the strongest trends in the Northern Hemisphere mid-latitudes. Part of the temperature trends are caused by circulation changes, which…

Atmospheric and Oceanic Physics · Physics 2025-12-22 Tamara Happé , Jasper Wijnands , Paolo Scussolini , Peter Pfleiderer , Dim Coumou

Accurately modeling and controlling vehicle exhaust emissions during transient events, such as rapid acceleration, is critical for meeting environmental regulations and optimizing powertrains. Conventional data-driven methods, such as…

Systems and Control · Electrical Eng. & Systems 2026-01-28 Ganesh Sundaram , Tobias Gehra , Jonas Ulmen , Mirjan Heubaum , Daniel Görges , Michael Günthner

Data-driven reduced-order models based on autoencoders generally lack interpretability compared to classical methods such as the proper orthogonal decomposition. More interpretability can be gained by disentangling the latent variables and…

Machine Learning · Computer Science 2025-02-21 Henning Schwarz , Pyei Phyo Lin , Jens-Peter M. Zemke , Thomas Rung

We explore the use of deep neural networks for nonlinear dimensionality reduction in climate applications. We train convolutional autoencoders (CAEs) to encode two temperature field datasets from pre-industrial control runs in the CMIP5…

Atmospheric and Oceanic Physics · Physics 2018-09-06 J. A. Saenz , N. Lubbers , N. M. Urban

Large climate-model ensembles are computationally expensive; yet many downstream analyses would benefit from additional, statistically consistent realizations of spatiotemporal climate variables. We study a generative modeling approach for…

Machine Learning · Computer Science 2026-01-06 Jacquelyn Shelton , Przemyslaw Polewski , Alexander Robel , Matthew Hoffman , Stephen Price

The rapid rise of deep learning (DL) in numerical weather prediction (NWP) has led to a proliferation of models which forecast atmospheric variables with comparable or superior skill than traditional physics-based NWP. However, among these…

Emerging generative world models and vision-language-action (VLA) systems are rapidly reshaping automated driving by enabling scalable simulation, long-horizon forecasting, and capability-rich decision making. Across these directions,…

Robotics · Computer Science 2026-03-11 Rongxiang Zeng , Yongqi Dong

Deep learning-based, data-driven models are gaining prevalence in climate research, particularly for global weather prediction. However, training the global weather data at high resolution requires massive computational resources.…

Machine Learning · Computer Science 2024-03-19 Minjong Cheon , Yo-Hwan Choi , Seon-Yu Kang , Yumi Choi , Jeong-Gil Lee , Daehyun Kang

Large language models (LLMs) face significant challenges in processing long contexts due to the linear growth of the key-value (KV) cache and quadratic complexity of self-attention. Existing approaches address these bottlenecks separately:…

Computation and Language · Computer Science 2026-04-17 Zeng You , Yaofo Chen , Qiuwu Chen , Ying Sun , Shuhai Zhang , Yingjian Li , Yaowei Wang , Mingkui Tan

Data assimilation (DA) combines model forecasts and observations to estimate the optimal state of the atmosphere with its uncertainty, providing initial conditions for weather prediction and reanalyses for climate research. Yet, existing…

Machine Learning · Computer Science 2026-03-05 Hang Fan , Juan Nathaniel , Yi Xiao , Ce Bian , Fenghua Ling , Ben Fei , Lei Bai , Pierre Gentine

Accurate assessments of extreme weather events are vital for research and policy, yet localized and granular data remain scarce in many parts of the world. This data gap limits our ability to analyze potential outcomes and implications of…

Computation and Language · Computer Science 2025-04-29 Deeksha Varshney , Keane Ong , Rui Mao , Erik Cambria , Gianmarco Mengaldo

Weather forecasting is fundamentally challenged by the chaotic nature of the atmosphere, necessitating probabilistic approaches to quantify uncertainty. While traditional ensemble prediction (EPS) addresses this through computationally…

Machine Learning · Computer Science 2025-11-19 Xinlei Xiong , Wenbo Hu , Shuxun Zhou , Kaifeng Bi , Lingxi Xie , Ying Liu , Richang Hong , Qi Tian

Detectors in next-generation high-energy physics experiments face several daunting requirements, such as high data rates, damaging radiation exposure, and stringent constraints on power, space, and latency. To address these challenges,…

Data Analysis, Statistics and Probability · Physics 2025-08-18 Alexander Yue , Haoyi Jia , Julia Gonski

The past several years have witnessed Variational Auto-Encoder's superiority in various text generation tasks. However, due to the sequential nature of the text, auto-regressive decoders tend to ignore latent variables and then reduce to…

Computation and Language · Computer Science 2022-10-24 Jinyi Hu , Xiaoyuan Yi , Wenhao Li , Maosong Sun , Xing Xie