English
Related papers

Related papers: Transforming Weather Data from Pixel to Latent Spa…

200 papers

To manage the complexity of transformers in video compression, local attention mechanisms are a practical necessity. The common approach of partitioning frames into patches, however, creates architectural flaws like irregular receptive…

Image and Video Processing · Electrical Eng. & Systems 2025-10-07 Alexander Kopte , André Kaup

Deep learning models have gained popularity in climate science, following their success in computer vision and other domains. For instance, researchers are increasingly employing deep learning techniques for downscaling climate data,…

Machine Learning · Computer Science 2023-06-21 Xingying Huang

The manifold hypothesis states that high-dimensional data can be modeled as lying on or near a low-dimensional, nonlinear manifold. Variational Autoencoders (VAEs) approximate this manifold by learning mappings from low-dimensional latent…

Machine Learning · Statistics 2021-03-03 Marissa C. Connor , Gregory H. Canal , Christopher J. Rozell

Estimating background-error covariances remains a core challenge in variational data assimilation (DA). Operational systems typically approximate these covariances by transformations that separate geostrophically balanced components from…

Atmospheric and Oceanic Physics · Physics 2026-01-21 Boštjan Melinc , Uroš Perkan , Žiga Zaplotnik

Deep-learning (DL) weather prediction models offer some notable advantages over traditional physics-based models, including auto-differentiability and low computational cost, enabling detailed diagnostics of forecast errors. Using our…

Atmospheric and Oceanic Physics · Physics 2025-07-23 Uros Perkan , Ziga Zaplotnik , Gregor Skok

Accurate probabilistic weather forecasting demands both high accuracy and efficient uncertainty quantification, challenges that overburden both ensemble numerical weather prediction (NWP) and recent machine-learning methods. We introduce…

Machine Learning · Computer Science 2025-06-12 Yilin Zhuang , Karthik Duraisamy

Large language models (LLMs) demonstrate strong task-specific capabilities through fine-tuning, but merging multiple fine-tuned models often leads to degraded performance due to overlapping instruction-following components. Task Arithmetic…

Computation and Language · Computer Science 2025-02-28 Yan-Lun Chen , Yi-Ru Wei , Chia-Yi Hsu , Chia-Mu Yu , Chun-Ying Huang , Ying-Dar Lin , Yu-Sung Wu , Wei-Bin Lee

This paper introduces WARLearn, a novel framework designed for adaptive representation learning in challenging and adversarial weather conditions. Leveraging the in-variance principal used in Barlow Twins, we demonstrate the capability to…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Shubham Agarwal , Raz Birman , Ofer Hadar

The evolution of Vision Transformers has led to their widespread adaptation to different domains. Despite large-scale success, there remain significant challenges including their reliance on extensive computational and memory resources for…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Suyash Gaurav , Muhammad Farhan Humayun , Jukka Heikkonen , Jatin Chaudhary

Modeling weather and climate is an essential endeavor to understand the near- and long-term impacts of climate change, as well as inform technology and policymaking for adaptation and mitigation efforts. In recent years, there has been a…

Machine Learning · Computer Science 2023-07-06 Tung Nguyen , Jason Jewik , Hritik Bansal , Prakhar Sharma , Aditya Grover

Real-world deployment often exposes models to distribution shifts, making test-time adaptation (TTA) critical for robustness. Yet most TTA methods are unfriendly to edge deployment, as they rely on backpropagation, activation buffering, or…

Machine Learning · Computer Science 2026-05-08 Xinyu Luo , Jie Liu , Kecheng Chen , Junyi Yang , Bo Ding , Arindam Basu , Haoliang Li

Bearing data compression is vital to manage the large volumes of data generated during condition monitoring. In this paper, a novel asymmetrical autoencoder with a lifting wavelet transform (LWT) layer is developed to compress bearing…

Signal Processing · Electrical Eng. & Systems 2025-01-22 Xin Zhu , Ahmet Enis Cetin

As the role played by statistical and computational sciences in climate and environmental modelling and prediction becomes more important, Machine Learning researchers are becoming more aware of the relevance of their work to help tackle…

Machine Learning · Statistics 2020-12-23 Federico Amato , Fabian Guignard , Sylvain Robert , Mikhail Kanevski

This work is motivated by the problem of predicting downward solar radiation flux spherical maps from the observation of atmospheric pressure at high cloud bottom. To this aim nonlinear functional regression is implemented under…

Methodology · Statistics 2025-02-17 Diana P. Ovalle-Muñoz , M. Dolores Ruiz-Medina

Advances in data assimilation (DA) methods have greatly improved the accuracy of Earth system predictions. To fuse multi-source data and reconstruct the nonlinear evolution missing from observations, geoscientists are developing…

Atmospheric and Oceanic Physics · Physics 2024-12-19 Qingyu Zheng , Guijun Han , Wei Li , Lige Cao , Gongfu Zhou , Haowen Wu , Qi Shao , Ru Wang , Xiaobo Wu , Xudong Cui , Hong Li , Xuan Wang

Computer simulations have become a popular tool of assessing complex skills such as problem-solving skills. Log files of computer-based items record the entire human-computer interactive processes for each respondent. The response processes…

Machine Learning · Statistics 2019-08-19 Xueying Tang , Zhi Wang , Jingchen Liu , Zhiliang Ying

An autoencoder is a neural network which data projects to and from a lower dimensional latent space, where this data is easier to understand and model. The autoencoder consists of two sub-networks, the encoder and the decoder, which carry…

Computer Vision and Pattern Recognition · Computer Science 2019-04-03 Saïd Ladjal , Alasdair Newson , Chi-Hieu Pham

Global data assimilation enables weather forecasting at all scales and provides valuable data for studying the Earth system. However, the computational demands of physics-based algorithms used in operational systems limits the volume and…

Machine Learning · Computer Science 2024-07-17 Thomas J. Vandal , Kate Duffy , Daniel McDuff , Yoni Nachmany , Chris Hartshorn

Data-driven approaches, most prominently deep learning, have become powerful tools for prediction in many domains. A natural question to ask is whether data-driven methods could also be used to predict global weather patterns days in…

Atmospheric and Oceanic Physics · Physics 2020-12-30 Stephan Rasp , Peter D. Dueben , Sebastian Scher , Jonathan A. Weyn , Soukayna Mouatadid , Nils Thuerey

Video prediction yields future frames by employing the historical frames and has exhibited its great potential in many applications, e.g., meteorological prediction, and autonomous driving. Previous works often decode the ultimate…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Ping Li , Chenhan Zhang , Zheng Yang , Xianghua Xu , Mingli Song