English
Related papers

Related papers: Transforming Weather Data from Pixel to Latent Spa…

200 papers

Deep learning has revolutionized weather forecasting, but many challenges remain, including climate modeling. Moreover, the current landscape remains fragmented: highly specialized models are typically trained individually for distinct…

Machine Learning · Computer Science 2026-05-20 Michael Aich , Andreas Fürst , Florian Sestak , Carlos Ruiz-Gonzalez , Niklas Boers , Johannes Brandstetter

Extreme precipitation events, such as violent rainfall and hail storms, routinely ravage economies and livelihoods around the developing world. Climate change further aggravates this issue. Data-driven deep learning approaches could widen…

In this work, we aim to optimize the radio resource management of a communication system between a remote controller and its device, whose state is represented through image frames, without compromising the performance of the control task.…

Machine Learning · Computer Science 2025-06-23 Charbel Bou Chaaya , Abanoub M. Girgis , Mehdi Bennis

Electricity is difficult to store, except at prohibitive cost, and therefore the balance between generation and load must be maintained at all times. Electricity is traditionally managed by anticipating demand and intermittent production…

Machine Learning · Computer Science 2024-09-26 Julie Keisler , Margaux Bregere

In the realm of deploying Machine Learning-based Advanced Driver Assistance Systems (ML-ADAS) into real-world scenarios, adverse weather conditions pose a significant challenge. Conventional ML models trained on clear weather data falter…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Muhammad Zaeem Shahzad , Muhammad Abdullah Hanif , Muhammad Shafique

Real-world weather conditions are intricate and often occur concurrently. However, most existing restoration approaches are limited in their applicability to specific weather conditions in training data and struggle to generalize to unseen…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Youngrae Kim , Younggeol Cho , Thanh-Tung Nguyen , Seunghoon Hong , Dongman Lee

Vision-Language-Action (VLA) models have emerged as a powerful paradigm in Embodied AI. However, the significant computational overhead of processing redundant visual tokens remains a critical bottleneck for real-time robotic deployment.…

Robotics · Computer Science 2025-11-25 Juntao Gao , Feiyang Ye , Jing Zhang , Wenjing Qian

Planning is a powerful approach to reinforcement learning with several desirable properties. However, it requires a model of the world, which is not readily available in many real-life problems. In this paper, we propose to learn a world…

Machine Learning · Computer Science 2020-11-24 Thor V. A. N. Olesen , Dennis T. T. Nguyen , Rasmus Berg Palm , Sebastian Risi

We introduce Latent-WAM, an efficient end-to-end autonomous driving framework that achieves strong trajectory planning through spatially-aware and dynamics-informed latent world representations. Existing world-model-based planners suffer…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Linbo Wang , Yupeng Zheng , Qiang Chen , Shiwei Li , Yichen Zhang , Zebin Xing , Qichao Zhang , Xiang Li , Deheng Qian , Pengxuan Yang , Yihang Dong , Ce Hao , Xiaoqing Ye , Junyu han , Yifeng Pan , Dongbin Zhao

The spatial and temporal distribution of precipitation has a significant impact on human lives by determining freshwater resources and agricultural yield, but also rainfall-driven hazards like flooding or landslides. While the ERA5…

Atmospheric and Oceanic Physics · Physics 2025-06-23 Luca Glawion , Julius Polz , Harald Kunstmann , Benjamin Fersch , Christian Chwala

This paper describes an adaptation of the Optimal Localized Averaging (OLA) inversion technique, originally developed for geo- and helioseismological applications, to the interpretation of solar spectroscopic data. It focuses on inverting…

Solar and Stellar Astrophysics · Physics 2023-02-27 Piyush Agrawal , Mark P. Rast , Basilio Ruiz Cobo

Accurate LiDAR simulation is crucial for autonomous driving, especially under adverse weather conditions. Existing methods struggle to capture the complex interactions between LiDAR signals and atmospheric phenomena, leading to unrealistic…

Robotics · Computer Science 2026-04-03 Vivek Anand , Bharat Lohani , Rakesh Mishra , Gaurav Pandey

All-weather image restoration (AWIR) is crucial for reliable autonomous navigation under adverse weather conditions. AWIR models are trained to address a specific set of weather conditions such as fog, rain, and snow. But this causes them…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Sudarshan Rajagopalan , Vishal M. Patel

We present a data-driven approach for forecasting global weather using graph neural networks. The system learns to step forward the current 3D atmospheric state by six hours, and multiple steps are chained together to produce skillful…

Atmospheric and Oceanic Physics · Physics 2022-02-16 Ryan Keisler

To advance automated detection of extreme weather events, which are increasing in frequency and intensity with climate change, we explore modifications to a novel light-weight Context Guided convolutional neural network architecture trained…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Romain Lacombe , Hannah Grossman , Lucas Hendren , David Lüdeke

The recent revolution in data-driven methods for weather forecasting has lead to a fragmented landscape of complex, bespoke architectures and training strategies, obscuring the fundamental drivers of forecast accuracy. Here, we demonstrate…

Weather forecasting is a long-standing computational challenge with direct societal and economic impacts. This task involves a large amount of continuous data collection and exhibits rich spatiotemporal dependencies over long periods,…

Machine Learning · Computer Science 2023-12-18 Xin Man , Chenghong Zhang , Jin Feng , Changyu Li , Jie Shao

End-to-end (E2E) autonomous driving has recently attracted increasing interest in unifying Vision-Language-Action (VLA) with World Models to enhance decision-making and forward-looking imagination. However, existing methods fail to…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Feiyang jia , Lin Liu , Ziying Song , Caiyan Jia , Hangjun Ye , Xiaoshuai Hao , Long Chen

In autonomous driving, end-to-end planners directly utilize raw sensor data, enabling them to extract richer scene features and reduce information loss compared to traditional planners. This raises a crucial research question: how can we…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Yingyan Li , Lue Fan , Jiawei He , Yuqi Wang , Yuntao Chen , Zhaoxiang Zhang , Tieniu Tan

Accurate residential load forecasting is critical for power system reliability with rising renewable integration and demand-side flexibility. However, most statistical and machine learning models treat external factors, such as weather,…

Machine Learning · Computer Science 2025-07-01 Haoran Li , Muhao Guo , Marija Ilic , Yang Weng , Guangchun Ruan