English
Related papers

Related papers: Transforming Weather Data from Pixel to Latent Spa…

200 papers

We develop multiple Deep Learning (DL) models that advance the state-of-the-art predictions of the global auroral particle precipitation. We use observations from low Earth orbiting spacecraft of the electron energy flux to develop a model…

Machine Learning · Computer Science 2021-12-01 Jack Ziegler , Ryan M. Mcgranaghan

As artificial intelligence (AI) continues to rapidly evolve, the realm of Earth and atmospheric sciences is increasingly adopting data-driven models, powered by progressive developments in deep learning (DL). Specifically, DL techniques are…

Machine Learning · Computer Science 2023-12-07 Shengchao Chen , Guodong Long , Jing Jiang , Dikai Liu , Chengqi Zhang

Latent actions serve as an intermediate representation that enables consistent modeling of vision-language-action (VLA) models across heterogeneous datasets. However, approaches to supervising VLAs with latent actions are fragmented and…

Robotics · Computer Science 2026-05-07 Yihan Lin , Haoyang Li , Yang Li , Haitao Shen , Yihan Zhao , Chao Shao , Jing Zhang

Autonomous driving systems require a comprehensive understanding of the environment, achieved by extracting visual features essential for perception, planning, and control. However, models trained solely on single-task objectives or generic…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Huy-Dung Nguyen , Anass Bairouk , Mirjana Maras , Wei Xiao , Tsun-Hsuan Wang , Patrick Chareyre , Ramin Hasani , Marc Blanchon , Daniela Rus

HRA (Human Reliability Analysis) data is crucial for advancing HRA methodologies. however, existing data collection methods lack the necessary granularity, and most approaches fail to capture dynamic features. Additionally, many methods…

Artificial Intelligence · Computer Science 2025-02-04 Xingyu Xiao , Peng Chen , Qianqian Jia , Jiejuan Tong , Jingang Liang , Haitao Wang

We present a parsimonious deep learning weather prediction model to forecast seven atmospheric variables with 3-h time resolution for up to one-year lead times on a 110-km global mesh using the Hierarchical Equal Area isoLatitude…

High-quality machine learning (ML)-ready datasets play a foundational role in developing new artificial intelligence (AI) models or fine-tuning existing models for scientific applications such as weather and climate analysis. Unfortunately,…

The performance of state-of-the-art object detectors degrades significantly under adverse weather, causing a safety-critical domain shift problem for autonomous vehicles. Recent efforts address this problem by relying on synthetic data to…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Hamed Khatounabadi , Xiaohu Lu , Hayder Radha

Modern generative models are usually designed to match target distributions directly in the data space, where the intrinsic dimension of data can be much lower than the ambient dimension. We argue that this discrepancy may contribute to the…

Machine Learning · Computer Science 2020-07-02 Zijun Zhang , Ruixiang Zhang , Zongpeng Li , Yoshua Bengio , Liam Paull

Across various research domains, remotely-sensed weather products are valuable for answering many scientific questions; however, their temporal and spatial resolutions are often too coarse to answer many questions. For instance, in wildlife…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-02 Enis Berk Çoban , Megan Perra , Michael I. Mandel

Vision-Language-Action models (VLAs) are emerging as powerful tools for learning generalizable visuomotor control policies. However, current VLAs are mostly trained on large-scale image-text-action data and remain limited in two key ways:…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Wenqi Liang , Gan Sun , Yao He , Jiahua Dong , Suyan Dai , Ivan Laptev , Salman Khan , Yang Cong

Kilometer-scale Earth system models are essential for capturing local climate change. However, these models are computationally expensive and produce petabyte-scale outputs, which limits their utility for applications such as probabilistic…

Machine Learning · Computer Science 2026-01-22 Johannes Meuer , Maximilian Witte , Étiénne Plésiat , Thomas Ludwig , Christopher Kadow

With generative models producing high quality images that are indistinguishable from real ones, there is growing concern regarding the malicious usage of AI-generated images. Imperceptible image watermarking is one viable solution towards…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Ahmad Rezaei , Mohammad Akbari , Saeed Ranjbar Alvar , Arezou Fatemi , Yong Zhang

Most state-of-the-art approaches for weather and climate modeling are based on physics-informed numerical models of the atmosphere. These approaches aim to model the non-linear dynamics and complex interactions between multiple variables,…

Machine Learning · Computer Science 2023-12-19 Tung Nguyen , Johannes Brandstetter , Ashish Kapoor , Jayesh K. Gupta , Aditya Grover

The world is moving towards clean and renewable energy sources, such as wind energy, in an attempt to reduce greenhouse gas emissions that contribute to global warming. To enhance the analysis and storage of wind data, we introduce a deep…

Machine Learning · Computer Science 2024-11-07 Alif Bin Abdul Qayyum , Xihaier Luo , Nathan M. Urban , Xiaoning Qian , Byung-Jun Yoon

The increasing frequency of extreme weather events due to global climate change urges accurate weather prediction. Recently, great advances have been made by the \textbf{end-to-end methods}, thanks to deep learning techniques, but they face…

Machine Learning · Computer Science 2025-07-24 Shaohan Li , Hao Yang , Min Chen , Xiaolin Qin

Pixel diffusion models have recently regained attention for visual generation. However, training advanced pixel-space models from scratch demands prohibitive computational and data resources. To address this, we propose the Latent-to-Pixel…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Zhennan Chen , Junwei Zhu , Xu Chen , Jiangning Zhang , Jiawei Chen , Zhuoqi Zeng , Wei Zhang , Chengjie Wang , Jian Yang , Ying Tai

Efficient querying and retrieval of healthcare data is posing a critical challenge today with numerous connected devices continuously generating petabytes of images, text, and internet of things (IoT) sensor data. One approach to…

Machine Learning · Computer Science 2023-02-28 Sazia Mahfuz , Farhana Zulkernine

Image restoration under adverse weather conditions (e.g., rain, snow and haze) is a fundamental computer vision problem and has important indications for various downstream applications. Different from early methods that are specially…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Zhentao Tan , Yue Wu , Qiankun Liu , Qi Chu , Le Lu , Jieping Ye , Nenghai Yu

There is an urgent need to build models to tackle Indoor Air Quality issue. Since the model should be accurate and fast, Reduced Order Modelling technique is used to reduce the dimensionality of the problem. The accuracy of the model, that…