English
Related papers

Related papers: Compressing multidimensional weather and climate d…

200 papers

After training complex deep learning models, a common task is to compress the model to reduce compute and storage demands. When compressing, it is desirable to preserve the original model's per-example decisions (e.g., to go beyond top-1…

Machine Learning · Computer Science 2022-10-18 Jerry Chee , Megan Renz , Anil Damle , Christopher De Sa

Climate change results in altered air and water temperatures. Increases affect physicochemical properties, such as oxygen concentration, and can shift species distribution and survival, with consequences for ecosystem functioning and…

Machine Learning · Computer Science 2021-10-11 Stefanie Mohr , Konstantina Drainas , Juergen Geist

Real-time high-resolution wind predictions are beneficial for various applications including safe manned and unmanned aviation. Current weather models require too much compute and lack the necessary predictive capabilities as they are valid…

Machine learning models have achieved human-level performance on various tasks. This success comes at a high cost of computation and storage overhead, which makes machine learning algorithms difficult to deploy on edge devices. Typically,…

Machine Learning · Computer Science 2021-11-12 Giuseppina Carannante , Dimah Dera , Ghulam Rasool , Nidhal C. Bouaynaya

Automotive perception systems are obligated to meet high requirements. While optical sensors such as Camera and Lidar struggle in adverse weather conditions, Radar provides a more robust perception performance, effectively penetrating fog,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Christof Leitgeb , Thomas Puchleitner , Max Peter Ronecker , Daniel Watzenig

Most data is automatically collected and only ever "seen" by algorithms. Yet, data compressors preserve perceptual fidelity rather than just the information needed by algorithms performing downstream tasks. In this paper, we characterize…

Machine Learning · Computer Science 2022-01-31 Yann Dubois , Benjamin Bloem-Reddy , Karen Ullrich , Chris J. Maddison

There has been much interest in deploying deep learning algorithms on low-powered devices, including smartphones, drones, and medical sensors. However, full-scale deep neural networks are often too resource-intensive in terms of energy and…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Yoshitomo Matsubara , Ruihan Yang , Marco Levorato , Stephan Mandt

Climate models have been key for assessing the impact of climate change and simulating future climate scenarios. The machine learning (ML) community has taken an increased interest in supporting climate scientists' efforts on various tasks…

Downscaling, or super-resolution, provides decision-makers with detailed, high-resolution information about the potential risks and impacts of climate change, based on climate model output. Machine learning algorithms are proving themselves…

Atmospheric and Oceanic Physics · Physics 2024-04-30 Robbie A. Watt , Laura A. Mansfield

The fast growth of computational power and scales of modern super-computing systems have raised great challenges for the management of exascale scientific data. To maintain the usability of scientific data, error-bound lossy compression is…

Machine Learning · Computer Science 2023-11-08 Jinyang Liu , Sheng Di , Sian Jin , Kai Zhao , Xin Liang , Zizhong Chen , Franck Cappello

Scientific discoveries are increasingly constrained by limited storage space and I/O capacities. For time-series simulations and experiments, their data often need to be decimated over timesteps to accommodate storage and I/O limitations.…

Deep neural network pruning and quantization techniques have demonstrated it is possible to achieve high levels of compression with surprisingly little degradation to test set accuracy. However, this measure of performance conceals…

Machine Learning · Computer Science 2021-09-07 Sara Hooker , Aaron Courville , Gregory Clark , Yann Dauphin , Andrea Frome

Lossy compression is one of the most effective methods for reducing the size of scientific data containing multiple data fields. It reduces information density through prediction or transformation techniques to compress the data. Previous…

Machine Learning · Computer Science 2024-09-30 Youyuan Liu , Wenqi Jia , Taolue Yang , Miao Yin , Sian Jin

Recent advances in learning-based image compression typically come at the cost of high complexity. Designing computationally efficient architectures remains an open challenge. In this paper, we empirically investigate the impact of…

Image and Video Processing · Electrical Eng. & Systems 2024-06-18 Yichi Zhang , Zhihao Duan , Fengqing Zhu

Machine learning at the edge offers great benefits such as increased privacy and security, low latency, and more autonomy. However, a major challenge is that many devices, in particular edge devices, have very limited memory, weak…

Machine Learning · Computer Science 2019-09-05 Yang Li , Thomas Strohmer

Image restoration under adverse weather conditions (e.g., rain, snow and haze) is a fundamental computer vision problem and has important indications for various downstream applications. Different from early methods that are specially…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Zhentao Tan , Yue Wu , Qiankun Liu , Qi Chu , Le Lu , Jieping Ye , Nenghai Yu

Multiple studies have now demonstrated that machine learning (ML) can give improved skill for predicting or simulating fairly typical weather events, for tasks such as short-term and seasonal weather forecasting, downscaling simulations to…

Atmospheric and Oceanic Physics · Physics 2023-08-30 Peter AG Watson

Efficient time series forecasting is essential for smart energy systems, enabling accurate predictions of energy demand, renewable resource availability, and grid stability. However, the growing volume of high-frequency data from sensors…

Computational Engineering, Finance, and Science · Computer Science 2025-05-06 Mikkel Bue Lykkegaard , Svend Vendelbo Nielsen , Akanksha Upadhyay , Mikkel Bendixen Copeland , Philipp Trénell

As climate change intensifies, the shift to cleaner energy sources becomes increasingly urgent. With wind energy production set to accelerate, reliable wind probabilistic forecasts are essential to ensure its efficient use. However, since…

Machine Learning · Computer Science 2024-10-08 Jean-Sébastien Giroux , Simon-Philippe Breton , Julie Carreau

Recent deep learning models for Long-term Time Series Forecasting (LTSF) often emphasize complex, handcrafted designs, while simpler architectures like linear models or MLPs have often outperformed these intricate solutions. In this paper,…

Machine Learning · Computer Science 2025-05-26 Yihang Lu , Yangyang Xu , Qitao Qing , Xianwei Meng