English
Related papers

Related papers: Scalable Climate Data Analysis: Balancing Petascal…

200 papers

Cloud computing provides scientists a platform that can deploy computation and data intensive applications without infrastructure investment. With excessive cloud resources and a decision support system, large generated data sets can be…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-01-27 Dong Yuan , Lizhen Cui , Xiao Liu , Erjiang Fu , Yun Yang

With the rapid development of data collection and aggregation technologies in many scientific disciplines, it is becoming increasingly ubiquitous to conduct large-scale or online regression to analyze real-world data and unveil real-world…

Methodology · Statistics 2021-03-22 Jinfeng Xu , Zhiliang Ying , Na Zhao

Cities play a pivotal role in human development and sustainability, yet studying them presents significant challenges due to the vast scale and complexity of spatial-temporal data. One such challenge is the need to uncover universal urban…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-12-04 Zhenhui Li , Hongwei Zhang , Kan Wu

Advances in technology and computing hardware are enabling scientists from all areas of science to produce massive amounts of data using large-scale simulations or observational facilities. In this era of data deluge, effective coordination…

Databases · Computer Science 2015-03-31 Spyros Blanas , Surendra Byna

Serverless computing is transforming cloud application development, but the performance-cost trade-offs of control plane designs remain poorly understood due to a lack of open, cross-platform benchmarks and detailed system analyses. In this…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-04 Leonid Kondrashov , Boxi Zhou , Hancheng Wang , Dmitrii Ustiugov

Phasor Measurement Units (PMUs) generate high-frequency, time-synchronized data essential for real-time power grid monitoring, yet the growing scale of PMU deployments creates significant challenges in latency, scalability, and reliability.…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-30 Nachiappan Chockalingam , Akshay Deshpande , Lokesh Butra , Ram Sekhar Bodala , Nitin Saksena , Adithya Parthasarathy , Balakrishna Pothineni , Akash Kumar Agarwal

Scientists generate petabytes of data daily to help uncover environmental trends or behaviors that are hard to predict. For example, understanding climate simulations based on the long-term average of temperature, precipitation, and other…

Modern scientific simulations, observations, and large-scale experiments generate data at volumes that often exceed the limits of storage, processing, and analysis. This challenge drives the development of data reduction methods that…

Machine Learning · Computer Science 2025-11-18 Minh Vu , Andrey Lokhov

Thermal management in the hyper-scale cloud data centers is a critical problem. Increased host temperature creates hotspots which significantly increases cooling cost and affects reliability. Accurate prediction of host temperature is…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-12-17 Shashikant Ilager , Kotagiri Ramamohanarao , Rajkumar Buyya

An exponential growth in computing power, which has brought more sophisticated and higher resolution simulations of the climate system, and an exponential increase in observations since the first weather satellite was put in orbit, are…

Atmospheric and Oceanic Physics · Physics 2024-08-20 Annalisa Bracco , Julien Brajard , Henk A. Dijkstra , Pedram Hassanzadeh , Christian Lessig , Claire Monteleoni

Machine learning-based weather forecasting models now surpass state-of-the-art numerical weather prediction systems, but training and operating these models at high spatial resolution remains computationally expensive. We present a modular…

Machine Learning · Computer Science 2026-04-02 Aymeric Delefosse , Anastase Charantonis , Dominique Béréziat

Due to computational constraints, running global climate models (GCMs) for many years requires a lower spatial grid resolution (${\gtrsim}50$ km) than is optimal for accurately resolving important physical processes. Such processes are…

Human activities accelerate consumption of fossil fuels and produce greenhouse gases, resulting in urgent issues today: global warming and the climate change. These indirectly cause severe natural disasters, plenty of lives suffering and…

Reliable wind speed data is crucial for applications such as estimating local (future) wind power. Global Climate Models (GCMs) and Regional Climate Models (RCMs) provide forecasts over multi-decadal periods. However, their outputs vary…

Applications · Statistics 2024-11-19 Sofia Morelli , Nina Effenberger , Luca Schmidt , Nicole Ludwig

Understanding the earth's climate system and how it might be changing is a preeminent scientific challenge. Global climate models are used to simulate past, present, and future climates, and experiments are executed continuously on an array…

Spatial fields in the Earth and environmental sciences are often available at multiple scales or resolutions. While coarse-scale data (e.g., from global circulation models) are often abundant, they lack the local detail provided by…

Methodology · Statistics 2026-04-01 Alejandro Calle-Saldarriaga , Paul F. V. Wiemann , Matthias Katzfuss

Numerical climate model simulations run at high spatial and temporal resolutions generate massive quantities of data. As our computing capabilities continue to increase, storing all of the data is not sustainable, and thus it is important…

Methodology · Statistics 2018-02-20 Joseph Guinness , Dorit Hammerling

Cloud-related parameterizations remain a leading source of uncertainty in climate projections. Although machine learning holds promise for Earth system models (ESMs), many data-driven parameterizations lack interpretability, physical…

Atmospheric and Oceanic Physics · Physics 2025-11-25 Arthur Grundner , Tom Beucler , Julien Savre , Axel Lauer , Manuel Schlund , Veronika Eyring

Recently it was demonstrated how climate data can be utilized to estimate regional wind power densities. In particular it was shown that the quality of the global scale estimate compared well with regional high resolution studies and a link…

Atmospheric and Oceanic Physics · Physics 2016-10-31 Markus Gross , Vanesa Magar

The rapid progress of large language models (LLMs) is fueled by the growing reliance on datasets that blend real and synthetic data. While synthetic data offers scalability and cost-efficiency, it often introduces systematic distributional…