English
Related papers

Related papers: Scalable Climate Data Analysis: Balancing Petascal…

200 papers

Cloud computing promises traditional enterprises and independent software vendors a myriad of advantages over on-premise installations including cost, operational and organizational efficiencies. The decision to migrate software configured…

Software Engineering · Computer Science 2019-08-13 Pierangelo Rosati , Frank Fowley , Claus Pahl , Davide Taibi , Theo Lynn

We make a case for "planetary computing" -- infrastructure to handle the ingestion, transformation, analysis and publication of global data products for furthering environmental science and enabling better informed policy-making. We draw on…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-04 Patrick Ferris , Michael Dales , Sadiq Jaffer , Amelia Holcomb , Eleanor Toye Scott , Thomas Swinfield , Alison Eyres , Andrew Balmford , David Coomes , Srinivasan Keshav , Anil Madhavapeddy

In cloud computing, storage area networks, remote backup storage, and similar settings, stored data is modified with updates from new versions. Representing information and modifying the representation are both expensive. Therefore it is…

Information Theory · Computer Science 2011-05-11 Lav R. Varshney , Julius Kusuma , Vivek K Goyal

Data assimilation of observational data into full atmospheric states is essential for weather forecast model initialization. Recently, methods for deep generative data assimilation have been proposed which allow for using new input data…

High resolution information on climatic conditions is essential to many applications in environmental and ecological sciences. Here we present the CHELSA Climatologies at high resolution for the earths land surface areas data of downscaled…

Atmosphere modelling applications become increasingly memory-bound due to the inconsistent development rates between processor speeds and memory bandwidth. In this study, we mitigate memory bottlenecks and reduce the computational load of…

Atmospheric and Oceanic Physics · Physics 2024-04-16 Siyuan Chen , Yi Zhang , Yiming Wang , Zhuang Liu , Xiaohan Li , Wei Xue

Hybrid modeling combining data-driven techniques and numerical methods is an emerging and promising research direction for efficient climate simulation. However, previous works lack practical platforms, making developing hybrid modeling a…

Atmospheric and Oceanic Physics · Physics 2022-09-20 Xin Wang , Wei Xue , Yilun Han , Guangwen Yang

Statistical downscaling of global climate models (GCMs) allows researchers to study local climate change effects decades into the future. A wide range of statistical models have been applied to downscaling GCMs but recent advances in…

Machine Learning · Statistics 2017-02-15 Thomas Vandal , Evan Kodra , Auroop R Ganguly

Data imbalance is a ubiquitous problem in machine learning. In large scale collected and annotated datasets, data imbalance is either mitigated manually by undersampling frequent classes and oversampling rare classes, or planned for with…

Computer Vision and Pattern Recognition · Computer Science 2021-07-20 Deep Patel , Erin Gao , Anirudh Koul , Siddha Ganju , Meher Anand Kasam

When performing predictions that use Machine Learning (ML), we are mainly interested in performance and interpretability. This generates a natural trade-off, where complex models generally have higher skills but are harder to explain and…

Machine Learning · Computer Science 2025-03-31 Alessandro Lovo , Amaury Lancelin , Corentin Herbert , Freddy Bouchet

Precise and reliable climate projections are required for climate adaptation and mitigation, but Earth system models still exhibit great uncertainties. Several approaches have been developed to reduce the spread of climate projections and…

The concept of scalability analysis of numerical parallel applications has been revisited, with the specific goals defined for the performance estimation of research applications. A series of Community Climate Model System (CCSM) numerical…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-11-08 Natalie Perlin , Joel P. Zysman , Ben P. Kirtman

Orbital data centers are being evaluated as solar-powered compute constellations and relay-integrated processing platforms. Their feasibility is not set by orbital solar flux alone, but by simultaneous closure of photovoltaic generation,…

General Physics · Physics 2026-05-01 Slava G. Turyshev

In engineering design and scientific computing, computational cost and predictive accuracy are intrinsically coupled. High-fidelity simulations provide accurate predictions but at substantial computational costs, while lower-fidelity…

Machine Learning · Computer Science 2026-05-11 Ahmed Mohamed Eisa Nasr , Ali Elham , Haris Moazam Sheikh

Regional climate information at kilometer scales is essential for assessing the impacts of climate change, but generating it with global climate models is too expensive due to their high computational costs. Machine learning models offer a…

Atmospheric and Oceanic Physics · Physics 2026-04-07 Kevin Debeire , Aytaç Paçal , Pierre Gentine , Luis Medrano-Navarro , Nils Thuerey , Veronika Eyring

Large biological datasets are being produced at a rapid pace and create substantial storage challenges, particularly in the domain of high-throughput sequencing (HTS). Most approaches currently used to store HTS data are either unable to…

Quantitative Methods · Quantitative Biology 2014-03-05 Fabien Campagne , Kevin C. Dorff , Nyasha Chambwe , James T. Robinson , Jill P. Mesirov , Thomas D. Wu

Climate change results in altered air and water temperatures. Increases affect physicochemical properties, such as oxygen concentration, and can shift species distribution and survival, with consequences for ecosystem functioning and…

Machine Learning · Computer Science 2021-10-11 Stefanie Mohr , Konstantina Drainas , Juergen Geist

Systems exhibiting nonlinear dynamics, including but not limited to chaos, are ubiquitous across Earth Sciences such as Meteorology, Hydrology, Climate and Ecology, as well as Biology such as neural and cardiac processes. However, System…

Machine Learning · Computer Science 2020-08-14 Nishant Yadav , Sai Ravela , Auroop R. Ganguly

Numerical simulations of Earth's weather and climate require substantial amounts of computation. This has led to a growing interest in replacing subroutines that explicitly compute physical processes with approximate machine learning (ML)…

Machine Learning · Computer Science 2021-11-30 Salva Rühling Cachay , Venkatesh Ramesh , Jason N. S. Cole , Howard Barker , David Rolnick

The rapid expansion of data centers (DCs) has intensified energy and carbon footprint, incurring a massive environmental computing cost. While carbon-aware workload migration strategies have been examined, existing approaches often overlook…

Systems and Control · Electrical Eng. & Systems 2025-04-02 Yichao Zhang , Yubo Song , Subham Sahoo