English
Related papers

Related papers: Productive Performance Engineering for Weather and…

200 papers

The large models, as predicted by scaling raw forecasts, have made groundbreaking progress in many fields, particularly in natural language generation tasks, where they have approached or even surpassed human levels. However, the…

Computation and Language · Computer Science 2025-04-25 Luping Wang , Sheng Chen , Linnan Jiang , Shu Pan , Runze Cai , Sen Yang , Fei Yang

In this paper, we present a comprehensive analysis of extreme temperature patterns using emerging statistical machine learning techniques. Our research focuses on exploring and comparing the effectiveness of various statistical models for…

Applications · Statistics 2023-07-27 Kameron B. Kinast , Ernest Fokoué

This paper describes LFRic: the new weather and climate modelling system being developed by the UK Met Office to replace the existing Unified Model in preparation for exascale computing in the 2020s. LFRic uses the GungHo dynamical core and…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-07-15 S. V. Adams , R. W. Ford , M. Hambley , J. M. Hobson , I. Kavcic , C. M. Maynard , T. Melvin , E. H Mueller , S. Mullerworth , A. R. Porter , M. Rezny , B. J. Shipway , R. Wong

We propose a language and compiler to productively build high-performance {\it software systolic arrays} that run on GPUs. Based on a rigorous mathematical foundation (uniform recurrence equations and space-time transform), our language has…

Programming Languages · Computer Science 2020-11-02 Hongbo Rong , Xiaochen Hao , Yun Liang , Lidong Xu , Hong H Jiang , Pradeep Dubey

High performance computing (HPC) architectures have undergone rapid development in recent years. As a result, established software suites face an ever increasing challenge to remain performant on and portable across modern systems. Many of…

Language models of code have demonstrated state-of-the-art performance across various software engineering and source code analysis tasks. However, their demanding computational resource requirements and consequential environmental…

Software Engineering · Computer Science 2025-02-12 Mootez Saad , José Antonio Hernández López , Boqi Chen , Dániel Varró , Tushar Sharma

There have been growing discussions on estimating and subsequently reducing the operational carbon footprint of enterprise data centers. The design and intelligent control for data centers have an important impact on data center carbon…

To enhance the efficiency, scalability, and cross-survey applicability of stellar parameter inference in large spectroscopic datasets, we present a modular, parallelized Python framework with automated error estimation, built on the LAMOST…

Spatio-temporal forecasting is crucial in transportation, logistics, and supply chain management. However, current methods struggle with large, complex datasets. We propose a dynamic, multi-modal approach that integrates the strengths of…

Machine Learning · Computer Science 2024-08-27 Sagar Srinivas Sakhinana , Geethan Sannidhi , Chidaksh Ravuru , Venkataramana Runkana

Micro-core architectures combine many simple, low memory, low power-consuming CPU cores onto a single chip. Potentially providing significant performance and low power consumption, this technology is not only of great interest in embedded,…

Programming Languages · Computer Science 2021-02-04 Maurice Jamieson , Nick Brown

Currently, the Weather Research and Forecasting model (WRF) utilizes shared memory (OpenMP) and distributed memory (MPI) parallelisms. To take advantage of GPU resources on the Perlmutter supercomputer at NERSC, we port parts of the…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-12 Chayanon , Wichitrnithed , Woo-Sun-Yang , Yun , He , Brad Richardson , Koichi Sakaguchi , Manuel Arenaz , William I. Gustafson , Jacob Shpund , Ulises Costi Blanco , Alvaro Goldar Dieste

In this work, we present our generic framework to construct, simulate, and calibrate dynamical systems in Python 3. Its goal is to reduce the time it takes to implement a dynamical system with $n$-dimensional states represented by coupled…

Data Analysis, Statistics and Probability · Physics 2023-10-11 Tijs W. Alleman , Christian Stevens , Jan M. Baetens

This document is one of the deliverable reports created for the ESCAPE project. ESCAPE stands for Energy-efficient Scalable Algorithms for Weather Prediction at Exascale. The project develops world-class, extreme-scale computing…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-08-20 Michał Kulczewski , Marek Błażewicz , Sebastian Ciesielski

Python is the de-facto language for software development in artificial intelligence (AI). Commonly used libraries, such as PyTorch and TensorFlow, rely on parallelization built into their BLAS backends to achieve speedup on CPUs. However,…

Machine Learning · Computer Science 2025-05-02 Maksim Helmann , Alexander Strack , Dirk Pflüger

CPU-GPU heterogeneous architectures are now commonly used in a wide variety of computing systems from mobile devices to supercomputers. Maximizing the throughput for multi-programmed workloads on such systems is indispensable as one single…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-08 Issa Saba , Eishi Arima , Dai Liu , Martin Schulz

Data-driven engineering refers to systematic data collection and processing using machine learning to improve engineering systems. Currently, the implementation of data-driven engineering relies on fundamental data science and software…

Software Engineering · Computer Science 2024-04-10 Simon Raedler , Matthias Rupp , Eugen Rigger , Stefanie Rinderle-Ma

As modern FPGAs evolve to include more het- erogeneous processing elements, such as ARM cores, it makes sense to consider these devices as processors first and FPGA accelerators second. As such, the conventional FPGA develop- ment…

Software Engineering · Computer Science 2017-05-16 Andrew G. Schmidt , Gabriel Weisz , Matthew French

Automatic code generation is frequently used to create implementations of algorithms specifically tuned to particular hardware and application parameters. The code generation process involves the selection of adequate code transformations,…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-08-08 Dominik Ernst , Markus Holzer , Georg Hager , Matthias Knorr , Gerhard Wellein

Python is a popular programming language known for its ease of learning and extensive libraries. However, concerns about performance and energy consumption have led to the development of compilers to enhance Python code efficiency. Despite…

Programming Languages · Computer Science 2025-05-06 Vincenzo Stoico , Andrei Calin Dragomir , Patricia Lago

We extract pixel-level masks of extreme weather patterns using variants of Tiramisu and DeepLabv3+ neural networks. We describe improvements to the software frameworks, input pipeline, and the network training algorithms necessary to…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-10-05 Thorsten Kurth , Sean Treichler , Joshua Romero , Mayur Mudigonda , Nathan Luehr , Everett Phillips , Ankur Mahesh , Michael Matheson , Jack Deslippe , Massimiliano Fatica , Prabhat , Michael Houston