English
Related papers

Related papers: Scaling on Frontier: Uncertainty Quantification Wo…

200 papers

Large language models (LLMs) are increasingly deployed locally for privacy and accessibility, yet users lack tools to measure their resource usage, environmental impact, and efficiency metrics. This paper presents EnviroLLM, an open-source…

Machine Learning · Computer Science 2025-12-16 Troy Allen

The first generation of exascale systems will include a variety of machine architectures, featuring GPUs from multiple vendors. As a result, many developers are interested in adopting portable programming models to avoid maintaining…

Performance · Computer Science 2023-10-26 Esteban M. Rangel , S. John Pennycook , Adrian Pope , Nicholas Frontiere , Zhiqiang Ma , Varsha Madananth

Scientific workflows have become essential for orchestrating complex computational processes across distributed resources, managing large datasets, and ensuring reproducibility in modern research. The Workflows Community Summit 2025, held…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-02-06 Irene Bonati , Silvina Caino-Lores , Tainã Coleman , Sagar Dolas , Sandro Fiore , Venkatesh Kannan , Marco Verdicchio , Sean R. Wilkinson , Rafael Ferreira da Silva

Efficient exploitation of exascale architectures requires rethinking of the numerical algorithms used in many large-scale applications. These architectures favor algorithms that expose ultra fine-grain parallelism and maximize the ratio of…

Fault tolerance overhead of high performance computing (HPC) applications is becoming critical to the efficient utilization of HPC systems at large scale. HPC applications typically tolerate fail-stop failures by checkpointing. Another…

Distributed, Parallel, and Cluster Computing · Computer Science 2011-06-22 Erlin Yao , Mingyu Chen , Rui Wang , Wenli Zhang , Guangming Tan

Advances in technology and computing hardware are enabling scientists from all areas of science to produce massive amounts of data using large-scale simulations or observational facilities. In this era of data deluge, effective coordination…

Databases · Computer Science 2015-03-31 Spyros Blanas , Surendra Byna

With the advent of exascale computing, effective load balancing in massively parallel software applications is critically important for leveraging the full potential of high performance computing systems. Load balancing is the distribution…

Quantum Physics · Physics 2025-01-30 Omer Rathore , Alastair Basden , Nicholas Chancellor , Halim Kusumaatmaja

Quantum resources are increasingly integrated into high-performance computing (HPC) and cloud environments, but quantum high-performance computing (QHPC) software stacks remain isolated, often proprietary, full-stack solutions lacking…

Building large AI fleets to support the rapidly growing DL workloads is an active research topic for modern cloud providers. Generating accurate benchmarks plays an essential role in designing the fast-paced software and hardware solutions…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-04-13 Mingyu Liang , Wenyin Fu , Louis Feng , Zhongyi Lin , Pavani Panakanti , Shengbao Zheng , Srinivas Sridharan , Christina Delimitrou

The rapid advancements in artificial intelligence (AI), particularly the Large Language Models (LLMs), have profoundly affected our daily work and communication forms. However, it is still a challenge to deploy LLMs on resource-constrained…

Hardware Architecture · Computer Science 2025-03-03 Mingqiang Huang , Ao Shen , Kai Li , Haoxiang Peng , Boyu Li , Yupeng Su , Hao Yu

Many machine learning models are fine-tuned from large language models (LLMs) to achieve high performance in specialized domains like code generation, biomedical analysis, and mathematical problem solving. However, this fine-tuning process…

Computation and Language · Computer Science 2025-11-14 Jialin Wu , Kecen Li , Zhicong Huang , Xinfeng Li , Xiaofeng Wang , Cheng Hong

quest for processing speed potential. In fact, we always get a fraction of the technically available computing power (so-called {\em theoretical peak}), and the gap is likely to go hand-to-hand with the hardware complexity of the target…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-06-23 Claude Tadonki

The Exascale Computing Project (ECP) is invested in co-design to assure that key applications are ready for exascale computing. Within ECP, the Co-design Center for Particle Applications (CoPA) is addressing challenges faced by…

We expect that multiscale simulations will be one of the main high performance computing workloads in the exascale era. We propose multiscale computing patterns as a generic vehicle to realise load balanced, fault tolerant and energy aware…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-12-09 Saad Alowayyed , Derek Groen , Peter V. Coveney , Alfons G. Hoekstra

We present the VECMA toolkit (VECMAtk), a flexible software environment for single and multiscale simulations that introduces directly applicable and reusable procedures for verification, validation (V&V), sensitivity analysis (SA) and…

To improve customer experience, datacenter operators offer support for simplifying application and resource management. For example, running workloads of workflows on behalf of customers is desirable, but requires increasingly more…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-11-27 Laurens Versluis , Mihai Neacşu , Alexandru Iosup

Quantum field theory (QFT) simulations are a potentially important application for noisy intermediate scale quantum (NISQ) computers. The ability of a quantum computer to emulate a QFT, therefore, constitutes a natural application-centric…

Uncertainty Quantification (UQ) workloads are becoming increasingly common in science and engineering. They involve the submission of thousands or even millions of similar tasks with potentially unpredictable runtimes, where the total…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-02 Chung Ming Loi , Anne Reinarz , Mikkel Lykkegaard , William Hornsby , James Buchanan , Linus Seelinger

Every day, we experience the effects of the global warming: extreme weather events, major forest fires, storms, global warming, etc.The scientific community acknowledges that this crisis is a consequence of human activities where…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-22 Guillaume Raffin , Denis Trystram

Particle accelerators are among the largest, most complex devices. To meet the challenges of increasing energy, intensity, accuracy, compactness, complexity and efficiency, increasingly sophisticated computational tools are required for…

Accelerator Physics · Physics 2023-01-13 Axel Huebl , Remi Lehe , Chad E. Mitchell , Ji Qiang , Robert D. Ryne , Ryan T. Sandberg , Jean-Luc Vay