English
Related papers

Related papers: The Energy Cost of Execution-Idle in GPU Clusters

200 papers

Cloud data centers face increasing pressure to reduce operational energy consumption as big data workloads continue to grow in scale and complexity. This paper presents a workload aware and energy efficient scheduling framework that…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-21 Milan Parikh , Aniket Abhishek Soni , Sneja Mitinbhai Shah , Ayush Raj Jha

The ever increasing demand for ML-driven intelligence in a wide spectrum of domains has led to ubiquity of GPUs. At the same time, GPUs are notorious for their power consumption needs and often dominate power allocation in a typical ML…

Hardware Architecture · Computer Science 2026-05-22 Shaizeen Aga , Mohamed Assem Ibrahim

GPU activity prediction is an important and complex problem. This is due to the high level of contention among thousands of parallel threads. This problem was mostly addressed using heuristics. We propose a representation learning approach…

Machine Learning · Computer Science 2017-03-28 Aswin Raghavan , Mohamed Amer , Timothy Shields , David Zhang , Sek Chai

Energy-efficiency is highly desirable for sensing systems in the Internet of Things (IoT). A common approach to achieve low-power systems is duty-cycling, where components in a system are turned off periodically to meet an energy budget.…

Systems and Control · Computer Science 2017-05-03 Long N. Le , Douglas L. Jones

Fine-grained workload and resource balancing is the key to high performance for regular and irregular computations on the GPUs. In this dissertation, we conduct an extensive survey of existing load-balancing techniques to build an…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-12-20 Muhammad Osama

Parallel programming models can encourage performance portability by moving the responsibility for work assignment and data distribution from the programmer to a runtime system. However, analyzing the resulting implicit memory allocations,…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-03-14 Fabian Knorr , Philip Salzmann , Peter Thoman , Thomas Fahringer

Agentic AI workloads - where a single user goal triggers multi-step orchestration, tool calls, retries, and failure recovery - are being targeted for edge deployment, with NVIDIA, Dell, HP, ASUS, MSI, Acer, and Gigabyte all shipping…

Machine Learning · Computer Science 2026-05-28 Deepak Panigrahy , Aakash Tyagi

Ubiquity of AI makes optimizing GPU power a priority as large GPU-based clusters are often employed to train and serve AI models. An important first step in optimizing GPU power consumption is high-fidelity and fine-grain power measurement…

Hardware Architecture · Computer Science 2025-04-01 Varsha Singhania , Shaizeen Aga , Mohamed Assem Ibrahim

Commercial graphics processors (GPUs) have high compute capacity at very low cost, which makes them attractive for general purpose scientific computing. In this paper we show how graphics processors can be used for N-body simulations to…

Computational Engineering, Finance, and Science · Computer Science 2007-06-22 Erich Elsen , V. Vishal , Mike Houston , Vijay Pande , Pat Hanrahan , Eric Darve

The energy efficiency of neural processing units (NPU) is playing a critical role in developing sustainable data centers. Our study with different generations of NPU chips reveals that 30%-72% of their energy consumption is contributed by…

Hardware Architecture · Computer Science 2025-10-07 Yuqi Xue , Jian Huang

One of the main challenges in Heavy Energy Physics is to make fast analysis of high amount of experimental and simulated data. At LHC-CERN one p-p event is approximate 1 Mb in size. The time taken to analyze the data and obtain fast results…

Distributed, Parallel, and Cluster Computing · Computer Science 2011-07-01 Mihai Niculescu , Sorin-Ion Zgura

This report evaluates the performance impact of enabling Trusted Execution Environments (TEE) on NVIDIA Hopper GPUs for large language model (LLM) inference tasks. We benchmark the overhead introduced by TEE mode across various LLMs and…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-06 Jianwei Zhu , Hang Yin , Peng Deng , Aline Almeida , Shunfan Zhou

GPUs in High-Performance Computing systems remain under-utilised due to the unavailability of schedulers that can safely schedule multiple applications to share the same GPU. The research reported in this paper is motivated to improve the…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-12-14 Carlos Reano , Federico Silla , Dimitrios S. Nikolopoulos , Blesson Varghese

Evolutionary algorithms (EAs) are increasingly implemented on graphics processing units (GPUs) to leverage parallel processing capabilities for enhanced efficiency. However, existing studies largely emphasize the raw speedup obtained by…

Neural and Evolutionary Computing · Computer Science 2026-01-28 Xinmeng Yu , Tao Jiang , Ran Cheng , Yaochu Jin , Kay Chen Tan

Artificial intelligence (AI) is fueling exponential electricity demand growth, threatening grid reliability, raising prices for communities paying for new energy infrastructure, and stunting AI innovation as data centers wait for…

The rise of Artificial Intelligence and Large Language Models is driving increased GPU usage in data centers for complex training and inference tasks, impacting operational costs, energy demands, and the environmental footprint of…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-12-24 Francesco Lettich , Emanuele Carlini , Franco Maria Nardini , Raffaele Perego , Salvatore Trani

Graphics Processing Units (GPUs) have revolutionized the computing landscape over the past decade. However, the growing energy demands of data centres and computing facilities equipped with GPUs come with significant capital and…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-11-15 Richard Schoonhoven , Bram Veenboer , Ben van Werkhoven , Kees Joost Batenburg

Enterprises and labs performing computationally expensive data science applications sooner or later face the problem of scale but unconnected infrastructure. For this up-scaling process, an IT service provider can be hired or in-house…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-10-12 Martin Uray , Eduard Hirsch , Gerold Katzinger , Michael Gadermayr

The rapid adoption of AI and convenience offered by cloud services have resulted in the growing demands for GPUs in the cloud. Generally, GPUs are physically attached to host servers as PCIe devices. However, the fixed assembly combination…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-10-10 Bowen He , Xiao Zheng , Yuan Chen , Weinan Li , Yajin Zhou , Xin Long , Pengcheng Zhang , Xiaowei Lu , Linquan Jiang , Qiang Liu , Dennis Cai , Xiantao Zhang

Computational Fluid Dynamics (CFD) is the simulation of fluid flow undertaken with the use of computational hardware. The underlying equations are computationally challenging to solve and necessitate high performance computing (HPC) to…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-04 Zachary Cooper-Baldock , Brenda Vara Almirall , Kiao Inthavong