English
Related papers

Related papers: Energy Consumption of Dataframe Libraries for End-…

200 papers

We present a library of efficient implementations of deep learning primitives. Deep learning workloads are computationally intensive, and optimizing their kernels is difficult and time-consuming. As parallel architectures evolve, kernels…

Neural and Evolutionary Computing · Computer Science 2014-12-19 Sharan Chetlur , Cliff Woolley , Philippe Vandermersch , Jonathan Cohen , John Tran , Bryan Catanzaro , Evan Shelhamer

This paper contributes towards better understanding the energy consumption trade-offs of HPC scale Artificial Intelligence (AI), and more specifically Deep Learning (DL) algorithms. For this task we developed benchmark-tracker, a benchmark…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-12-02 Danilo Carastan dos Santos

The general increase in data size and data sharing motivates the adoption of Big Data strategies in several scientific disciplines. However, while several options are available, no particular guidelines exist for selecting a Big Data…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-04 Mathieu Dugré , Valérie Hayot-Sasson , Tristan Glatard

Dataloaders, in charge of moving data from storage into GPUs while training machine learning models, might hold the key to drastically improving the performance of training jobs. Recent advances have shown promise not only by considerably…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-09-29 Iason Ofeidis , Diego Kiedanski , Leandros Tassiulas

In the past few years, neuroimaging has entered the Big Data era due to the joint increase in image resolution, data sharing, and study sizes. However, no particular Big Data engines have emerged in this field, and several alternatives…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-10-08 Mathieu Dugré , Valérie Hayot-Sasson , Tristan Glatard

With the success of deep learning techniques in a broad range of application domains, many deep learning software frameworks have been developed and are being updated frequently to adapt to new hardware features and software libraries,…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-11-10 Pengfei Xu , Shaohuai Shi , Xiaowen Chu

Deep Learning has enabled many advances in machine learning applications in the last few years. However, since current Deep Learning algorithms require much energy for computations, there are growing concerns about the associated…

Machine Learning · Computer Science 2023-03-06 Vanessa Mehlin , Sigurd Schacht , Carsten Lanquillon

GPUs have been favored for training deep learning models due to their highly parallelized architecture. As a result, most studies on training optimization focus on GPUs. There is often a trade-off, however, between cost and efficiency when…

The rise in deployment of large language models has driven a surge in GPU demand and datacenter scaling, raising concerns about electricity use, grid stress, and the impacts of modern AI workloads. Distillation is often promoted as one of…

Machine Learning · Computer Science 2026-05-15 Katherine Lambert , Sasha Luccioni

Deep learning algorithms have made many breakthroughs and have various applications in real life. Computational resources become a bottleneck as the data and complexity of the deep learning pipeline increases. In this paper, we propose…

Machine Learning · Computer Science 2021-05-05 Salman Ahmed , Hammad Naveed

Over the past years, great progress has been made in improving the computing power of general-purpose graphics processing units (GPGPUs), which facilitates the prosperity of deep neural networks (DNNs) in multiple fields like computer…

Performance · Computer Science 2019-05-28 Zhenheng Tang , Yuxin Wang , Qiang Wang , Xiaowen Chu

Estimates of energy usage in layers of computing from devices to algorithms have been determined and analyzed. Building on the previous analysis [3], energy needed from single devices and systems including three large-scale computing…

Computers and Society · Computer Science 2023-10-12 Sadasivan Shankar

Deep learning models have revolutionized various fields, from image recognition to natural language processing, by achieving unprecedented levels of accuracy. However, their increasing energy consumption has raised concerns about their…

Machine Learning · Computer Science 2024-09-18 Shreyank N Gowda , Xinyue Hao , Gen Li , Shashank Narayana Gowda , Xiaobo Jin , Laura Sevilla-Lara

Python is a popular programming language known for its ease of learning and extensive libraries. However, concerns about performance and energy consumption have led to the development of compilers to enhance Python code efficiency. Despite…

Programming Languages · Computer Science 2025-05-06 Vincenzo Stoico , Andrei Calin Dragomir , Patricia Lago

Many modern parallel computing systems are heterogeneous at their node level. Such nodes may comprise general purpose CPUs and accelerators (such as, GPU, or Intel Xeon Phi) that provide high performance with suitable energy-consumption…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-04-19 Suejb Memeti , Lu Li , Sabri Pllana , Joanna Kolodziej , Christoph Kessler

Data preprocessing pipelines, which includes data decoding, cleaning, and transforming, are a crucial component of Machine Learning (ML) training. Thy are computationally intensive and often become a major bottleneck, due to the increasing…

Hardware Architecture · Computer Science 2024-09-24 Yu Zhu , Wenqi Jiang , Gustavo Alonso

Due to their highly parallel multi-cores architecture, GPUs are being increasingly used in a wide range of computationally intensive applications. Compared to CPUs, GPUs can achieve higher performances at accelerating the programs'…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-10-05 Frédéric Magoulès , Abal-Kassim Cheik Ahamed , Alban Desmaison , Jean-Christophe Léchenet , François Mayer , Haifa Ben Salem , Thomas Zhu

Training large-scale deep neural networks is a long, time-consuming operation, often requiring many GPUs to accelerate. In large models, the time spent loading data takes a significant portion of model training time. As GPU servers are…

Computer Vision and Pattern Recognition · Computer Science 2020-05-06 Mahdi Zolnouri , Xinlin Li , Vahid Partovi Nia

As supercomputers grow in size and complexity, power efficiency has become a critical challenge, particularly in understanding GPU power consumption within modern HPC workloads. This work addresses this challenge by presenting a data…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-22 Melanie Cornelius , Greg Cross , Shilpika Shilpika , Matthew T. Dearing , Zhiling Lan

This deliverable reports our early energy models for data structures and algorithms based on both micro-benchmarks and concurrent algorithms. It reports the early results of Task 2.1 on investigating and modeling the trade-off between…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-02-09 Phuong Hoai Ha , Vi Ngoc-Nha Tran , Ibrahim Umar , Philippas Tsigas , Anders Gidenstam , Paul Renaud-Goud , Ivan Walulya , Aras Atalar