English
Related papers

Related papers: Energy Consumption of Dataframe Libraries for End-…

200 papers

This paper presents and justifies an open benchmark suite named BEEBS, targeted at evaluating the energy consumption of embedded processors. We explore the possible sources of energy consumption, then select individual benchmarks from…

Performance · Computer Science 2013-10-01 James Pallister , Simon Hollis , Jeremy Bennett

Efficient use of energy is essential for today's supercomputing systems, as energy cost is generally a major component of their operational cost. Research into "green computing" is needed to reduce the environmental impact of running these…

Performance · Computer Science 2022-11-08 Stefano Corda , Bram Veenboer , Emma Tolley

Large language models such as GPT-3 & ChatGPT have transformed deep learning (DL), powering applications that have captured the public's imagination. These models are rapidly being adopted across domains for analytics on various modalities,…

Machine Learning · Computer Science 2023-12-14 Kabir Nagrecha , Arun Kumar

The effective utilization at scale of complex machine learning (ML) techniques for HEP use cases poses several technological challenges, most importantly on the actual implementation of dedicated end-to-end data pipelines. A solution to…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-17 Matteo Migliorini , Riccardo Castellotti , Luca Canali , Marco Zanetti

Differentially private (DP) synthetic data sets are a solution for sharing data while preserving the privacy of individual data providers. Understanding the effects of utilizing DP synthetic data in end-to-end machine learning pipelines…

Machine Learning · Computer Science 2023-10-31 Mayana Pereira , Meghana Kshirsagar , Sumit Mukherjee , Rahul Dodhia , Juan Lavista Ferres , Rafael de Sousa

This work presents an in-depth analysis of the majority of the deep neural networks (DNNs) proposed in the state of the art for image recognition. For each DNN multiple performance indices are observed, such as recognition accuracy, model…

Computer Vision and Pattern Recognition · Computer Science 2023-09-15 Simone Bianco , Remi Cadene , Luigi Celona , Paolo Napoletano

The training process of Deep Neural Network (DNN) is compute-intensive, often taking days to weeks to train a DNN model. Therefore, parallel execution of DNN training on GPUs is a widely adopted approach to speed up the process nowadays.…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-10-29 Chi-Chung Chen , Chia-Lin Yang , Hsiang-Yun Cheng

Deep learning hyper-parameter optimization is a tough task. Finding an appropriate network configuration is a key to success, however most of the times this labor is roughly done. In this work we introduce a novel library to tackle this…

Machine Learning · Computer Science 2018-07-11 Andrés Camero , Jamal Toutouh , Enrique Alba

Deep learning (DL)-based code completion tools have transformed software development by enabling advanced code generation. These tools leverage models trained on vast amounts of code from numerous repositories, capturing general coding…

Software Engineering · Computer Science 2025-03-19 Alessandro Giagnorio , Alberto Martin-Lopez , Gabriele Bavota

The rapidly growing number of large network analysis problems has led to the emergence of many parallel and distributed graph processing systems---one survey in 2014 identified over 80. Since then, the landscape has evolved; some packages…

Performance · Computer Science 2017-05-18 Samuel Pollard , Boyana Norris

Training deep learning models is compute-intensive and there is an industry-wide trend towards hardware specialization to improve performance. To systematically benchmark deep learning platforms, we introduce ParaDnn, a parameterized…

Machine Learning · Computer Science 2019-10-23 Yu Emma Wang , Gu-Yeon Wei , David Brooks

Deep learning (DL) has been widely adopted those last years but they are computing-intensive method. Therefore, scientists proposed diverse optimization to accelerate their predictions for end-user applications. However, no single inference…

Machine Learning · Computer Science 2022-10-11 Pierrick Pochelu

Software systems often have numerous configuration options that can be adjusted to meet different performance requirements. However, understanding the combined impact of these options on performance is often challenging, especially with…

Software Engineering · Computer Science 2025-01-31 Jingzhi Gong

We introduce gridfm-datakit-v1, a Python library for generating realistic and diverse Power Flow (PF) and Optimal Power Flow (OPF) datasets for training Machine Learning (ML) solvers. Existing datasets and libraries face three main…

Foundation models are becoming the dominant deep learning technologies. Pretraining a foundation model is always time-consumed due to the large scale of both the model parameter and training dataset. Besides being computing-intensive, the…

Machine Learning · Computer Science 2023-03-22 Zhiquan Lai , Shengwei Li , Xudong Tang , Keshi Ge , Weijie Liu , Yabo Duan , Linbo Qiao , Dongsheng Li

It is crucial today that economies harness renewable energies and integrate them into the existing grid. Conventionally, energy has been generated based on forecasts of peak and low demands. Renewable energy can neither be produced on…

Signal Processing · Electrical Eng. & Systems 2019-10-02 Alexey Györi , Mathis Niederau , Violett Zeller , Volker Stich

Python is the de-facto language for software development in artificial intelligence (AI). Commonly used libraries, such as PyTorch and TensorFlow, rely on parallelization built into their BLAS backends to achieve speedup on CPUs. However,…

Machine Learning · Computer Science 2025-05-02 Maksim Helmann , Alexander Strack , Dirk Pflüger

Energy conservation of large data centers for high-performance computing workloads, such as deep learning with big data, is of critical significance, where cutting down a few percent of electricity translates into million-dollar savings.…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-04-02 Xinxin Mei , Qiang Wang , Xiaowen Chu , Hai Liu , Yiu-Wing Leung , Zongpeng Li

The number of processing elements (PEs) in a fixed-sized systolic accelerator is well matched for large and compute-bound DNNs; whereas, memory-bound DNNs suffer from PE underutilization and fail to achieve peak performance and energy…

Signal Processing · Electrical Eng. & Systems 2020-06-29 Nandan Kumar Jha , Shreyas Ravishankar , Sparsh Mittal , Arvind Kaushik , Dipan Mandal , Mahesh Chandra

There is a wealth of data on air pollution within several users' reach, including modelled concentrations and depositions as well as observations from air quality stations. However, data integration to perceive spatial and temporal trends…