English
Related papers

Related papers: Empirically-Calibrated H100 Node Power Models for …

200 papers

There is a huge demand for on-device execution of deep learning algorithms on mobile and embedded platforms. These devices present constraints on the application due to limited resources and power. Hence, developing energy-efficient…

Performance · Computer Science 2018-05-15 Crefeda Faviola Rodrigues , Graham Riley , Mikel Lujan

The power that machine learning models consume when making predictions can be affected by a model's architecture. This paper presents various estimates of power consumption for a range of different activation functions, a core factor in…

Machine Learning · Computer Science 2020-06-15 Leon Derczynski

The growing demand for optimal and low-power energy consumption paradigms for IOT devices has garnered significant attention due to their cost-effectiveness, simplicity, and intelligibility. In this article, an AI hardware energy-efficient…

Signal Processing · Electrical Eng. & Systems 2024-12-03 Zheqi Yu , Chao Zhang , Pedro Machado , Adnan Zahid , Tim. Fernandez-Hart , Muhammad A. Imran , Qammer H. Abbasi

Buildings sector is one of the major consumers of energy in the United States. The buildings HVAC (Heating, Ventilation, and Air Conditioning) systems, whose functionality is to maintain thermal comfort and indoor air quality (IAQ), account…

Systems and Control · Electrical Eng. & Systems 2021-03-24 Chi Zhang , Sanmukh R. Kuppannagari , Rajgopal Kannan , Viktor K. Prasanna

With electric power systems becoming more compact and increasingly powerful, the relevance of thermal stress especially during overload operation is expected to increase ceaselessly. Whenever critical temperatures cannot be measured…

Machine Learning · Computer Science 2022-11-03 Wilhelm Kirchgässner , Oliver Wallscheid , Joachim Böcker

The proliferation of the Internet of Things (IoT) and its cutting-edge AI-enabled applications (e.g., autonomous vehicles and smart industries) combine two paradigms: data-driven systems and their deployment on the edge. Usually, edge…

Machine Learning · Computer Science 2025-08-01 Ghazal Sobhani , Md. Monzurul Amin Ifath , Tushar Sharma , Israat Haque

Rapid adoption of machine learning (ML) technologies has led to a surge in power consumption across diverse systems, from tiny IoT devices to massive datacenter clusters. Benchmarking the energy efficiency of these systems is crucial for…

Estimates of energy usage in layers of computing from devices to algorithms have been determined and analyzed. Building on the previous analysis [3], energy needed from single devices and systems including three large-scale computing…

Computers and Society · Computer Science 2023-10-12 Sadasivan Shankar

Recently, there has been a trend of shifting the execution of deep learning inference tasks toward the edge of the network, closer to the user, to reduce latency and preserve data privacy. At the same time, growing interest is being devoted…

Machine Learning · Computer Science 2023-06-07 Seyyidahmed Lahmer , Aria Khoshsirat , Michele Rossi , Andrea Zanella

Datacenter power demand has been continuously growing and is the key driver of its cost. An accurate mapping of compute resources (CPU, RAM, etc.) and hardware types (servers, accelerators, etc.) to power consumption has emerged as a…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-06-15 Ana Radovanovic , Bokan Chen , Saurav Talukdar , Binz Roy , Alexandre Duarte , Mahya Shahbazi

Modern deep learning models have been exploited in various domains, including computer vision (CV), natural language processing (NLP), search and recommendation. In practical AI clusters, workloads training these models are run using…

Performance · Computer Science 2019-10-15 Mengdi Wang , Chen Meng , Guoping Long , Chuan Wu , Jun Yang , Wei Lin , Yangqing Jia

This is the 1st part of the dissertation for my master degree and compares the power consumption using the default floating point (32bit) and Nvidia mixed precision (16bit and 32bit) while training a classification ML model. A custom PC…

Machine Learning · Computer Science 2024-10-01 Andrew Antonopoulos

Specialized compute blocks have been developed for efficient DNN execution. However, due to the vast amount of data and parameter movements, the interconnects and on-chip memories form another bottleneck, impairing power and performance.…

Machine Learning · Computer Science 2023-11-10 Lennart Bamberg , Ardalan Najafi , Alberto Garcia-Ortiz

This paper presents the building heating demand prediction model with occupancy profile and operational heating power level characteristics in short time horizon (a couple of days) using artificial neural network. In addition, novel pseudo…

Computational Engineering, Finance, and Science · Computer Science 2014-11-19 S. Paudel , M. Elmtiri , W. L. Kling , O. Le Corre , B. Lacarriere

How can short-term energy consumption be accurately forecasted when sensor data is noisy, incomplete, and lacks contextual richness? This question guided our participation in the \textit{2025 Competition on Electric Energy Consumption…

Machine Learning · Computer Science 2025-10-21 Sarah Al-Shareeda , Gulcihan Ozdemir , Heung Seok Jeon , Khaleel Ahmad

The deployment of Deep Neural Networks in energy-constrained environments, such as Energy Harvesting Wireless Sensor Networks, presents unique challenges, primarily due to the intermittent nature of power availability. To address these…

Machine Learning · Computer Science 2025-01-28 Cyan Subhra Mishra , Deeksha Chaudhary , Jack Sampson , Mahmut Taylan Knademir , Chita Das

Energy is now a critical ML computing resource. While measuring energy consumption and observing trends is a valuable first step, accurately understanding and diagnosing why those differences occur is crucial for optimization. To that end,…

Machine Learning · Computer Science 2026-02-02 Jae-Won Chung , Ruofan Wu , Jeff J. Ma , Mosharaf Chowdhury

Artificial intelligence (AI) has enabled a new paradigm of smart applications -- changing our way of living entirely. Many of these AI-enabled applications have very stringent latency requirements, especially for applications on mobile…

Machine Learning · Computer Science 2023-03-06 Anik Mallik , Haoxin Wang , Jiang Xie , Dawei Chen , Kyungtae Han

Smart manufacturing can significantly improve efficiency and reduce energy consumption, yet the energy demands of AI models may offset these gains. This study utilizes in-situ sensing-based prediction of geometric quality in smart machining…

Machine Learning · Computer Science 2025-12-04 Danny Hoang , Anandkumar Patel , Ruimen Chen , Rajiv Malhotra , Farhad Imani