English
Related papers

Related papers: Toward Cross-Layer Energy Optimizations in AI Syst…

200 papers

The energy consumption and carbon footprint of Artificial Intelligence (AI) have become critical concerns due to rising costs and environmental impacts. In response, a new trend in green AI is emerging, shifting from the "bigger is better"…

Computers and Society · Computer Science 2025-10-03 Tiago da Silva Barros , Frédéric Giroire , Ramon Aparicio-Pardo , Joanna Moulierac

Artificial Intelligence (AI) is being incorporated in several optimization, scheduling, orchestration as well as in native communication network functions. This paradigm shift results in increased energy consumption, however, quantifying…

Emerging Technologies · Computer Science 2025-12-10 Shih-Kai Chou , Jernej Hribar , Vid Hanžel , Mihael Mohorčič , Carolina Fortuna

Edge AI, which brings artificial intelligence to the edge of the network for real-time processing and decision-making, has emerged as a transformative technology across various applications. However, the deployment of Edge AI systems faces…

Signal Processing · Electrical Eng. & Systems 2025-11-11 Zhiyuan Zhai , Wei Ni , Xin Wang

Scientific research faces high costs and inefficiencies with traditional methods, but the rise of deep learning and large language models (LLMs) offers innovative solutions. This survey reviews transformer-based LLM applications across…

Machine Learning · Computer Science 2025-09-16 Kaiyuan Tian , Linbo Qiao , Baihui Liu , Gongqingjian Jiang , Shanshan Li , Dongsheng Li

Modern AI practices all strive towards the same goal: better results. In the context of deep learning, the term "results" often refers to the achieved accuracy on a competitive problem set. In this paper, we adopt an idea from the emerging…

Machine Learning · Computer Science 2023-03-27 Tim Yarally , Luís Cruz , Daniel Feitosa , June Sallou , Arie van Deursen

Advanced Large Language Models (LLMs) have revolutionized various fields, including communication networks, sparking an innovation wave that has led to new applications and services, and significantly enhanced solution schemes. Despite all…

Performance · Computer Science 2026-04-29 Nguyen Phuc Tran , Brigitte Jaumard , Oscar Delgado

Large language models have become central to many AI applications, but their growing energy consumption raises serious sustainability concerns. A key limitation in current AI deployments is the reliance on a one-size-fits-all inference…

Rapid adoption of machine learning (ML) technologies has led to a surge in power consumption across diverse systems, from tiny IoT devices to massive datacenter clusters. Benchmarking the energy efficiency of these systems is crucial for…

Deep learning has become widely used in complex AI applications. Yet, training a deep neural network (DNNs) model requires a considerable amount of calculations, long running time, and much energy. Nowadays, many-core AI accelerators (e.g.,…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-12 Yuxin Wang , Qiang Wang , Shaohuai Shi , Xin He , Zhenheng Tang , Kaiyong Zhao , Xiaowen Chu

In particular, large-scale deep learning and artificial intelligence model training uses a lot of computational power and energy, so it poses serious sustainability issues. The fast rise in model complexity has resulted in exponential…

Hardware Architecture · Computer Science 2025-08-20 Yashasvi Makin , Rahul Maliakkal

The increasing usage of Artificial Intelligence (AI) models, especially Deep Neural Networks (DNNs), is increasing the power consumption during training and inference, posing environmental concerns and driving the need for more…

Neural and Evolutionary Computing · Computer Science 2024-02-01 Gabriel Cortês , Nuno Lourenço , Penousal Machado

In this research paper, we propose a new type of energy-efficient Green AI architecture to support circular economies and address the contemporary challenge of sustainable resource consumption in modern systems. We introduce a multi-layered…

Machine Learning · Computer Science 2025-06-17 Ripal Ranpara

In the rapidly evolving landscape of artificial intelligence (AI), generative large language models (LLMs) stand at the forefront, revolutionizing how we interact with our data. However, the computational intensity and memory consumption of…

Machine Learning · Computer Science 2025-07-24 Xupeng Miao , Gabriele Oliaro , Zhihao Zhang , Xinhao Cheng , Hongyi Jin , Tianqi Chen , Zhihao Jia

Microgrids have emerged as a pivotal solution in the quest for a sustainable and energy-efficient future. While microgrids offer numerous advantages, they are also prone to issues related to reliably forecasting renewable energy demand and…

Systems and Control · Electrical Eng. & Systems 2025-05-14 Noor ul Misbah Khanum , Hayssam Dahrouj , Ramesh C. Bansal , Hissam Mouayad Tawfik

As the performance of artificial intelligence systems has dramatically increased, so too has the environmental impact of creating these systems. While many model developers release estimates of the power consumption and carbon emissions…

Computers and Society · Computer Science 2025-03-11 Jacob Morrison , Clara Na , Jared Fernandez , Tim Dettmers , Emma Strubell , Jesse Dodge

As the modern electrical grid shifts towards distributed systems, there is an increasing need for rapid decision-making tools. Artificial Intelligence (AI) and Machine Learning (ML) technologies are now pivotal in enhancing the efficiency…

Systems and Control · Electrical Eng. & Systems 2024-08-27 Meiyi Li , Javad Mohammadi

Artificial Intelligence (AI) workloads drive a rapid expansion of high-performance computing (HPC) infrastructures and increase their power and energy demands towards a critical level. AI benchmarks representing state-of-the art workloads…

Performance · Computer Science 2026-03-18 Martin Mayr , Sebastian Wind , Lukas Schröder , Georg Hager , Harald Köstler , Gerhard Wellein

As AI capabilities and deployment accelerate toward a post-AGI era, concerns are growing about electricity demand and carbon emissions from AI computing, yet it is rarely represented explicitly in long term energy-economy-climate scenario…

Computers and Society · Computer Science 2026-03-12 Doyi Kim , Jiseok Ahn , Haewon McJeon , Changick Kim

The burgeoning field of Large Language Models (LLMs), exemplified by sophisticated models like OpenAI's ChatGPT, represents a significant advancement in artificial intelligence. These models, however, bring forth substantial challenges in…

The substantial increase in AI model training has considerable environmental implications, mandating more energy-efficient and sustainable AI practices. On the one hand, data-centric approaches show great potential towards training…

Machine Learning · Computer Science 2024-02-20 Mohammed Alswaitti , Roberto Verdecchia , Grégoire Danoy , Pascal Bouvry , Johnatan Pecero