English
Related papers

Related papers: Analytic Framework for Estimating Memory Cost

200 papers

The size and complexity of deep neural networks continue to grow exponentially, significantly increasing energy consumption for training and inference by these models. We introduce an open-source package eco2AI to help data scientists and…

Computing systems are consuming an increasing and unsustainable fraction of society's energy footprint, notably in data centers. Meanwhile, energy-efficient software engineering techniques are often absent from undergraduate curricula. We…

Throughout its lifecycle, a large language model (LLM) generates a substantially larger carbon footprint during inference than training. LLM inference requests vary in batch size, prompt length, and token generation number, while cloud…

Machine Learning · Computer Science 2024-10-07 Zhenxiao Fu , Fan Chen , Shan Zhou , Haitong Li , Lei Jiang

Philosophers of technology have recently started paying more attention to the environmental impacts of AI, in particular of large language models (LLMs) and generative AI (genAI) applications. Meanwhile, few developers of AI give concrete…

Computers and Society · Computer Science 2025-07-30 Sylvia Wenmackers

Training large-scale artificial intelligence (AI) models demands significant computational power and energy, leading to increased carbon footprint with potential environmental repercussions. This paper delves into the challenges of training…

Machine Learning · Computer Science 2024-02-07 Jieming Bian , Lei Wang , Shaolei Ren , Jie Xu

The rapid advancement of AI, particularly large language models (LLMs), has raised significant concerns about the energy use and carbon emissions associated with model training and inference. However, existing tools for measuring and…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-31 Hongzhen Huang , Kunming Zhang , Hanlong Liao , Kui Wu , Guoming Tang

The increasing use of information technology has led to a significant share of energy consumption and carbon emissions from data centers. These contributions are expected to rise with the growing demand for big data analytics, increasing…

The widespread adoption of Artificial Intelligence (AI) and Machine Learning (ML) comes with a significant environmental impact, particularly in terms of energy consumption and carbon emissions. This pressing issue highlights the need for…

Machine Learning · Computer Science 2025-07-24 Mattia Sabella , Monica Vitali

As machine learning (ML) and artificial intelligence (AI) technologies become more widespread, concerns about their environmental impact are increasing due to the resource-intensive nature of training and inference processes. Green AI…

Software Engineering · Computer Science 2025-01-06 Vincenzo De Martino , Silverio Martínez-Fernández , Fabio Palomba

With the growing adoption of AI image generation, in conjunction with the ever-increasing environmental resources demanded by AI, we are urged to answer a fundamental question: What is the environmental impact hidden behind each image we…

Machine Learning · Computer Science 2025-06-23 Giulia Bertazzini , Chiara Albisani , Daniele Baracchi , Dasara Shullani , Roberto Verdecchia

The progress of some AI paradigms such as deep learning is said to be linked to an exponential growth in the number of parameters. There are many studies corroborating these trends, but does this translate into an exponential increase in…

Machine Learning · Computer Science 2023-03-30 Radosvet Desislavov , Fernando Martínez-Plumed , José Hernández-Orallo

The prevalence of Large Language Models (LLMs) is having an growing impact on the climate due to the substantial energy required for their deployment and use. To create awareness for developers who are implementing LLMs in their products,…

Software Engineering · Computer Science 2025-09-12 K. Pronk , Q. Zhao

Artificial intelligence (AI) systems impose substantial and growing environmental costs, yet transparency about these impacts has declined even as their deployment has accelerated. This paper makes three contributions. First, we collate…

Computers and Society · Computer Science 2026-03-03 Kai Ebert , Boris Gamazaychikov , Philipp Hacker , Sasha Luccioni

The rapid advancement of Artificial Intelligence (AI) has created unprecedented demands for computational power, yet methods for evaluating the performance, efficiency, and environmental impact of deployed models remain fragmented. Current…

Performance · Computer Science 2025-10-22 Hongyuan Liu , Xinyang Liu , Guosheng Hu

Deep learning has become widely used in complex AI applications. Yet, training a deep neural network (DNNs) model requires a considerable amount of calculations, long running time, and much energy. Nowadays, many-core AI accelerators (e.g.,…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-12 Yuxin Wang , Qiang Wang , Shaohuai Shi , Xin He , Zhenheng Tang , Kaiyong Zhao , Xiaowen Chu

Over the past decade, deep learning (DL) has led to significant advancements in various fields of artificial intelligence, including machine translation (MT). These advancements would not be possible without the ever-growing volumes of data…

Computation and Language · Computer Science 2022-11-17 Dimitar Shterionov , Eva Vanmassenhove

The rapid adoption of Large Language Models (LLMs) has raised significant environmental concerns. Unlike the one-time cost of training, LLM inference occurs continuously and dominates the AI energy footprint. Yet most sustainability studies…

Machine Learning · Computer Science 2026-04-08 Hemang Jain , Shailender Goyal , Divyansh Pandey , Karthik Vaidhyanathan

Artificial intelligence (AI) has enabled a new paradigm of smart applications -- changing our way of living entirely. Many of these AI-enabled applications have very stringent latency requirements, especially for applications on mobile…

Machine Learning · Computer Science 2023-03-06 Anik Mallik , Haoxin Wang , Jiang Xie , Dawei Chen , Kyungtae Han

As research and practice in artificial intelligence (A.I.) grow in leaps and bounds, the resources necessary to sustain and support their operations also grow at an increasing pace. While innovations and applications from A.I. have brought…

Artificial Intelligence · Computer Science 2023-01-30 Dan Zhao , Nathan C. Frey , Joseph McDonald , Matthew Hubbell , David Bestor , Michael Jones , Andrew Prout , Vijay Gadepally , Siddharth Samsi

With the ever-growing adoption of AI-based systems, the carbon footprint of AI is no longer negligible. AI researchers and practitioners are therefore urged to hold themselves accountable for the carbon emissions of the AI models they…

Artificial Intelligence · Computer Science 2023-05-08 Roberto Verdecchia , June Sallou , Luís Cruz