English
Related papers

Related papers: Greening AI Inference with Accuracy and Latency-aw…

200 papers

This paper addresses the critical challenge of building consumer trust in AI-powered customer engagement by emphasising the necessity for transparency and accountability. Despite the potential of AI to revolutionise business operations and…

Computers and Society · Computer Science 2024-10-04 Tara DeZao

The rapid adoption of large language models (LLMs) has led to significant energy consumption and carbon emissions, posing a critical challenge to the sustainability of generative AI technologies. This paper explores the integration of…

Machine Learning · Computer Science 2026-04-14 Tahniat Khan , Soroor Motie , Sedef Akinli Kocak , Shaina Raza

Machine learning systems increasingly drive innovation across scientific fields and industry, yet challenges in compute overhead, specifically during inference, limit their scalability and sustainability. Responsible AI guardrails,…

Machine Learning · Computer Science 2024-12-30 Jason M. Pittman

AI has been proposed as an important tool to support several efforts related to nature-based climate solutions such as the detection of wildfires that affect forests and vegetation-based offsets. While this and other use-cases provide…

Machine Learning · Computer Science 2023-12-20 Olamide Oladeji , Seyed Shahabeddin Mousavi

Developing and implementing AI-based solutions help state and federal government agencies, research institutions, and commercial companies enhance decision-making processes, automate chain operations, and reduce the consumption of natural…

Artificial Intelligence · Computer Science 2021-12-02 Andrei Svetovidov , Abdul Rahman , Feras A. Batarseh

The recent breakthrough in artificial intelligence (AI), especially deep neural networks (DNNs), has affected every branch of science and technology. Particularly, edge AI has been envisioned as a major application scenario to provide…

Machine Learning · Computer Science 2024-10-30 Jiawei Shao , Jun Zhang

With the ever-growing adoption of AI, its impact on the environment is no longer negligible. Despite the potential that continual learning could have towards Green AI, its environmental sustainability remains relatively uncharted. In this…

Machine Learning · Computer Science 2024-09-30 Tomaso Trinci , Simone Magistri , Roberto Verdecchia , Andrew D. Bagdanov

Task-oriented integrated sensing, communication, and computation (ISCC) is a key technology for achieving low-latency edge inference and enabling efficient implementation of artificial intelligence (AI) in industrial cyber-physical systems…

Information Theory · Computer Science 2025-03-04 Jiacheng Yao , Wei Xu , Guangxu Zhu , Kaibin Huang , Shuguang Cui

In artificial intelligence (AI), the complexity of many models and processes surpasses human understanding, making it challenging to determine why a specific prediction is made. This lack of transparency is particularly problematic in…

Machine Learning · Statistics 2025-06-30 Alexandra Stadler , Werner G. Müller , Radoslav Harman

Across the Artificial Intelligence (AI) lifecycle - from hardware to development, deployment, and reuse - burdens span energy, carbon, water, and embodied impacts. Cloud provider tools improve transparency but remain heterogeneous and often…

Artificial Intelligence · Computer Science 2025-11-14 Marcel Rojahn , Marcus Grum

The rapid expansion of AI inference services in the cloud necessitates a robust scalability solution to manage dynamic workloads and maintain high performance. This study proposes a comprehensive scalability optimization framework for cloud…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-23 Yihong Jin , Ze Yang

Prominent works in the field of Natural Language Processing have long attempted to create new innovative models by improving upon previous model training approaches, altering model architecture, and developing more in-depth datasets to…

Computation and Language · Computer Science 2024-04-02 Vivian Liu , Yiqiao Yin

We propose a novel incentive-based framework for composing energy service requests. An incentive model is designed that considers the context of the providers and consumers to determine rewards for sharing wireless energy. We propose a…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-07-21 Amani Abusafia , Athman Bouguettaya , Sajib Mistry

The skyrocketing demand for artificial intelligence (AI) has created an enormous appetite for globally deployed power-hungry servers. As a result, the environmental footprint of AI systems has come under increasing scrutiny. More crucially,…

Machine Learning · Computer Science 2024-12-24 Mohammad Hajiesmaili , Shaolei Ren , Ramesh K. Sitaraman , Adam Wierman

In this paper, we first clarify the concepts of green AI versus frugal AI, positioning frugality as efficiency by design and green AI as transparency and accountability. We then argue that these approaches, while complementary, are…

Systems and Control · Electrical Eng. & Systems 2025-12-09 Farzaneh Pourahmadi , Olivier Corradi , Pierre Pinson

With the ubiquitous use of modern large language models (LLMs) across industries, the inference serving for these models is ever expanding. Given the high compute and memory requirements of modern LLMs, more and more top-of-the-line GPUs…

Artificial Intelligence · Computer Science 2024-04-01 Jovan Stojkovic , Esha Choukse , Chaojie Zhang , Inigo Goiri , Josep Torrellas

The rapid progress of AI is fueled by increasingly large and computationally intensive machine learning models and datasets. As a consequence, the amount of compute used in training state-of-the-art models is exponentially increasing…

The recent advances in artificial intelligence namely in machine learning and deep learning, have boosted the performance of intelligent systems in several ways. This gave rise to human expectations, but also created the need for a deeper…

Sustainability encompasses three key facets: economic, environmental, and social. However, the nascent discourse that is emerging on sustainable artificial intelligence (AI) has predominantly focused on the environmental sustainability of…

Machine Learning · Computer Science 2025-02-28 Pedram Bakhtiarifard , Pınar Tözün , Christian Igel , Raghavendra Selvan

As large language models (LLMs) scale in size and adoption, their computational and environmental costs continue to rise. Prior benchmarking efforts have primarily focused on latency reduction in idealized settings, often overlooking the…

Computation and Language · Computer Science 2025-04-25 Jared Fernandez , Clara Na , Vashisth Tiwari , Yonatan Bisk , Sasha Luccioni , Emma Strubell
‹ Prev 1 3 4 5 6 7 10 Next ›