English
Related papers

Related papers: EcoServe: Designing Carbon-Aware AI Inference Syst…

200 papers

Microservice architectures have become the dominant paradigm for cloud-native systems, offering flexibility and scalability. However, this shift has also led to increased demand for cloud resources, contributing to higher energy consumption…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-13 Julian Legler , Sebastian Werner , Maria C. Borges , Stefan Tai

The accelerating adoption of Large Language Models (LLMs) in software engineering (SE) has brought with it a silent crisis: unsustainable computational cost. While these models demonstrate remarkable capabilities in different SE tasks, they…

Software Engineering · Computer Science 2026-04-29 Ajmain Inqiad Alam , Palash Roy , Chanchal K. Roy , Banani Roy , Kevin A. Schneider

The carbon footprint of data centers has recently become a critical concern. So far, most carbon-aware strategies have focused on leveraging the flexibility of scheduling decisions for batch processing by shifting the time and location of…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-27 Kevin Kreutz , Philipp Wiesner , Monica Vitali

Transformers, driven by attention mechanisms, form the foundation of large language models (LLMs). As these models scale up, efficient GPU attention kernels become essential for high-throughput and low-latency inference. Diverse LLM…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-23 Zihao Ye , Lequn Chen , Ruihang Lai , Wuwei Lin , Yineng Zhang , Stephanie Wang , Tianqi Chen , Baris Kasikci , Vinod Grover , Arvind Krishnamurthy , Luis Ceze

Reducing our reliance on carbon-intensive energy sources is vital for reducing the carbon footprint of the electric grid. Although the grid is seeing increasing deployments of clean, renewable sources of energy, a significant portion of the…

Systems and Control · Electrical Eng. & Systems 2020-05-26 Rishikesh Jha , Stephen Lee , Srinivasan Iyengar , Mohammad H. Hajiesmaili , David Irwin , Prashant Shenoy

The rapid expansion of artificial intelligence has significantly increased the electricity, water, and carbon demands of modern data centers, raising sustainability concerns. This study evaluates the environmental footprint of AI server…

Computers and Society · Computer Science 2026-01-13 Aadi Patel , Nikhil Mahalingam , Rusheen Patel

The rapid emergence of Large Language Models (LLMs) has catalyzed Agentic artificial intelligence (AI), autonomous systems integrating perception, reasoning, and action into closed-loop pipelines for continuous adaptation. While unlocking…

Systems and Control · Electrical Eng. & Systems 2026-04-10 Xiaojing Chen , Haiqi Yu , Wei Ni , Dusit Niyato , Ruichen Zhang , Xin Wang , Shunqing Zhang , Shugong Xu

As global warming soars, the need to assess and reduce the environmental impact of recommender systems is becoming increasingly urgent. Despite this, the recommender systems community hardly understands, addresses, and evaluates the…

Information Retrieval · Computer Science 2025-09-17 Lukas Wegmeth , Tobias Vente , Alan Said , Joeran Beel

As augmented large language models (LLMs) with external tools become increasingly popular in web applications, improving augmented LLM inference serving efficiency and optimizing service-level objectives (SLOs) are critical for enhancing…

Computation and Language · Computer Science 2025-12-17 Ying Wang , Zhen Jin , Jiexiong Xu , Wenhai Lin , Yiquan Chen , Wenzhi Chen

Large Language Model (LLM) inference on large-scale systems is expected to dominate future cloud infrastructures. Efficient LLM inference in cloud environments with numerous AI accelerators is challenging, necessitating extensive…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-11 Ilias Bournias , Lukas Cavigelli , Georgios Zacharopoulos

The surge for computing resource demand is increasing global electricity consumption in data centers which is expected to exceed 1000 TWh by 2026, mainly attributable to adoption of new AI technologies. Carbon-aware computing strategies can…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-14 Marvin Steinke

Large language models (LLMs) have become increasingly popular in various areas, traditional business gradually shifting from rule-based systems to LLM-based solutions. However, the inference of LLMs is resource-intensive or…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-06 Wanyi Zheng , Minxian Xu , Shengye Song , Kejiang Ye

Serverless computing is an emerging cloud computing abstraction wherein the cloud platform transparently manages all resources, including explicitly provisioning resources and geographical load balancing when the demand for service spikes.…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-06 Jayden Serenari , Sreekanth Sreekumar , Kaiwen Zhao , Saurabh Sarkar , Stephen Lee

Attention efficiency is critical to large language model (LLM) inference. While prior advances optimize attention execution for individual requests (e.g., FlashAttention), production LLM serving relies on batching requests with highly…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-02-09 Rui Ning , Wei Zhang , Fan Lai

The use of Large Language Models (LLMs) for querying relational data has given rise to relQuery, a workload pattern that applies templated LLM calls to structured tables. As relQuery services become more widely adopted in applications such…

Databases · Computer Science 2026-01-21 Xin Zhang , Shihong Gao , Yanyan Shen , Haoyang Li , Lei Chen

Large language models (LLMs) have shown remarkable potential in processing long sequences and complex reasoning tasks, yet efficiently serving these models remains challenging due to the quadratic computational complexity of attention in…

Computation and Language · Computer Science 2025-04-22 Shang Yang , Junxian Guo , Haotian Tang , Qinghao Hu , Guangxuan Xiao , Jiaming Tang , Yujun Lin , Zhijian Liu , Yao Lu , Song Han

Cloud computing is offering utility-oriented IT services to users worldwide. Based on a pay-as-you-go model, it enables hosting of pervasive applications from consumer, scientific, and business domains. However, data centers hosting Cloud…

Distributed, Parallel, and Cluster Computing · Computer Science 2010-06-03 Rajkumar Buyya , Anton Beloglazov , Jemal Abawajy

Federated Learning (FL) distributes machine learning (ML) training across edge devices to reduce data transfer overhead and protect data privacy. Since FL model training may span hundreds of devices and is thus resource- and…

Machine Learning · Computer Science 2025-05-20 Talha Mehboob , Noman Bashir , Jesus Omana Iglesias , Michael Zink , David Irwin

The immense technological progress in artificial intelligence research and applications is increasingly drawing attention to the environmental sustainability of such systems, a field that has been termed Green AI. With this contribution we…

Computers and Society · Computer Science 2024-07-16 Christian Clemm , Lutz Stobbe , Kishan Wimalawarne , Jan Druschke

Cloud computing drives innovation but also poses significant environmental challenges due to its high-energy consumption and carbon emissions. Data centers account for 2-4% of global energy usage, and the ICT sector's share of electricity…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-26 Federico Ruilova , Ernst Gunnar Gran , Sven-Arne Reinemo