English
Related papers

Related papers: GAR: Carbon-Aware Routing for LLM Inference via Co…

200 papers

Mitigating the substantial undesirable impact of transportation systems on the environment is paramount. Thus, predicting Greenhouse Gas (GHG) emissions is one of the profound topics, especially with the emergence of intelligent…

Signal Processing · Electrical Eng. & Systems 2020-12-07 Lama Alfaseeh , Ran Tu , Bilal Farooq , Marianne Hatzopoulou

Large Language Model (LLM) workloads have distinct prefill and decode phases with different compute and memory requirements which should ideally be accounted for when scheduling input queries across different LLM instances in a cluster.…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-08 Kunal Jain , Anjaly Parayil , Ankur Mallick , Esha Choukse , Xiaoting Qin , Jue Zhang , Íñigo Goiri , Rujia Wang , Chetan Bansal , Victor Rühle , Anoop Kulkarni , Steve Kofsky , Saravan Rajmohan

Augmenting large language models (LLM) to use external tools enhances their performance across a variety of tasks. However, prior works over-rely on task-specific demonstration of tool use that limits their generalizability and…

Artificial Intelligence · Computer Science 2024-02-01 Yining Lu , Haoping Yu , Daniel Khashabi

The abundance of materials and the development of the economy have led to the flourishing of the logistics industry, but have also caused certain pollution. The research on GVRP (Green vehicle routing problem) for planning vehicle routes…

Neural and Evolutionary Computing · Computer Science 2024-10-22 YY. Feng

As machine learning (ML) continues its rapid expansion, the environmental cost of model training and inference has become a critical societal concern. Existing benchmarks overwhelmingly focus on standard performance metrics such as…

Machine Learning · Computer Science 2026-02-25 KC Santosh , Srikanth Baride , Rodrigue Rizk

With the widespread adoption of Large Language Models (LLMs), energy costs of running LLMs is quickly becoming a critical concern. However, precisely measuring the energy consumption of LLMs is often infeasible because hardware-based power…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-16 Anurag Dutt , Young Won Choi , Avirup Sil , Anshul Gandhi , Aruna Balasubramanian , Niranjan Balasubramanian

We introduce Green-NAS, a multi-objective NAS (neural architecture search) framework designed for low-resource environments using weather forecasting as a case study. By adhering to 'Green AI' principles, the framework explicitly minimizes…

The global energy landscape is undergoing a profound transformation, often referred to as the energy transition, driven by the urgent need to mitigate climate change, reduce greenhouse gas emissions, and ensure sustainable energy supplies.…

Machine Learning · Computer Science 2025-05-08 Stavros Sykiotis

Retrieval-Augmented Generation (RAG) significantly improves the performance of Large Language Models (LLMs) on knowledge-intensive tasks. However, varying response quality across LLMs under RAG necessitates intelligent routing mechanisms,…

Computation and Language · Computer Science 2025-10-20 Jiarui Zhang , Xiangyu Liu , Yong Hu , Chaoyue Niu , Fan Wu , Guihai Chen

Large language model (LLM) inference has become a dominant workload in modern data centers, driving significant GPU utilization and energy consumption. While prior systems optimize throughput and latency by batching, scheduling, and…

Artificial Intelligence · Computer Science 2026-05-21 Can Hankendi , Rana Shahout , Minlan Yu , Ayse K. Coskun

The rapid advancement of AI technologies and their accelerated adoption in software development necessitates a systematic evaluation of their environmental impact alongside functional correctness. While prior studies have examined…

Software Engineering · Computer Science 2025-11-12 Mohammadjavad Mehditabar , Saurabhsingh Rajput , Antonio Mastropaolo , Tushar Sharma

The environmental impact of Large Language Models (LLMs) on data centers hosting these models is becoming a significant concern. While many efforts have focused on reducing the substantial training overhead of LLMs, carbon and water…

Systems and Control · Electrical Eng. & Systems 2026-03-10 Arash Khalatbarisoltani , Amin Mahmoudi , Jie Han , Muhammad Saeed , Wenxue Liu , Jinwen Li , Solmaz Kahourzade , Amirmehdi Yazdani , Xiaosong Hu

Graph-based retrieval-augmented generation (GraphRAG) has recently emerged as a powerful paradigm for knowledge-intensive question answering, especially for tasks that require structured evidence organization and multi-hop reasoning.…

Information Retrieval · Computer Science 2026-04-21 Dongzhe Fan , Chuanhao Ji , Zimu Wang , Tong Chen , Qiaoyu Tan

Land-use regression (LUR) models are important for the assessment of air pollution concentrations in areas without measurement stations. While many such models exist, they often use manually constructed features based on restricted, locally…

Machine Learning · Computer Science 2020-11-05 Michael Steininger , Konstantin Kobs , Albin Zehe , Florian Lautenschlager , Martin Becker , Andreas Hotho

Ridesharing has experienced significant global growth over the past decade and is becoming an integral component of modern transportation systems. However, despite their benefits, ridesharing platforms face fundamental inefficiencies that…

Systems and Control · Electrical Eng. & Systems 2025-09-09 Ali Zeynali , Mahsa Sahebdel , Noman Bashir , Ramesh K. Sitaraman , Mohammad Hajiesmaili

The rapid expansion of data centers (DCs) has intensified energy and carbon footprint, incurring a massive environmental computing cost. While carbon-aware workload migration strategies have been examined, existing approaches often overlook…

Systems and Control · Electrical Eng. & Systems 2025-04-02 Yichao Zhang , Yubo Song , Subham Sahoo

Recently, the number of off-the-shelf Large Language Models (LLMs) has exploded with many open-source options. This creates a diverse landscape regarding both serving options (e.g., inference on local hardware vs remote LLM APIs) and model…

Machine Learning · Computer Science 2024-12-18 Dimitrios Sikeridis , Dennis Ramdass , Pranay Pareek

Reducing our reliance on carbon-intensive energy sources is vital for reducing the carbon footprint of the electric grid. Although the grid is seeing increasing deployments of clean, renewable sources of energy, a significant portion of the…

Systems and Control · Electrical Eng. & Systems 2020-05-26 Rishikesh Jha , Stephen Lee , Srinivasan Iyengar , Mohammad H. Hajiesmaili , David Irwin , Prashant Shenoy

The environmental impact of Large Language Models (LLMs) is rising significantly, with inference now accounting for more than half of their total lifecycle carbon emissions. However, existing simulation frameworks, which are increasingly…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-16 Miray Özcan , Philipp Wiesner , Philipp Weiß , Odej Kao

Detailed scheduling has traditionally been optimized for the reduction of makespan and manufacturing costs. However, growing awareness of environmental concerns and increasingly stringent regulations are pushing manufacturing towards…

Optimization and Control · Mathematics 2025-10-14 Andrea Mencaroni , Pieter Leyman , Birger Raa , Stijn De Vuyst , Dieter Claeys