中文
相关论文

相关论文: GAR: Carbon-Aware Routing for LLM Inference via Co…

200 篇论文

Mitigating the substantial undesirable impact of transportation systems on the environment is paramount. Thus, predicting Greenhouse Gas (GHG) emissions is one of the profound topics, especially with the emergence of intelligent…

信号处理 · 电气工程与系统科学 2020-12-07 Lama Alfaseeh , Ran Tu , Bilal Farooq , Marianne Hatzopoulou

Large Language Model (LLM) workloads have distinct prefill and decode phases with different compute and memory requirements which should ideally be accounted for when scheduling input queries across different LLM instances in a cluster.…

Augmenting large language models (LLM) to use external tools enhances their performance across a variety of tasks. However, prior works over-rely on task-specific demonstration of tool use that limits their generalizability and…

人工智能 · 计算机科学 2024-02-01 Yining Lu , Haoping Yu , Daniel Khashabi

The abundance of materials and the development of the economy have led to the flourishing of the logistics industry, but have also caused certain pollution. The research on GVRP (Green vehicle routing problem) for planning vehicle routes…

神经与进化计算 · 计算机科学 2024-10-22 YY. Feng

As machine learning (ML) continues its rapid expansion, the environmental cost of model training and inference has become a critical societal concern. Existing benchmarks overwhelmingly focus on standard performance metrics such as…

机器学习 · 计算机科学 2026-02-25 KC Santosh , Srikanth Baride , Rodrigue Rizk

With the widespread adoption of Large Language Models (LLMs), energy costs of running LLMs is quickly becoming a critical concern. However, precisely measuring the energy consumption of LLMs is often infeasible because hardware-based power…

分布式、并行与集群计算 · 计算机科学 2025-12-16 Anurag Dutt , Young Won Choi , Avirup Sil , Anshul Gandhi , Aruna Balasubramanian , Niranjan Balasubramanian

We introduce Green-NAS, a multi-objective NAS (neural architecture search) framework designed for low-resource environments using weather forecasting as a case study. By adhering to 'Green AI' principles, the framework explicitly minimizes…

The global energy landscape is undergoing a profound transformation, often referred to as the energy transition, driven by the urgent need to mitigate climate change, reduce greenhouse gas emissions, and ensure sustainable energy supplies.…

机器学习 · 计算机科学 2025-05-08 Stavros Sykiotis

Retrieval-Augmented Generation (RAG) significantly improves the performance of Large Language Models (LLMs) on knowledge-intensive tasks. However, varying response quality across LLMs under RAG necessitates intelligent routing mechanisms,…

计算与语言 · 计算机科学 2025-10-20 Jiarui Zhang , Xiangyu Liu , Yong Hu , Chaoyue Niu , Fan Wu , Guihai Chen

Large language model (LLM) inference has become a dominant workload in modern data centers, driving significant GPU utilization and energy consumption. While prior systems optimize throughput and latency by batching, scheduling, and…

人工智能 · 计算机科学 2026-05-21 Can Hankendi , Rana Shahout , Minlan Yu , Ayse K. Coskun

The rapid advancement of AI technologies and their accelerated adoption in software development necessitates a systematic evaluation of their environmental impact alongside functional correctness. While prior studies have examined…

软件工程 · 计算机科学 2025-11-12 Mohammadjavad Mehditabar , Saurabhsingh Rajput , Antonio Mastropaolo , Tushar Sharma

The environmental impact of Large Language Models (LLMs) on data centers hosting these models is becoming a significant concern. While many efforts have focused on reducing the substantial training overhead of LLMs, carbon and water…

系统与控制 · 电气工程与系统科学 2026-03-10 Arash Khalatbarisoltani , Amin Mahmoudi , Jie Han , Muhammad Saeed , Wenxue Liu , Jinwen Li , Solmaz Kahourzade , Amirmehdi Yazdani , Xiaosong Hu

Graph-based retrieval-augmented generation (GraphRAG) has recently emerged as a powerful paradigm for knowledge-intensive question answering, especially for tasks that require structured evidence organization and multi-hop reasoning.…

信息检索 · 计算机科学 2026-04-21 Dongzhe Fan , Chuanhao Ji , Zimu Wang , Tong Chen , Qiaoyu Tan

Land-use regression (LUR) models are important for the assessment of air pollution concentrations in areas without measurement stations. While many such models exist, they often use manually constructed features based on restricted, locally…

Ridesharing has experienced significant global growth over the past decade and is becoming an integral component of modern transportation systems. However, despite their benefits, ridesharing platforms face fundamental inefficiencies that…

系统与控制 · 电气工程与系统科学 2025-09-09 Ali Zeynali , Mahsa Sahebdel , Noman Bashir , Ramesh K. Sitaraman , Mohammad Hajiesmaili

The rapid expansion of data centers (DCs) has intensified energy and carbon footprint, incurring a massive environmental computing cost. While carbon-aware workload migration strategies have been examined, existing approaches often overlook…

系统与控制 · 电气工程与系统科学 2025-04-02 Yichao Zhang , Yubo Song , Subham Sahoo

Recently, the number of off-the-shelf Large Language Models (LLMs) has exploded with many open-source options. This creates a diverse landscape regarding both serving options (e.g., inference on local hardware vs remote LLM APIs) and model…

机器学习 · 计算机科学 2024-12-18 Dimitrios Sikeridis , Dennis Ramdass , Pranay Pareek

Reducing our reliance on carbon-intensive energy sources is vital for reducing the carbon footprint of the electric grid. Although the grid is seeing increasing deployments of clean, renewable sources of energy, a significant portion of the…

系统与控制 · 电气工程与系统科学 2020-05-26 Rishikesh Jha , Stephen Lee , Srinivasan Iyengar , Mohammad H. Hajiesmaili , David Irwin , Prashant Shenoy

The environmental impact of Large Language Models (LLMs) is rising significantly, with inference now accounting for more than half of their total lifecycle carbon emissions. However, existing simulation frameworks, which are increasingly…

分布式、并行与集群计算 · 计算机科学 2025-07-16 Miray Özcan , Philipp Wiesner , Philipp Weiß , Odej Kao

Detailed scheduling has traditionally been optimized for the reduction of makespan and manufacturing costs. However, growing awareness of environmental concerns and increasingly stringent regulations are pushing manufacturing towards…

最优化与控制 · 数学 2025-10-14 Andrea Mencaroni , Pieter Leyman , Birger Raa , Stijn De Vuyst , Dieter Claeys