中文
相关论文

相关论文: GAR: Carbon-Aware Routing for LLM Inference via Co…

200 篇论文

Retrieval-Augmented Generation (RAG) enables large language models (LLMs) to access broader knowledge sources, yet factual inconsistencies persist due to noise in retrieved documents-even with advanced retrieval methods. We demonstrate that…

计算与语言 · 计算机科学 2025-06-04 Yongjian Li , HaoCheng Chu , Yukun Yan , Zhenghao Liu , Shi Yu , Zheni Zeng , Ruobing Wang , Sen Song , Zhiyuan Liu , Maosong Sun

Ensuring energy feasibility under wind uncertainty is critical for the safety and reliability of UAV delivery missions. In realistic truck-drone logistics systems, UAVs must deliver parcels and safely return under time-varying wind…

机器人学 · 计算机科学 2026-04-16 Tianshun Li , Hongliang Lu , Yanggang Sheng , Zhongzhen Wang , Haoang Li , Xinhu Zheng

Traffic congestion in urban road networks leads to longer trip times and higher emissions, especially during peak periods. While the Shortest Path First (SPF) algorithm is optimal for a single vehicle in a static network, it performs poorly…

机器学习 · 计算机科学 2025-10-31 Fazel Arasteh , Arian Haghparast , Manos Papagelis

The rise of large language models (LLMs) has made natural language-driven route planning an emerging research area that encompasses rich user objectives. Current research exhibits two distinct approaches: direct route planning using…

人工智能 · 计算机科学 2025-09-17 Liangqi Yuan , Dong-Jun Han , Christopher G. Brinton , Sabine Brunswicker

A significant hurdle for current LLMs is the execution of complex, multi-stage tasks. Group Relative Policy Optimization (GRPO) has been emerging as a leading choice, but its reliance on sparse outcome rewards severely limits credit…

人工智能 · 计算机科学 2026-05-19 Wonjoong Kim , Yeonjun In , Sangwu Park , Dongha Lee , Chanyoung Park

Large Language Models (LLMs) excel across diverse domains but suffer from high energy costs due to quadratic attention and dense Feed-Forward Network (FFN) operations. To address these issues, we propose Module-aware Architecture Refinement…

人工智能 · 计算机科学 2026-04-23 Junhong Cai , Guiqin Wang , Kejie Zhao , Jianxiong Tang , Xiang Wang , Luziwei Leng , Ran Cheng , Yuxin Ma , Qinghai Guo

The deployment of large language models (LLMs) in real-world applications is increasingly limited by their high inference cost. While recent advances in dynamic token-level computation allocation attempt to improve efficiency by selectively…

计算与语言 · 计算机科学 2025-10-17 Chao Han , Yijuan Liang , Zihao Xuan , Daokuan Wu , Wei Zhang , Xiaoyu Shen

Motivated by an imperative to reduce the carbon emissions of cloud data centers, this paper studies the online carbon-aware resource scaling problem with unknown job lengths (OCSU) and applies it to carbon-aware resource scaling for…

分布式、并行与集群计算 · 计算机科学 2024-06-05 Roozbeh Bostandoost , Adam Lechowicz , Walid A. Hanafy , Noman Bashir , Prashant Shenoy , Mohammad Hajiesmaili

With the growing use of Large Language Model (LLM)-based tools like ChatGPT, Perplexity, and Gemini across industries, there is a rising need for efficient LLM inference systems. These systems handle requests with a unique two-phase…

机器学习 · 计算机科学 2025-12-02 Agrim Bari , Parikshit Hegde , Gustavo de Veciana

Ensuring that Software Requirements Specifications (SRS) align with higher-level organizational or national requirements is vital, particularly in regulated environments such as finance and aerospace. In these domains, maintaining…

软件工程 · 计算机科学 2024-12-12 Arsalan Masoudifard , Mohammad Mowlavi Sorond , Moein Madadi , Mohammad Sabokrou , Elahe Habibi

Although deep learning has demonstrated remarkable capability in learning from unstructured data, modern tree-based ensemble models remain superior in extracting relevant information and learning from structured datasets. While several…

机器学习 · 计算机科学 2026-02-05 Yi-Chun Liao , Chieh-Lin Tsai , Yuan-Hao Chang , Camélia Slimani , Jalil Boukhobza , Tei-Wei Kuo

The transition to intelligent, low-carbon power systems necessitates advanced optimization strategies for managing renewable energy integration, energy storage, and carbon emissions. Generative Large Models (GLMs) provide a data-driven…

系统与控制 · 电气工程与系统科学 2025-04-07 Lu Cheng , Qixiu Zhang , Beibei Xu , Zhiwei Huang , Cirun Zhang , Yanan Lyu , Fan Zhang

Large language models (LLMs) are increasingly deployed as the execution core of autonomous agents rather than as standalone text generators. Agentic workloads induce a temporal shift from single-turn inference to multi-turn LLM-tool loops,…

The latest trends in the adoption of cloud, edge, and distributed computing, as well as a rise in applying AI/ML workloads, have created a need to measure, monitor, and reduce the carbon emissions of these compute-intensive workloads and…

网络与互联网体系结构 · 计算机科学 2024-06-17 Jacob Goldverg , Hasibul Jamil , Elvis Rodriguez , Tevfik Kosar

Serverless computing simplifies cloud deployment but introduces new challenges in managing service latency and carbon emissions. Reducing cold-start latency requires retaining warm function instances, while minimizing carbon emissions…

分布式、并行与集群计算 · 计算机科学 2026-03-02 Bowen Sun , Christos D. Antonopoulos , Evgenia Smirni , Bin Ren , Nikolaos Bellas , Spyros Lalis

Large Language Models (LLMs) have demonstrated remarkable capabilities, leading to a significant increase in user demand for LLM services. However, cloud-based LLM services often suffer from high latency, unstable responsiveness, and…

网络与互联网体系结构 · 计算机科学 2025-08-04 Jin Yang , Qiong Wu , Zhiying Feng , Zhi Zhou , Deke Guo , Xu Chen

Accurately predicting travel mode choice is essential for effective transportation planning, yet traditional statistical and machine learning models are constrained by rigid assumptions, limited contextual reasoning, and reduced…

人工智能 · 计算机科学 2025-08-26 Yiming Xu , Junfeng Jiao

Cost-efficient path planning across multiple terrains is a crucial task in robot navigation, requiring the identification of a path from the start to the goal that not only avoids obstacles but also minimizes the overall travel cost. This…

机器人学 · 计算机科学 2026-03-11 Ling Xiao , Toshihiko Yamasaki

Accurate reporting of energy and carbon usage is essential for understanding the potential climate impacts of machine learning research. We introduce a framework that makes this easier by providing a simple interface for tracking realtime…

计算机与社会 · 计算机科学 2022-11-30 Peter Henderson , Jieru Hu , Joshua Romoff , Emma Brunskill , Dan Jurafsky , Joelle Pineau

While retrieval-augmented generation (RAG) has been shown to enhance factuality of large language model (LLM) outputs, LLMs still suffer from hallucination, generating incorrect or irrelevant information. A common detection strategy…

计算与语言 · 计算机科学 2025-03-17 Tobias Leemann , Periklis Petridis , Giuseppe Vietri , Dionysis Manousakas , Aaron Roth , Sergul Aydore