中文
相关论文

相关论文: The Workload-Router-Pool Architecture for LLM Infe…

200 篇论文

The deployment of large language models' (LLMs) inference at the edge can facilitate prompt service responsiveness while protecting user privacy. However, it is critically challenged by the resource constraints of a single edge node.…

分布式、并行与集群计算 · 计算机科学 2026-01-21 Peirong Zheng , Wenchao Xu , Haozhao Wang , Jinyu Chen , Xuemin Shen

AI agents powered by large language models (LLMs) have shown strong capabilities in problem solving. Through combining many intelligent agents, multi-agent collaboration has emerged as a promising approach to tackle complex, multi-faceted…

计算与语言 · 计算机科学 2024-12-10 Raphael Shu , Nilaksh Das , Michelle Yuan , Monica Sunkara , Yi Zhang

With the rise of artificial intelligence (AI), applying large language models (LLMs) to mathematical problem-solving has attracted increasing attention. Most existing approaches attempt to improve Operations Research (OR) optimization…

人工智能 · 计算机科学 2025-08-04 Bowen Zhang , Pengcheng Luo , Genke Yang , Boon-Hee Soong , Chau Yuen

The growing complexity of power systems has made accurate load forecasting more important than ever. An increasing number of advanced load forecasting methods have been developed. However, the static design of current methods offers no…

机器学习 · 计算机科学 2025-05-23 Yu Zuo , Dalin Qin , Yi Wang

As multi-agent AI systems grow in complexity, the protocols connecting them constrain their capabilities. Current protocols such as A2A and MCP do not expose model-level properties as first-class primitives, ignoring properties fundamental…

人工智能 · 计算机科学 2026-03-11 Sunil Prakash

Exploration capacity shapes both inference-time performance and reinforcement learning (RL) training for large (vision-) language models, as stochastic sampling often yields redundant reasoning paths with little high-level diversity. This…

计算机视觉与模式识别 · 计算机科学 2025-12-22 Rujiao Long , Yang Li , Xingyao Zhang , Weixun Wang , Tianqianjin Lin , Xi Zhao , Yuchi Xu , Wenbo Su , Junchi Yan , Bo Zheng

The transition from standard generative AI to \emph{reasoning-centric architectures}, exemplified by models capable of extensive Chain-of-Thought~(CoT) processing, marks a fundamental paradigm shift in system requirements. Unlike…

分布式、并行与集群计算 · 计算机科学 2026-05-20 Moiz Arif , Avinash Maurya , Sudharshan Vazhkudai , Bogdan Nicolae

Large Language Models can break through knowledge and timeliness limitations by invoking external tools within the Model Context Protocol framework to achieve automated execution of complex tasks. However, with the rapid growth of…

软件工程 · 计算机科学 2025-11-26 Qingsong He , Jing Nan , Jiayu Jiao , Liangjie Tang , Xiaodong Xu , Mengmeng Sun , Qingyao Wang , Minghui Yan

This paper presents a novel semantics-aware inspection path planning paradigm called "Semantics-aware Predictive Planning" (SPP). Industrial environments that require the inspection of specific objects or structures (called "semantics"),…

机器人学 · 计算机科学 2025-06-10 Mihir Dharmadhikari , Kostas Alexis

We observe that LLM cascading and routing implicitly solves an anytime computation problem -- a class of algorithms, well-studied in classical AI, that improve solutions as additional computation is allocated. We formalize this connection…

计算与语言 · 计算机科学 2026-04-14 Arindam Khaled

Autonomous indoor mobile robots can navigate reliably to metric coordinates using established frameworks such as ROS 2 Navigation 2, yet they lack the ability to interpret natural language instructions that express intent rather than…

机器人学 · 计算机科学 2026-05-05 Bogdan Felician Abaza , Andrei-Alexandru Staicu , Cristian Vasile Doicin

Conventional operating system scheduling algorithms are largely content-ignorant, making decisions based on factors such as latency or fairness without considering the actual intents or semantics of processes. Consequently, these algorithms…

机器学习 · 计算机科学 2025-06-17 Wenyue Hua , Dujian Ding , Yile Gu , Yujie Ren , Kai Mei , Minghua Ma , William Yang Wang

Large Language Models have revolutionized natural language processing, yet serving them efficiently in data centers remains challenging due to mixed workloads comprising latency-sensitive (LS) and best-effort (BE) jobs. Existing inference…

机器学习 · 计算机科学 2025-03-13 Mohammad Siavashi , Faezeh Keshmiri Dindarloo , Dejan Kostic , Marco Chiesa

The reasoning large language model (RLLM) has been proven competitive in solving complex reasoning tasks such as mathematics, coding, compared to general LLM. However, the serving performance and behavior of RLLM remains unexplored, which…

机器学习 · 计算机科学 2025-10-22 Qi Li , Junpan Wu , Xiang Liu , Yuxin Wang , Zeyu Li , Zhenheng Tang , Yuhan Chen , Shaohuai Shi , Xiaowen Chu

Large Language Models (LLMs), deep learning architectures with typically over 10 billion parameters, have recently begun to be integrated into various cyber-physical systems (CPS) such as robotics, industrial automation, and autopilot…

机器人学 · 计算机科学 2026-03-24 Weizhe Xu , Mengyu Liu , Fanxin Kong

While Vision-Language Models (VLMs) are set to transform robotic navigation, existing methods often underutilize their reasoning capabilities. To unlock the full potential of VLMs in robotics, we shift their role from passive observers to…

机器人学 · 计算机科学 2025-11-13 Mobin Habibpour , Fatemeh Afghah

Vision-and-Language Navigation (VLN) requires an agent to ground language instructions to its own movement within a visual environment. While state-of-the-art methods leverage the reasoning capabilities of Vision-Language Models (VLMs) for…

机器人学 · 计算机科学 2026-05-22 Wenxuan Guo , Xiuwei Xu , Yichen Liu , Xiangyu Li , Hang Yin , Huangxing Chen , Wenzhao Zheng , Jianjiang Feng , Jie Zhou , Jiwen Lu

Existing navigation decision support systems often perform poorly when handling non-predefined navigation scenarios. Leveraging the generalization capabilities of large language model (LLM) in handling unknown scenarios, this research…

人工智能 · 计算机科学 2025-02-25 Feng Ma , Xiu-min Wang , Chen Chen , Xiao-bin Xu , Xin-ping Yan

Large Language Model (LLM) agents increasingly interact with external systems through tool-calling protocols such as the Model Context Protocol (MCP). In prevailing architectures, the agent must reason about every tool invocation in every…

分布式、并行与集群计算 · 计算机科学 2026-05-05 Abhinav Singh Parmar

To appear in Theory and Practice of Logic Programming (TPLP), 2008. We are researching the interaction between the rule and the ontology layers of the Semantic Web, by comparing two options: 1) using OWL and its rule extension SWRL to…