English
Related papers

Related papers: The Workload-Router-Pool Architecture for LLM Infe…

200 papers

The deployment of large language models' (LLMs) inference at the edge can facilitate prompt service responsiveness while protecting user privacy. However, it is critically challenged by the resource constraints of a single edge node.…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-21 Peirong Zheng , Wenchao Xu , Haozhao Wang , Jinyu Chen , Xuemin Shen

AI agents powered by large language models (LLMs) have shown strong capabilities in problem solving. Through combining many intelligent agents, multi-agent collaboration has emerged as a promising approach to tackle complex, multi-faceted…

Computation and Language · Computer Science 2024-12-10 Raphael Shu , Nilaksh Das , Michelle Yuan , Monica Sunkara , Yi Zhang

With the rise of artificial intelligence (AI), applying large language models (LLMs) to mathematical problem-solving has attracted increasing attention. Most existing approaches attempt to improve Operations Research (OR) optimization…

Artificial Intelligence · Computer Science 2025-08-04 Bowen Zhang , Pengcheng Luo , Genke Yang , Boon-Hee Soong , Chau Yuen

The growing complexity of power systems has made accurate load forecasting more important than ever. An increasing number of advanced load forecasting methods have been developed. However, the static design of current methods offers no…

Machine Learning · Computer Science 2025-05-23 Yu Zuo , Dalin Qin , Yi Wang

As multi-agent AI systems grow in complexity, the protocols connecting them constrain their capabilities. Current protocols such as A2A and MCP do not expose model-level properties as first-class primitives, ignoring properties fundamental…

Artificial Intelligence · Computer Science 2026-03-11 Sunil Prakash

Exploration capacity shapes both inference-time performance and reinforcement learning (RL) training for large (vision-) language models, as stochastic sampling often yields redundant reasoning paths with little high-level diversity. This…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Rujiao Long , Yang Li , Xingyao Zhang , Weixun Wang , Tianqianjin Lin , Xi Zhao , Yuchi Xu , Wenbo Su , Junchi Yan , Bo Zheng

The transition from standard generative AI to \emph{reasoning-centric architectures}, exemplified by models capable of extensive Chain-of-Thought~(CoT) processing, marks a fundamental paradigm shift in system requirements. Unlike…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-20 Moiz Arif , Avinash Maurya , Sudharshan Vazhkudai , Bogdan Nicolae

Large Language Models can break through knowledge and timeliness limitations by invoking external tools within the Model Context Protocol framework to achieve automated execution of complex tasks. However, with the rapid growth of…

Software Engineering · Computer Science 2025-11-26 Qingsong He , Jing Nan , Jiayu Jiao , Liangjie Tang , Xiaodong Xu , Mengmeng Sun , Qingyao Wang , Minghui Yan

This paper presents a novel semantics-aware inspection path planning paradigm called "Semantics-aware Predictive Planning" (SPP). Industrial environments that require the inspection of specific objects or structures (called "semantics"),…

Robotics · Computer Science 2025-06-10 Mihir Dharmadhikari , Kostas Alexis

We observe that LLM cascading and routing implicitly solves an anytime computation problem -- a class of algorithms, well-studied in classical AI, that improve solutions as additional computation is allocated. We formalize this connection…

Computation and Language · Computer Science 2026-04-14 Arindam Khaled

Autonomous indoor mobile robots can navigate reliably to metric coordinates using established frameworks such as ROS 2 Navigation 2, yet they lack the ability to interpret natural language instructions that express intent rather than…

Robotics · Computer Science 2026-05-05 Bogdan Felician Abaza , Andrei-Alexandru Staicu , Cristian Vasile Doicin

Conventional operating system scheduling algorithms are largely content-ignorant, making decisions based on factors such as latency or fairness without considering the actual intents or semantics of processes. Consequently, these algorithms…

Machine Learning · Computer Science 2025-06-17 Wenyue Hua , Dujian Ding , Yile Gu , Yujie Ren , Kai Mei , Minghua Ma , William Yang Wang

Large Language Models have revolutionized natural language processing, yet serving them efficiently in data centers remains challenging due to mixed workloads comprising latency-sensitive (LS) and best-effort (BE) jobs. Existing inference…

Machine Learning · Computer Science 2025-03-13 Mohammad Siavashi , Faezeh Keshmiri Dindarloo , Dejan Kostic , Marco Chiesa

The reasoning large language model (RLLM) has been proven competitive in solving complex reasoning tasks such as mathematics, coding, compared to general LLM. However, the serving performance and behavior of RLLM remains unexplored, which…

Machine Learning · Computer Science 2025-10-22 Qi Li , Junpan Wu , Xiang Liu , Yuxin Wang , Zeyu Li , Zhenheng Tang , Yuhan Chen , Shaohuai Shi , Xiaowen Chu

Large Language Models (LLMs), deep learning architectures with typically over 10 billion parameters, have recently begun to be integrated into various cyber-physical systems (CPS) such as robotics, industrial automation, and autopilot…

Robotics · Computer Science 2026-03-24 Weizhe Xu , Mengyu Liu , Fanxin Kong

While Vision-Language Models (VLMs) are set to transform robotic navigation, existing methods often underutilize their reasoning capabilities. To unlock the full potential of VLMs in robotics, we shift their role from passive observers to…

Robotics · Computer Science 2025-11-13 Mobin Habibpour , Fatemeh Afghah

Vision-and-Language Navigation (VLN) requires an agent to ground language instructions to its own movement within a visual environment. While state-of-the-art methods leverage the reasoning capabilities of Vision-Language Models (VLMs) for…

Existing navigation decision support systems often perform poorly when handling non-predefined navigation scenarios. Leveraging the generalization capabilities of large language model (LLM) in handling unknown scenarios, this research…

Artificial Intelligence · Computer Science 2025-02-25 Feng Ma , Xiu-min Wang , Chen Chen , Xiao-bin Xu , Xin-ping Yan

Large Language Model (LLM) agents increasingly interact with external systems through tool-calling protocols such as the Model Context Protocol (MCP). In prevailing architectures, the agent must reason about every tool invocation in every…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-05 Abhinav Singh Parmar

To appear in Theory and Practice of Logic Programming (TPLP), 2008. We are researching the interaction between the rule and the ontology layers of the Semantic Web, by comparing two options: 1) using OWL and its rule extension SWRL to…

Artificial Intelligence · Computer Science 2007-11-22 Ken Samuel , Leo Obrst , Suzette Stoutenberg , Karen Fox , Paul Franklin , Adrian Johnson , Ken Laskey , Deborah Nichols , Steve Lopez , Jason Peterson
‹ Prev 1 3 4 5 6 7 10 Next ›