English
Related papers

Related papers: Orla: A Library for Serving LLM-Based Multi-Agent …

200 papers

GPU kernel optimization has long been a central challenge at the intersection of high-performance computing and machine learning. Efficient kernels are crucial for accelerating large language model (LLM) training and serving, yet attaining…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-04 Anjiang Wei , Tianran Sun , Yogesh Seenichamy , Hang Song , Anne Ouyang , Azalia Mirhoseini , Ke Wang , Alex Aiken

Recent advances in Large Language Models (LLMs) have enabled the development of increasingly complex agentic and multi-agent systems capable of planning, tool use and task decomposition. However, empirical evidence shows that many of these…

Software Engineering · Computer Science 2026-01-27 Maria Jesus Rodriguez-Sanchez , Manuel Noguera , Angel Ruiz-Zafra , Kawtar Benghazi

Recent advances in LLM-based agent systems have shown promise on complex, long-horizon tasks, but existing agent protocols (e.g., A2A and MCP) do not adequately support lifecycle-aware coordination across agents, tools, and environments. To…

Artificial Intelligence · Computer Science 2026-05-29 Wentao Zhang , Liang Zeng , Yuzhen Xiao , Yongcong Li , Ce Cui , Yilei Zhao , Rui Hu , Yang Liu , Yahui Zhou , Bo An

The growing capabilities of large language models (LLMs) in instruction-following and context-understanding lead to the era of agents with numerous applications. Among these, task planning agents have become especially prominent in…

As LLM applications grow more complex, developers are increasingly adopting multi-agent architectures to decompose workflows into specialized, collaborative components, introducing structure that constrains agent behavior and exposes useful…

Large Language Model (LLM) based multi-agent systems (MAS) show remarkable potential in collaborative problem-solving, yet they still face critical challenges: low communication efficiency, poor scalability, and a lack of effective…

Computation and Language · Computer Science 2025-02-19 Weize Chen , Jiarui Yuan , Chen Qian , Cheng Yang , Zhiyuan Liu , Maosong Sun

AI agents execute tens to hundreds of chained LLM calls per task, yet GPU schedulers treat each call as independent, discarding gigabytes of intermediate state between steps and inflating end-to-end latency by 3-8x. We argue that this…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-04 Dongxin Guo , Jikun Wu , Siu Ming Yiu

Effort estimation is a crucial activity in agile software development, where teams collaboratively review, discuss, and estimate the effort required to complete user stories in a product backlog. Current practices in agile effort estimation…

Software Engineering · Computer Science 2025-09-19 Thanh-Long Bui , Hoa Khanh Dam , Rashina Hoda

Large language model (LLM)-based multi-agent systems have demonstrated impressive capabilities in handling complex tasks. However, the complexity of agentic behaviors makes these systems difficult to understand. When failures occur,…

Human-Computer Interaction · Computer Science 2026-02-06 Rui Sheng , Yukun Yang , Chuhan Shi , Yanna Lin , Zixin Chen , Huamin Qu , Furui Cheng

Large Language Model (LLM) agents, acting on their users' behalf to manipulate and analyze data, are likely to become the dominant workload for data systems in the future. When working with data, agents employ a high-throughput process of…

Integrating Large Language Models (LLMs) into autonomous agents marks a significant shift in the research landscape by offering cognitive abilities that are competitive with human planning and reasoning. This paper explores the…

Software Engineering · Computer Science 2025-07-21 Junda He , Christoph Treude , David Lo

We introduce OrchVis, a multi-agent orchestration framework that visualizes, verifies, and coordinates goal-driven collaboration among LLM-based agents. Through hierarchical goal alignment, task assignment, and conflict resolution, OrchVis…

Human-Computer Interaction · Computer Science 2025-10-30 Jieyu Zhou

We present an agentic flow consisting of multiple agents that combine specialized LLMs and hardware simulation tools to collaboratively complete the complex task of Register Transfer Level (RTL) generation without human intervention. A key…

Software Engineering · Computer Science 2025-11-07 Athma Narayanan , Mahesh Subedar , Omesh Tickoo

This paper presents a Large Language Model (LLM) based conversational agent system designed to enhance human-machine collaboration in Machine Learning Operations (MLOps). We introduce the Swarm Agent, an extensible architecture that…

Artificial Intelligence · Computer Science 2025-11-11 George Fatouros , Georgios Makridis , George Kousiouris , John Soldatos , Anargyros Tsadimas , Dimosthenis Kyriazis

The rise of agentic AI workflows unlocks novel opportunities for computer systems design and optimization. However, for specialized domains such as program synthesis, the relative scarcity of HDL and proprietary EDA resources online…

Hardware Architecture · Computer Science 2025-09-25 Amulya Bhattaram , Janani Ramamoorthy , Ranit Gupta , Diana Marculescu , Dimitrios Stamoulis

LLMs have recently demonstrated strong capabilities in automatic RTL code generation, achieving high syntactic and functional correctness. However, most methods focus on functional correctness while overlooking critical physical design…

Computation and Language · Computer Science 2026-03-19 Yaoxiang Wang , Qi Shi , ShangZhan Li , Qingguo Hu , Xinyu Yin , Bo Guo , Xu Han , Maosong Sun , Jinsong Su

Large-scale telecom and datacenter infrastructures rely on multi-layered service and resource models, where failures propagate across physical and logical components and affect multiple customers. Traditional approaches to root cause…

Artificial Intelligence · Computer Science 2026-01-13 Nicolas Tacheny

Multi-agent applications utilize the advanced capabilities of large language models (LLMs) for intricate task completion through agent collaboration in a workflow. Under this situation, requests from different agents usually access the same…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-12 Jinyuan Chen , Jiuchen Shi , Quan Chen , Minyi Guo

Multi-agent systems (MAS) enable complex reasoning by coordinating multiple agents, but often incur high inference latency due to multi-step execution and repeated model invocations, severely limiting their scalability and usability in…

Multiagent Systems · Computer Science 2026-01-16 Xi Shi , Mengxin Zheng , Qian Lou

We introduce LEGOMem, a modular procedural memory framework for multi-agent large language model (LLM) systems in workflow automation. LEGOMem decomposes past task trajectories into reusable memory units and flexibly allocates them across…

Artificial Intelligence · Computer Science 2025-10-07 Dongge Han , Camille Couturier , Daniel Madrigal Diaz , Xuchao Zhang , Victor Rühle , Saravan Rajmohan