English
Related papers

Related papers: Towards Understanding, Analyzing, and Optimizing A…

200 papers

Autonomous agents powered by large language models (LLMs) perform complex tasks through long-horizon reasoning and tool interaction, where a fundamental trade-off arises between execution efficiency and reasoning robustness. Models at…

Computation and Language · Computer Science 2026-03-30 Wenbo Gao , Renxi Liu , Xian Wang , Fang Guo , Shuai Yang , Xi Chen , Hui-Ling Zhen , Hanting Chen , Weizhe Lin , Xiaosong Li , Yaoyuan Wang

This review presents a comprehensive analysis of two emerging paradigms in AI-assisted software development: vibe coding and agentic coding. While both leverage large language models (LLMs), they differ fundamentally in autonomy,…

Software Engineering · Computer Science 2025-05-27 Ranjan Sapkota , Konstantinos I. Roumeliotis , Manoj Karkee

AI agents execute tens to hundreds of chained LLM calls per task, yet GPU schedulers treat each call as independent, discarding gigabytes of intermediate state between steps and inflating end-to-end latency by 3-8x. We argue that this…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-04 Dongxin Guo , Jikun Wu , Siu Ming Yiu

Unlike traditional automation tools or static LLM-based systems, agents combine decision-making and tool utilization to accomplish complex tasks, showing great potential in software engineering. However, existing studies largely focus on…

Software Engineering · Computer Science 2025-11-04 Zhuowen Yin , Cuifeng Gao , Chunsong Fan , Wenzhang Yang , Yinxing Xue , Lijun Zhang

While frontier large language models (LLMs) are capable tool-using agents, current AI systems still operate in a strict turn-based fashion, oblivious to passage of time. This synchronous design forces user queries and tool-use to occur…

Artificial Intelligence · Computer Science 2024-10-30 Antonio A. Ginart , Naveen Kodali , Jason Lee , Caiming Xiong , Silvio Savarese , John Emmons

Agentic systems, AI architectures that autonomously execute multi-step workflows to achieve complex goals, are often built using repeated large language model (LLM) calls for closed-set decision tasks such as routing, shortlisting, gating,…

Computation and Language · Computer Science 2026-02-19 Ido Levy , Eilam Shapira , Yinon Goldshtein , Avi Yaeli , Nir Mashkif , Segev Shlomov

AI agents -- systems that combine foundation models with reasoning, planning, memory, and tool use -- are rapidly becoming a practical interface between natural-language intent and real-world computation. This survey synthesizes the…

Artificial Intelligence · Computer Science 2026-01-06 Bin Xu

Long-horizon tasks that require sustained reasoning and multiple tool interactions remain challenging for LLM agents: small errors compound across steps, and even state-of-the-art models often hallucinate or lose coherence. We identify…

Artificial Intelligence · Computer Science 2025-10-13 Guangya Wan , Mingyang Ling , Xiaoqi Ren , Rujun Han , Sheng Li , Zizhao Zhang

In this paper, we propose a novel factored agent architecture designed to overcome the limitations of traditional single-agent systems in agentic AI. Our approach decomposes the agent into two specialized components: (1) a large language…

Artificial Intelligence · Computer Science 2025-04-03 Nicholas Roth , Christopher Hidey , Lucas Spangher , William F. Arnold , Chang Ye , Nick Masiewicki , Jinoo Baek , Peter Grabowski , Eugene Ie

Cybersecurity is being fundamentally reshaped by foundation-model-based artificial intelligence. Large language models now enable autonomous planning, tool orchestration, and strategic adaptation at scale, challenging security architectures…

Cryptography and Security · Computer Science 2025-12-30 Tao Li , Quanyan Zhu

Advancements in Large Language Models (LLMs) are revolutionizing the development of autonomous agentic systems by enabling dynamic, context-aware task decomposition and automated tool selection. These sophisticated systems possess…

Artificial Intelligence · Computer Science 2024-10-31 Adrian Garret Gabriel , Alaa Alameer Ahmad , Shankar Kumar Jeyakumar

The rapid advancement of Large Language Models (LLMs) is catalyzing a shift towards autonomous AI Agents capable of executing complex, multi-step tasks. However, these agents remain brittle when faced with real-world exceptions, making…

Deploying large language models (LLMs) for online inference is often constrained by limited GPU memory, particularly due to the growing KV cache during auto-regressive decoding. Hybrid GPU-CPU execution has emerged as a promising solution…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-16 Jiakun Fan , Yanglin Zhang , Xiangchen Li , Dimitrios S. Nikolopoulos

Multi-agent systems achieve state-of-the-art outcomes through peer collaboration. However, when an agent in the pipeline silently drops a constraint, the system's final output may look correct even though the reasoning chain was quietly…

While agentic AI has advanced in automating individual tasks, managing complex multi-agent workflows remains a challenging problem. This paper presents a research vision for autonomous agentic systems that orchestrate collaboration within…

Artificial Intelligence · Computer Science 2025-10-06 Charlie Masters , Advaith Vellanki , Jiangbo Shangguan , Bart Kultys , Jonathan Gilmore , Alastair Moore , Stefano V. Albrecht

LLM-based multi-agent systems (MAS) have emerged as a promising approach to tackle complex tasks that are difficult for individual LLMs. A natural strategy is to scale performance by increasing the number of agents; however, we find that…

Artificial Intelligence · Computer Science 2026-02-04 Yingxuan Yang , Chengrui Qu , Muning Wen , Laixi Shi , Ying Wen , Weinan Zhang , Adam Wierman , Shangding Gu

Existing Multi-Agent Systems (MAS) typically rely on homogeneous model configurations, failing to exploit the diverse expertise inherent in different post-trained architectures. We propose Team-of-Thoughts, a heterogeneous MAS framework…

Computation and Language · Computer Science 2026-03-26 Jeffrey T. H. Wong , Zixi Zhang , Junyi Liu , Yiren Zhao

The electricity sector transition requires substantial increases in residential demand response capacity, yet Home Energy Management Systems (HEMS) adoption remains limited by user interaction barriers requiring translation of everyday…

Artificial Intelligence · Computer Science 2025-10-31 Reda El Makroum , Sebastian Zwickl-Bernhard , Lukas Kranzl

Configuring LLM-based agent systems involves choosing workflows, tools, token budgets, and prompts from a large combinatorial design space, and is typically handled today by fixed templates or hand-tuned heuristics that apply the same…

Artificial Intelligence · Computer Science 2026-05-22 Aditya Taparia , Som Sagar , Ransalu Senanayake

Multi-agent systems (MAS) extend large language models (LLMs) from independent single-model reasoning to coordinative system-level intelligence. While existing LLM agents depend on text-based mediation for reasoning and communication, we…

Computation and Language · Computer Science 2025-12-09 Jiaru Zou , Xiyuan Yang , Ruizhong Qiu , Gaotang Li , Katherine Tieu , Pan Lu , Ke Shen , Hanghang Tong , Yejin Choi , Jingrui He , James Zou , Mengdi Wang , Ling Yang