English
Related papers

Related papers: Act While Thinking: Accelerating LLM Agents via Pa…

200 papers

LLM agents execute in an interleaved reasoning-and-action loop, where future tool calls cannot be launched until the current reasoning step completes. This serial dependency inflates end-to-end latency and leaves the model idle while…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-21 Yanfei Song

Language models (LMs) are becoming increasingly dependent on external tools. LM-based agentic frameworks frequently interact with their environment via such tools to search files, run code, call APIs, etc. Further, modern reasoning-based…

Programming Languages · Computer Science 2025-12-19 Daniel Nichols , Prajwal Singhania , Charles Jekel , Abhinav Bhatele , Harshitha Menon

Language Model (LM) agents have demonstrated remarkable capabilities in solving tasks that require multiple interactions with the environment. However, they remain vulnerable in environments where a single error often leads to irrecoverable…

Artificial Intelligence · Computer Science 2026-02-24 Jongwon Jeong , Jungtaek Kim , Kangwook Lee

There is a growing demand for agentic AI technologies for a range of downstream applications like customer service and personal assistants. For applications where the agent needs to interact with a person, real-time low-latency…

AI agents are increasingly deployed in complex, interactive environments, yet their runtime remains a major bottleneck for training, evaluation, and real-world use. Typical agent behavior unfolds sequentially, with each action requiring an…

Artificial Intelligence · Computer Science 2026-04-24 Naimeng Ye , Arnav Ahuja , Georgios Liargkovas , Yunan Lu , Kostis Kaffes , Tianyi Peng

LLM-based search agents achieve strong performance but suffer from severe latency, as each step requires serialized LLM reasoning followed by action of tool execution. We revisit this bottleneck through the lens of speculation. While…

Artificial Intelligence · Computer Science 2025-11-26 Zixiao Huang , Wen Zeng , Tianyu Fu , Tengxuan Liu , Yizhou Sun , Ke Hong , Xinhao Yang , Chengchun Liu , Yan Li , Quanlu Zhang , Guohao Dai , Zhenhua Zhu , Yu Wang

Agentic AI will be an essential enabling technology for designing future mobile communication systems, which could provide flexible and customized services, automate complex network operations, and drive autonomous decision-making across…

Networking and Internet Architecture · Computer Science 2026-05-05 Purna Sai Garigipati , Onur Ayan , Kishor Chandra Joshi , Xueli An

Tool calling has greatly expanded the practical utility of large language models (LLMs) by enabling them to interact with external applications. As LLM capabilities advance, effective tool use increasingly involves multi-step, multi-turn…

Computation and Language · Computer Science 2026-05-29 Heming Xia , Yongqi Li , Cunxiao Du , Mingbo Song , Wenjie Li

Large Language Models (LLMs) typically come with a fixed architecture, despite growing evidence that not all layers contribute equally to every downstream task. We introduce TALE (Task-Aware Layer Elimination), an inference-time method that…

Machine Learning · Computer Science 2026-05-12 Omar Naim , Krish Sharma , Niyar R Barman , Nicholas Asher

As agent capabilities advance, existing benchmarks, such as $\tau^2$-Bench, are becoming increasingly saturated. Yet constructing new benchmark tasks remains complex, costly, and labor-intensive. Moreover, the standard approach, in which…

Artificial Intelligence · Computer Science 2026-05-28 Tomer Keren , Nitay Calderon , Asaf Yehudai , Yotam Perlitz , Michal Shmueli-Scheuer , Roi Reichert

With the increasingly giant scales of (causal) large language models (LLMs), the inference efficiency comes as one of the core concerns along the improved performance. In contrast to the memory footprint, the latency bottleneck seems to be…

Computation and Language · Computer Science 2024-04-24 Chen Zhang , Zhuorui Liu , Dawei Song

Multi-agent systems (MAS) extend large language models (LLMs) from independent single-model reasoning to coordinative system-level intelligence. While existing LLM agents depend on text-based mediation for reasoning and communication, we…

Computation and Language · Computer Science 2025-12-09 Jiaru Zou , Xiyuan Yang , Ruizhong Qiu , Gaotang Li , Katherine Tieu , Pan Lu , Ke Shen , Hanghang Tong , Yejin Choi , Jingrui He , James Zou , Mengdi Wang , Ling Yang

Large Language Models (LLMs) have shown remarkable capabilities in tool calling and tool usage, but suffer from hallucinations where they choose incorrect tools, provide malformed parameters and exhibit 'tool bypass' behavior by performing…

Artificial Intelligence · Computer Science 2026-01-09 Kait Healy , Bharathi Srinivasan , Visakh Madathil , Jing Wu

Large language models (LLMs) are increasingly deployed in teams, yet existing coordination approaches often occupy two extremes. Highly structured methods rely on fixed roles, pipelines, or task decompositions assigned a priori. In…

Agents, as user-centric tools, are increasingly deployed for human task delegation, assisting with a broad spectrum of requests by generating thoughts, engaging with user proxies, and producing action plans. However, agents based on large…

Multiagent Systems · Computer Science 2024-10-02 Wenyue Hua , Mengting Wan , Shashank Vadrevu , Ryan Nadel , Yongfeng Zhang , Chi Wang

Enabling large language models (LLMs) to solve complex reasoning tasks is a key step toward artificial general intelligence. Recent work augments LLMs with external tools to enable agentic reasoning, achieving high utility and efficiency in…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Qi Li , Xinchao Wang

Generative Large Language Models (LLMs) based on the Transformer architecture have recently emerged as a dominant foundation model for a wide range of Natural Language Processing tasks. Nevertheless, their application in real-time scenarios…

Computation and Language · Computer Science 2024-01-04 Coleman Hooper , Sehoon Kim , Hiva Mohammadzadeh , Hasan Genc , Kurt Keutzer , Amir Gholami , Sophia Shao

Tool learning empowers large language models (LLMs) as agents to use external tools and extend their utility. Existing methods employ one single LLM-based agent to iteratively select and execute tools, thereafter incorporating execution…

Computation and Language · Computer Science 2024-06-25 Zhengliang Shi , Shen Gao , Xiuyi Chen , Yue Feng , Lingyong Yan , Haibo Shi , Dawei Yin , Pengjie Ren , Suzan Verberne , Zhaochun Ren

We introduce a new software toolbox for agent-based simulation. Facilitating rapid prototyping by offering a user-friendly Python API, its core rests on an efficient C++ implementation to support simulation of large-scale multi-agent…

Computational Finance · Quantitative Finance 2022-09-22 Peter Belcak , Jan-Peter Calliess , Stefan Zohren

Tools are essential for large language models (LLMs) to acquire up-to-date information and take consequential actions in external environments. Existing work on tool-augmented LLMs primarily focuses on the broad coverage of tools and the…

Computation and Language · Computer Science 2024-03-08 Boshi Wang , Hao Fang , Jason Eisner , Benjamin Van Durme , Yu Su
‹ Prev 1 2 3 10 Next ›