English
Related papers

Related papers: Budget-Aware Tool-Use Enables Effective Agent Scal…

200 papers

The remarkable growth in large language model (LLM) capabilities has spurred exploration into multi-agent systems, with debate frameworks emerging as a promising avenue for enhanced problem-solving. These multi-agent debate (MAD)…

Artificial Intelligence · Computer Science 2025-06-23 Yongjin Yang , Euiin Yi , Jongwoo Ko , Kimin Lee , Zhijing Jin , Se-Young Yun

Tool-using large language model (LLM) agents often face a fundamental tension between answer quality and execution cost. Fixed workflows are stable but inflexible, while free-form multi-step reasoning methods such as ReAct may improve task…

Artificial Intelligence · Computer Science 2026-03-23 Boyan Liu , Gongming Zhao , Hongli Xu

Current test-time scaling (TTS) techniques enhance large language model (LLM) performance by allocating additional computation at inference time, yet they remain insufficient for agentic settings, where actions directly interact with…

Computation and Language · Computer Science 2026-02-04 Xingshan Zeng , Lingzhi Wang , Weiwen Liu , Liangyou Li , Yasheng Wang , Lifeng Shang , Xin Jiang , Qun Liu

Agentic Retrieval-Augmented Generation (RAG) systems combine iterative search, planning prompts, and retrieval backends, but deployed settings impose explicit budgets on tool calls and completion tokens. We present a controlled measurement…

Artificial Intelligence · Computer Science 2026-03-11 Kyle McCleary , James Ghawaly

Recent work reports strong performance from multi-agent LLM systems (MAS), but these gains are often confounded by increased test-time computation. When computation is normalized, single-agent systems (SAS) can match or outperform MAS, yet…

Computation and Language · Computer Science 2026-04-14 Dat Tran , Douwe Kiela

Recent advancements in Large Language Model (LLM) agents have enabled complex multi-turn agentic tasks requiring extensive tool calling, where conversations can span dozens of API calls with increasingly large context windows. However,…

Computation and Language · Computer Science 2026-02-03 Elias Lumer , Faheem Nizar , Akshaya Jangiti , Kevin Frank , Anmol Gulati , Mandar Phadate , Vamse Kumar Subbiah

With the growing adoption of large language model agents in persistent real-world roles, they naturally encounter continuous streams of tasks. A key limitation, however, is their failure to learn from the accumulated interaction history,…

LLM agents are deployed in environments where they must interact to acquire information. In these scenarios, the agent must reason about inherent cost-uncertainty tradeoffs in how to act, such as when to stop exploring and commit to an…

Computation and Language · Computer Science 2026-05-19 Wenxuan Ding , Nicholas Tomlin , Greg Durrett

The current paradigm of test-time scaling relies on generating long reasoning traces ("thinking" more) before producing a response. In agent problems that require interaction, this can be done by generating thinking traces before acting in…

Agentic AI architectures augment LLMs with external tools, unlocking strong capabilities. However, tool use is not always beneficial; some calls may be redundant or even harmful. Effective tool use, therefore, hinges on a core LLM decision:…

Artificial Intelligence · Computer Science 2026-05-04 Qinyuan Wu , Soumi Das , Mahsa Amani , Arijit Nag , Seungeon Lee , Krishna P. Gummadi , Abhilasha Ravichander , Muhammad Bilal Zafar

Inference-time scaling has emerged as a powerful way to improve large language model (LLM) performance by generating multiple candidate responses and selecting among them. However, existing work on dynamic allocation for test-time compute…

Machine Learning · Computer Science 2025-09-15 Jenny Y. Huang , Mehul Damani , Yousef El-Kurdi , Ramon Astudillo , Wei Sun

Large language models (LLMs) have demonstrated remarkable capabilities across various natural language processing (NLP) scenarios, but they still face challenges when handling complex arithmetic and logical reasoning tasks. While…

Computation and Language · Computer Science 2025-04-11 Yuting Zeng , Weizhe Huang , Lei Jiang , Tongxuan Liu , Xitai Jin , Chen Tianying Tiana , Jing Li , Xiaohua Xu

While integrating tools like Code Interpreter and Search has significantly enhanced Large Language Model (LLM) reasoning in models like ChatGPT Agent and Gemini-Pro, practical guidance on optimal tool use is lacking. The core challenge is…

Computation and Language · Computer Science 2025-10-03 Yongchao Chen , Jiefeng Chen , Rui Meng , Ji Yin , Na Li , Chuchu Fan , Chi Wang , Tomas Pfister , Jinsung Yoon

Transformer based language models (LMs) demonstrate increasing performance with scale across a wide variety of tasks. Scale alone however cannot enable models to solve tasks that require access to ephemeral, changing, or private data that…

Computation and Language · Computer Science 2022-05-25 Aaron Parisi , Yao Zhao , Noah Fiedel

Recent deep-thinking large language models often reason extensively to improve performance, but such lengthy reasoning is not always desirable, as it incurs excessive inference costs with disproportionate performance gains. Controlling…

Computation and Language · Computer Science 2025-06-17 Junyan Li , Wenshuo Zhao , Yang Zhang , Chuang Gan

Planning under resource constraints is central to real-world decision making, yet most large language model (LLM) planners assume uniform action costs. We systematically analyze whether tree-search LLM planners are cost-aware and whether…

Artificial Intelligence · Computer Science 2026-01-13 Zihao Zhang , Hui Wei , Kenan Jiang , Shijia Pan , Shu Kai , Fei Liu

Tool-augmented reasoning has become a popular direction for LLM-based agents, and it is widely assumed to improve reasoning and reliability. However, we demonstrate that this consensus does not always hold: in the presence of semantic…

Artificial Intelligence · Computer Science 2026-05-04 Kaituo Zhang , Zhen Xiong , Mingyu Zhong , Zhimeng Jiang , Zhouyuan Yuan , Zhecheng Li , Ying Lin

Scaling test-time computation improves large language model performance without additional training. Recent work demonstrates that techniques such as repeated sampling, self-verification, and self-reflection can significantly enhance task…

Artificial Intelligence · Computer Science 2025-12-15 Dongwon Jung , Peng Shi , Yi Zhang

We present a multi-agent system where agents can cooperate to solve a system of dependent tasks, with agents having the capability to explore a solution space, make inferences, as well as query for information under a limited budget.…

Multiagent Systems · Computer Science 2024-05-21 Karishma , Shrisha Rao

Large Language Models (LLMs) have dramatically advanced AI applications, yet their deployment remains challenging due to their immense inference costs. Recent studies ameliorate the computational costs of LLMs by increasing their activation…

Machine Learning · Computer Science 2024-11-05 Donghyun Lee , Je-Yong Lee , Genghan Zhang , Mo Tiwari , Azalia Mirhoseini