English
Related papers

Related papers: Budget-Aware Tool-Use Enables Effective Agent Scal…

200 papers

Modern large language models (LLMs) increasingly rely on inference-time planning and external tools to improve reasoning. We benchmark this behavior on two real-world settings: event-centric question answering over graph-structured…

Computation and Language · Computer Science 2026-03-06 Subha Ghoshal , Ali Al-Bustami

Recently using machine learning (ML) based techniques to optimize modern database management systems has attracted intensive interest from both industry and academia. With an objective to tune a specific component of a DBMS (e.g., index…

Databases · Computer Science 2023-03-13 Xinyi Zhang , Zhuo Chang , Hong Wu , Yang Li , Jia Chen , Jian Tan , Feifei Li , Bin Cui

Effective automation hinges on deciding when to act and when to escalate. We model this as a decision under uncertainty: an LLM forms a prediction, estimates its probability of being correct, and compares the expected costs of acting and…

Machine Learning · Computer Science 2026-04-13 Matthew DosSantos DiSorbo , Harang Ju

Recent breakthroughs in large language model-driven autonomous agents have revealed that multi-agent collaboration often surpasses each individual through collective reasoning. Inspired by the neural scaling law--increasing neurons enhances…

Artificial Intelligence · Computer Science 2025-03-18 Chen Qian , Zihao Xie , YiFei Wang , Wei Liu , Kunlun Zhu , Hanchen Xia , Yufan Dang , Zhuoyun Du , Weize Chen , Cheng Yang , Zhiyuan Liu , Maosong Sun

Tool-using agents based on Large Language Models (LLMs) excel in tasks such as mathematical reasoning and multi-hop question answering. However, in long trajectories, agents often trigger excessive and low-quality tool calls, increasing…

Artificial Intelligence · Computer Science 2026-03-25 Zeping Li , Hongru Wang , Yiwen Zhao , Guanhua Chen , Yixia Li , Keyang Chen , Yixin Cao , Guangnan Ye , Hongfeng Chai , Zhenfei Yin

Test-time scaling (TTS) improves large language models (LLMs) by allocating additional compute at inference time. In practice, TTS is often achieved through parallel scaling: generating multiple candidate responses and selecting the best…

Machine Learning · Computer Science 2026-04-22 Divya Shyamal , Marta Knežević , Lan Tran , Chanakya Ekbote , Vijay Lingam , Paul Pu Liang

Tool use has turned large language models (LLMs) into powerful agents that can perform complex multi-step tasks by dynamically utilising external software components. However, these tools must be implemented in advance by human developers,…

Computation and Language · Computer Science 2025-06-02 Georg Wölflein , Dyke Ferber , Daniel Truhn , Ognjen Arandjelović , Jakob Nikolas Kather

Open-source pre-trained Large Language Models (LLMs) exhibit strong language understanding and generation capabilities, making them highly successful in a variety of tasks. However, when used as agents for dealing with complex problems in…

Computation and Language · Computer Science 2024-04-01 Qinhao Zhou , Zihan Zhang , Xiang Xiang , Ke Wang , Yuchuan Wu , Yongbin Li

Effective prompt design is essential for improving the planning capabilities of large language model (LLM)-driven agents. However, existing structured prompting strategies are typically limited to single-agent, plan-only settings, and often…

Artificial Intelligence · Computer Science 2025-07-08 Bruce Yang , Xinfeng He , Huan Gao , Yifan Cao , Xiaofan Li , David Hsu

Scaling test-time compute through extended chains of thought has become a dominant paradigm for improving large language model reasoning. However, existing research implicitly assumes that longer thinking always yields better results. This…

Artificial Intelligence · Computer Science 2026-04-14 Shu Zhou , Rui Ling , Junan Chen , Xin Wang , Tao Fan , Hao Wang

Large Language Models (LLMs) have demonstrated remarkable progress in reasoning across diverse domains. However, effective reasoning in real-world tasks requires adapting the reasoning strategy to the demands of the problem, ranging from…

Computation and Language · Computer Science 2025-08-19 Xinda Jia , Jinpeng Li , Zezhong Wang , Jingjing Li , Xingshan Zeng , Yasheng Wang , Weinan Zhang , Yong Yu , Weiwen Liu

A flurry of recent work has demonstrated that pre-trained large language models (LLMs) can be effective task planners for a variety of single-robot tasks. The planning performance of LLMs is significantly improved via prompting techniques,…

Robotics · Computer Science 2024-03-25 Yongchao Chen , Jacob Arkin , Yang Zhang , Nicholas Roy , Chuchu Fan

Advanced agentic intelligence is a prerequisite for deploying Large Language Models in practical, real-world applications. Diverse real-world APIs demand precise, robust function-calling intelligence, which needs agents to develop these…

Scaling test-time compute has emerged as an effective strategy for improving the performance of large language models. However, existing methods typically allocate compute uniformly across all queries, overlooking variation in query…

Artificial Intelligence · Computer Science 2026-04-24 Bowen Zuo , Yinglun Zhu

Agent harnesses increasingly determine the performance of language-model systems by deciding how models call tools, receive feedback, verify intermediate states, store memory, and revise solutions. Yet current test-time scaling analyses…

Computation and Language · Computer Science 2026-05-29 Xuanliang Zhang , Dingzirui Wang , Keyan Xu , Qingfu Zhu , Wanxiang Che

The advances made by Large Language Models (LLMs) have led to the pursuit of LLM agents that can solve intricate, multi-step reasoning tasks. As with any research pursuit, benchmarking and evaluation are key corner stones to efficient and…

Artificial Intelligence · Computer Science 2024-04-10 Luca Gioacchini , Giuseppe Siracusano , Davide Sanvito , Kiril Gashteovski , David Friede , Roberto Bifulco , Carolin Lawrence

Tool use enables large language models (LLMs) to access external information, invoke software systems, and act in digital environments beyond what can be solved from model parameters alone. Early research mainly studied whether a model…

Large Language Models (LLMs) are now integral to numerous industries, increasingly serving as the core reasoning engine for autonomous agents that perform complex tasks through tool-use. While the development of Arabic-native LLMs is…

Artificial Intelligence · Computer Science 2026-01-09 Konstantin Kubrak , Ahmed El-Moselhy , Ammar Alsulami , Remaz Altuwaim , Hassan Ismail Fawaz , Faisal Alsaby

Recent advancements in tool-equipped Agents (LLMs) have enabled complex tasks like secure database interactions and multi-agent code development. However, scaling tool capacity beyond agent reasoning or model limits remains a challenge. In…

Computation and Language · Computer Science 2024-10-23 Elias Lumer , Vamse Kumar Subbiah , James A. Burke , Pradeep Honaganahalli Basavaraju , Austin Huber

Language models (LMs) are becoming increasingly dependent on external tools. LM-based agentic frameworks frequently interact with their environment via such tools to search files, run code, call APIs, etc. Further, modern reasoning-based…

Programming Languages · Computer Science 2025-12-19 Daniel Nichols , Prajwal Singhania , Charles Jekel , Abhinav Bhatele , Harshitha Menon