English
Related papers

Related papers: Switchcraft: AI Model Router for Agentic Tool Call…

200 papers

This paper studies the next major bottleneck in agentic AI as system scaling, not only model scaling: the design of auditable, persistent, modular, and verifiable architectures around foundation models. We refer to this shift as scaling the…

Artificial Intelligence · Computer Science 2026-05-26 Shangding Gu

Large language models (LLMs) power many state-of-the-art systems in natural language processing. However, these models are extremely computationally expensive, even at inference time, raising the natural question: when is the extra cost of…

Machine Learning · Computer Science 2023-05-05 Deepak Narayanan , Keshav Santhanam , Peter Henderson , Rishi Bommasani , Tony Lee , Percy Liang

The rapid progress seen in terms of large-scale generative AI is largely based on the attention mechanism. It is conversely non-trivial to conceive small-scale applications for which attention-based architectures outperform traditional…

Machine Learning · Computer Science 2025-08-07 Claudius Gros

AI tasks differ in complexity and are best addressed with different computation strategies (e.g., combinations of models and decoding methods). Hence, an effective routing system that maps tasks to the appropriate strategies is crucial.…

Computation and Language · Computer Science 2025-12-11 Peter Baile Chen , Weiyue Li , Dan Roth , Michael Cafarella , Samuel Madden , Jacob Andreas

Large Language Models (LLMs) exhibit potential artificial generic intelligence recently, however, their usage is costly with high response latency. Given mixed LLMs with their own strengths and weaknesses, LLM routing aims to identify the…

Computation and Language · Computer Science 2025-02-27 Xinyuan Wang , Yanchi Liu , Wei Cheng , Xujiang Zhao , Zhengzhang Chen , Wenchao Yu , Yanjie Fu , Haifeng Chen

Large Language Models (LLMs) present a critical trade-off between inference quality and computational cost: larger models offer superior capabilities but incur significant latency, while smaller models are faster but less powerful. Existing…

Machine Learning · Computer Science 2025-05-13 Hang Wu , Jianian Zhu , Yinghui Li , Haojie Wang , Biao Hou , Jidong Zhai

We introduce AnyTool, a large language model agent designed to revolutionize the utilization of a vast array of tools in addressing user queries. We utilize over 16,000 APIs from Rapid API, operating under the assumption that a subset of…

Computation and Language · Computer Science 2024-02-07 Yu Du , Fangyun Wei , Hongyang Zhang

Agentic reinforcement learning has advanced large language models (LLMs) to reason through long chain-of-thought trajectories while interleaving external tool use. Existing approaches assume a fixed inventory of tools, limiting LLM agents'…

Computation and Language · Computer Science 2025-12-16 Jiaru Zou , Ling Yang , Yunzhe Qi , Sirui Chen , Mengting Ai , Ke Shen , Jingrui He , Mengdi Wang

Reasoning language models have demonstrated remarkable performance on many challenging tasks in math, science, and coding. Choosing the right reasoning model for practical deployment involves a performance and cost tradeoff at two key…

Artificial Intelligence · Computer Science 2026-03-12 Nigel Fernandez , Branislav Kveton , Ryan A. Rossi , Andrew S. Lan , Zichao Wang

Generative Artificial Intelligence (GenAI) has rapidly transformed various fields including code generation, text summarization, image generation and so on. Agentic AI is a recent evolution that further advances this by coupling the…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-10 Shiva Sai Krishna Anand Tokal , Vaibhav Jha , Anand Eswaran , Praveen Jayachandran , Yogesh Simmhan

Large language model (LLM) agents are moving beyond prompting alone. ChatGPT marked the rise of general-purpose LLM assistants, DeepSeek showed that on-policy reinforcement learning with verifiable rewards can improve reasoning and tool…

Outcome-driven reinforcement learning has advanced reasoning in large language models (LLMs), but prevailing tool-augmented approaches train a single, monolithic policy that interleaves thoughts and tool calls under full context; this…

Artificial Intelligence · Computer Science 2025-10-08 Zhuofeng Li , Haoxiang Zhang , Seungju Han , Sheng Liu , Jianwen Xie , Yu Zhang , Yejin Choi , James Zou , Pan Lu

Classification tasks play a fundamental role in various applications, spanning domains such as healthcare, natural language processing and computer vision. With the growing popularity and capacity of machine learning models, people can…

Computer Vision and Pattern Recognition · Computer Science 2025-02-26 Dujian Ding , Bicheng Xu , Laks V. S. Lakshmanan

Model routing is a simple technique for reducing the inference cost of large language models (LLMs), wherein one maintains a pool of candidate LLMs, and learns to route each prompt to the smallest feasible LLM. Existing works focus on…

With the rapid advancement of agent-based methods in recent years, Agentic RAG has undoubtedly become an important research direction. Multi-hop reasoning, which requires models to engage in deliberate thinking and multi-step interaction,…

Computation and Language · Computer Science 2026-02-24 Qijie You , Wenkai Yu , Wentao Zhang

Large language models (LLMs) deliver superior performance but require substantial computational resources and operate with relatively low efficiency, while smaller models can efficiently handle simpler tasks with fewer resources. LLM…

Databases · Computer Science 2025-12-01 Kai Mei , Wujiang Xu , Minghao Guo , Shuhang Lin , Yongfeng Zhang

Modern open-world agents such as OpenClaw exhibit powerful cross-environment execution capabilities yet introduce broad new safety risk sources. Meanwhile, advanced frontier AI models drastically lower attack barriers, rendering current…

Self-evolving agentic artificial intelligence (AI) offers a new paradigm for future wireless systems by enabling autonomous agents to continually adapt and improve without human intervention. Unlike static AI models, self-evolving agents…

Artificial Intelligence · Computer Science 2025-10-08 Changyuan Zhao , Ruichen Zhang , Jiacheng Wang , Dusit Niyato , Geng Sun , Xianbin Wang , Shiwen Mao , Abbas Jamalipour

Large language models (LLMs) have enabled a new class of agentic AI systems that reason, plan, and act by invoking external tools. However, most existing agentic architectures remain centralized and monolithic, limiting scalability,…

Computer Science and Game Theory · Computer Science 2026-02-04 Ya-Ting Yang , Quanyan Zhu

As modern artificial intelligence (AI) systems become more advanced and capable, they can leverage a wide range of tools and models to perform complex tasks. The task of orchestrating these models is increasingly performed by Large Language…

Artificial Intelligence · Computer Science 2026-04-20 Daria Smirnova , Hamid Nasiri , Marta Adamska , Zhengxin Yu , Peter Garraghan