English
Related papers

Related papers: Task-Aware LLM Routing with Multi-Level Task-Profi…

200 papers

Large Language Models (LLMs) present a critical trade-off between inference quality and computational cost: larger models offer superior capabilities but incur significant latency, while smaller models are faster but less powerful. Existing…

Machine Learning · Computer Science 2025-05-13 Hang Wu , Jianian Zhu , Yinghui Li , Haojie Wang , Biao Hou , Jidong Zhai

This study introduces intelligent frameworks that use Large Language Models (LLMs) to improve task scheduling for construction robots. The LLM is fed with key data about the desired task, such as agent action abilities, and the desired end…

Robotics · Computer Science 2026-05-18 Swayamjit Saha , Subhabrata Das , Haonan Duan , Xiao-Yang Liu

LLMs now tackle a wide range of software-related tasks, yet we show that their performance varies markedly both across and within these tasks. Routing user queries to the appropriate LLMs can therefore help improve response quality while…

Software Engineering · Computer Science 2025-11-13 Adam Štorek , Vikas Upadhyay , Marianne Menglin Liu , Daniel W. Peterson , Anshul Mittal , Sujeeth Bharadwaj , Fahad Shah , Dan Roth

Recent research has highlighted the potential of large language models (LLMs) to improve their problem-solving capabilities with the aid of suitable external tools. In our work, we further advance this concept by introducing a closed-loop…

Machine Learning · Computer Science 2024-03-12 Tianle Cai , Xuezhi Wang , Tengyu Ma , Xinyun Chen , Denny Zhou

Large Language Models (LLMs) have achieved remarkable success across a wide range of tasks, but serving them efficiently at scale remains a critical challenge due to their substantial computational and latency demands. While most existing…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-04 Yifan Sun , Gholamreza Haffari , Minxian Xu , Rajkumar Buyya , Adel N. Toosi

Large language model (LLM) routers improve the efficiency of multi-model systems by directing each query to the most appropriate model while leveraging the diverse strengths of heterogeneous LLMs. Most existing approaches frame routing as a…

Computation and Language · Computer Science 2025-10-23 Canbin Huang , Tianyuan Shi , Yuhua Zhu , Ruijun Chen , Xiaojun Quan

Large language models (LLMs) are being rapidly integrated into decision-support tools, automation workflows, and AI-enabled software systems. However, their behavior in production environments remains poorly understood, and their failure…

Artificial Intelligence · Computer Science 2025-11-27 Vaishali Vinay

The rapidly growing number and variety of Large Language Models (LLMs) present significant challenges in efficiently selecting the appropriate LLM for a given query, especially considering the trade-offs between performance and…

Artificial Intelligence · Computer Science 2025-03-18 Tao Feng , Yanzhen Shen , Jiaxuan You

LLMs with superior response quality--particularly larger or closed-source models--often come with higher inference costs, making their deployment inefficient and costly. Meanwhile, developing foundational LLMs from scratch is becoming…

Computation and Language · Computer Science 2024-10-03 Alireza Mohammadshahi , Arshad Rafiq Shaikh , Majid Yazdani

Large language models have achieved remarkable success in various tasks but suffer from high computational costs during inference, limiting their deployment in resource-constrained applications. To address this issue, we propose a novel…

Computation and Language · Computer Science 2025-09-11 Wenhao Zheng , Yixiao Chen , Weitong Zhang , Souvik Kundu , Yun Li , Zhengzhong Liu , Eric P. Xing , Hongyi Wang , Huaxiu Yao

In this work, we introduce SMART-LLM, an innovative framework designed for embodied multi-robot task planning. SMART-LLM: Smart Multi-Agent Robot Task Planning using Large Language Models (LLMs), harnesses the power of LLMs to convert…

Robotics · Computer Science 2024-03-26 Shyam Sundar Kannan , Vishnunandan L. N. Venkatesh , Byung-Cheol Min

Effective document reranking is essential for improving search relevance across diverse applications. While Large Language Models (LLMs) excel at reranking due to their deep semantic understanding and reasoning, their high computational…

Computation and Language · Computer Science 2025-10-03 Dimitar Peshevski , Kiril Blazhevski , Martin Popovski , Gjorgji Madjarov

Large language models (LLMs) excel in most NLP tasks but also require expensive cloud servers for deployment due to their size, while smaller models that can be deployed on lower cost (e.g., edge) devices, tend to lag behind in terms of…

Typical multi-task learning (MTL) methods rely on architectural adjustments and a large trainable parameter set to jointly optimize over several tasks. However, when the number of tasks increases so do the complexity of the architectural…

Computer Vision and Pattern Recognition · Computer Science 2019-03-29 Gjorgji Strezoski , Nanne van Noord , Marcel Worring

Pretrained language models have become the standard approach for many NLP tasks due to strong performance, but they are very expensive to train. We propose a simple and efficient learning framework, TLM, that does not rely on large-scale…

Computation and Language · Computer Science 2022-07-25 Xingcheng Yao , Yanan Zheng , Xiaocong Yang , Zhilin Yang

Tool calling has become increasingly popular for Large Language Models (LLMs). However, for large tool sets, the resulting tokens would exceed the LLM's context window limit, making it impossible to include every tool. Hence, an external…

Computation and Language · Computer Science 2026-03-03 Saptarshi Sengupta , Zhengyu Zhou , Jun Araki , Xingbo Wang , Bingqing Wang , Suhang Wang , Zhe Feng

Routing large language models (LLMs) is a new paradigm that uses a router to recommend the best LLM from a pool of candidates for a given input. In this paper, our comprehensive analysis with more than 8,500 LLMs reveals a novel model-level…

Computation and Language · Computer Science 2025-05-21 Zhongzhan Huang , Guoming Ling , Yupei Lin , Yandong Chen , Shanshan Zhong , Hefeng Wu , Liang Lin

The lack of training data gives rise to the system cold-start problem in recommendation systems, making them struggle to provide effective recommendations. To address this problem, Large Language Models (LLMs) can model recommendation tasks…

Information Retrieval · Computer Science 2024-12-25 Wenlin Zhang , Chuhan Wu , Xiangyang Li , Yuhao Wang , Kuicai Dong , Yichao Wang , Xinyi Dai , Xiangyu Zhao , Huifeng Guo , Ruiming Tang

Multimodal large language models (MLLMs) have heterogeneous strengths across OCR, chart understanding, spatial reasoning, visual question answering, cost, and latency. Effective MLLM routing therefore requires more than estimating query…

Artificial Intelligence · Computer Science 2026-05-13 Xueqi Cheng , Yushun Dong

We study the problem of routing queries to large language models (LLMs) under cost, GPU resources, and concurrency constraints. Prior per-query routing methods often fail to control batch-level cost, especially under non-uniform or…

Machine Learning · Computer Science 2026-03-31 Jelena Markovic-Voronov , Kayhan Behdin , Yuanda Xu , Zhengze Zhou , Zhipeng Wang , Rahul Mazumder