English
Related papers

Related papers: Dynamic LLM Routing and Selection based on User Pr…

200 papers

The inherent capabilities of a language model (LM) and the reasoning strategies it employs jointly determine its performance in reasoning tasks. While test-time scaling is regarded as an effective approach to tackling complex reasoning…

Computation and Language · Computer Science 2025-05-27 Zhihong Pan , Kai Zhang , Yuze Zhao , Yupeng Han

Mathematical programming -- the task of expressing operations and decision-making problems in precise mathematical language -- is fundamental across domains, yet remains a skill-intensive process requiring operations research expertise.…

Building on advancements in Large Language Models (LLMs), we can tackle complex analytical and mathematical reasoning tasks requiring nuanced contextual understanding. A prime example of such complex tasks is modelling resource allocation…

Networking and Internet Architecture · Computer Science 2025-12-02 Tasnim Ahmed , Siana Rizwan , Naveed Ejaz , Salimur Choudhury

While reasoning-augmented large language models (RLLMs) significantly enhance complex task performance through extended reasoning chains, they inevitably introduce substantial unnecessary token consumption, particularly for simpler problems…

Computation and Language · Computer Science 2025-05-28 Yang He , Xiao Ding , Bibo Cai , Yufei Zhang , Kai Xiong , Zhouhao Sun , Bing Qin , Ting Liu

Despite the rapid development of large language models (LLMs), a fundamental challenge persists: the lack of high-quality optimization modeling datasets hampers LLMs' robust modeling of practical optimization problems from natural language…

Artificial Intelligence · Computer Science 2025-02-24 Hongliang Lu , Zhonglin Xie , Yaoyu Wu , Can Ren , Yuxuan Chen , Zaiwen Wen

The proliferation of large language models (LLMs) with varying computational costs and performance profiles presents a critical challenge for scalable, cost-effective deployment in real-world applications. We introduce a unified routing…

Recent progress in Language Models (LMs) has dramatically advanced the field of natural language processing (NLP), excelling at tasks like text generation, summarization, and question answering. However, their inference remains…

Machine Learning · Computer Science 2025-06-10 Adarsh Prasad Behera , Jaya Prakash Champati , Roberto Morabito , Sasu Tarkoma , James Gross

Optimization problems seek to find the best solution to an objective under a set of constraints, and have been widely investigated in real-world applications. Modeling and solving optimization problems in a specific domain typically require…

Optimization and Control · Mathematics 2024-07-12 Jihai Zhang , Wei Wang , Siyan Guo , Li Wang , Fangquan Lin , Cheng Yang , Wotao Yin

Large language models (LLMs) have been widely adopted due to their remarkable performance across various applications, driving the accelerated development of a large number of diverse models. However, these individual LLMs show limitations…

Computation and Language · Computer Science 2025-06-13 Kaushal Kumar Maurya , KV Aditya Srivatsa , Ekaterina Kochmar

Large language models (LLMs) have exhibited their problem-solving abilities in mathematical reasoning. Solving realistic optimization (OPT) problems in application scenarios requires advanced and applied mathematics ability. However,…

Machine Learning · Computer Science 2025-06-05 Zhicheng Yang , Yiwei Wang , Yinya Huang , Zhijiang Guo , Wei Shi , Xiongwei Han , Liang Feng , Linqi Song , Xiaodan Liang , Jing Tang

LLMs now tackle a wide range of software-related tasks, yet we show that their performance varies markedly both across and within these tasks. Routing user queries to the appropriate LLMs can therefore help improve response quality while…

Software Engineering · Computer Science 2025-11-13 Adam Štorek , Vikas Upadhyay , Marianne Menglin Liu , Daniel W. Peterson , Anshul Mittal , Sujeeth Bharadwaj , Fahad Shah , Dan Roth

The rapid growth of large language models (LLMs) with diverse capabilities, latency and computational costs presents a critical deployment challenge: selecting the most suitable model for each prompt to optimize the trade-off between…

Computation and Language · Computer Science 2025-10-03 Shubham Agrawal , Prasang Gupta

LLM routing aims to select the most appropriate model for each query, balancing competing performance metrics such as accuracy and cost across a pool of language models. Prior approaches typically adopt a decoupled strategy, where the…

Artificial Intelligence · Computer Science 2026-01-05 Asterios Tsiourvas , Wei Sun , Georgia Perakis

Online ride-hailing platforms aim to deliver efficient mobility-on-demand services, often facing challenges in balancing dynamic and spatially heterogeneous supply and demand. Existing methods typically fall into two categories:…

Artificial Intelligence · Computer Science 2025-10-28 Yi Zhang , Yushen Long , Yun Ni , Liping Huang , Xiaohong Wang , Jun Liu

The rapid evolution of Large Language Models (LLMs) has markedly expanded their application across diverse domains, transforming how complex problems are approached and solved. Initially conceived to predict subsequent words in texts, these…

Artificial Intelligence · Computer Science 2024-07-11 Sumedh Rasal , E. J. Hauer

By virtue of its great utility in solving real-world problems, optimization modeling has been widely employed for optimal decision-making across various sectors, but it requires substantial expertise from operations research professionals.…

The development of autonomous vehicles has brought a great impact and changes to the transportation industry, offering numerous benefits in terms of safety and efficiency. However, one of the key challenges that autonomous driving faces is…

Robotics · Computer Science 2023-08-03 Wen Wei , Jiankun Wang

Large Language Models (LLMs) deliver state-of-the-art performance across many tasks but impose high computational and memory costs, limiting their deployment in resource-constrained or real-time settings. To address this, we propose…

Computation and Language · Computer Science 2025-11-14 Nikunj Gupta , Bill Guo , Rajgopal Kannan , Viktor K. Prasanna

Routing problems are common in mobile robotics, encompassing tasks such as inspection, surveillance, and coverage. Depending on the objective and constraints, these problems often reduce to variants of the Traveling Salesman Problem (TSP),…

Computation and Language · Computer Science 2024-08-08 Zhehui Huang , Guangyao Shi , Gaurav S. Sukhatme

Large language model (LLM) routing has emerged as a crucial strategy for balancing computational costs with performance by dynamically assigning queries to the most appropriate model based on query complexity. Despite recent advances…

Computation and Language · Computer Science 2025-04-11 Aly M. Kassem , Bernhard Schölkopf , Zhijing Jin