English
Related papers

Related papers: LLM Routing as Reasoning: A MaxSAT View

200 papers

One of the long-standing goals in optimisation and constraint programming is to describe a problem in natural language and automatically obtain an executable, efficient model. Large language models appear to bring this vision closer,…

Artificial Intelligence · Computer Science 2025-11-20 Alessio Pellegrino , Jacopo Mauro

Large language model (LLM) routing has emerged as a crucial strategy for balancing computational costs with performance by dynamically assigning queries to the most appropriate model based on query complexity. Despite recent advances…

Computation and Language · Computer Science 2025-04-11 Aly M. Kassem , Bernhard Schölkopf , Zhijing Jin

Travel behavior prediction is a core problem in transportation demand management and is traditionally addressed using numerical models calibrated on observed data. With recent advances in large language models (LLMs), new opportunities have…

Machine Learning · Computer Science 2026-03-12 Baichuan Mo , Hanyong Xu , Ruoyun Ma , Jung-Hoon Cho , Dingyi Zhuang , Xiaotong Guo , Jinhua Zhao

In language tasks that require extensive human--model interaction, deploying a single "best" model for every query can be expensive. To reduce inference cost while preserving the quality of the responses, a large language model (LLM) router…

Machine Learning · Computer Science 2025-12-24 Yichi Zhang , Fangzheng Xie , Shu Yang , Chong Wu

Rule-based adaptation is a foundational approach to self-adaptation, characterized by its human readability and rapid response. However, building high-performance and robust adaptation rules is often a challenge because it essentially…

Computation and Language · Computer Science 2024-07-03 Yusei Ishimizu , Jialong Li , Jinglue Xu , Jinyu Cai , Hitoshi Iba , Kenji Tei

Large Language Models (LLMs) have recently demonstrated impressive capabilities across various real-world applications. However, due to the current text-in-text-out paradigm, it remains challenging for LLMs to handle dynamic and complex…

Artificial Intelligence · Computer Science 2024-10-25 Timothy Wei , Annabelle Miin , Anastasia Miin

Configuration optimization remains a critical bottleneck in machine learning, requiring coordinated tuning across model architecture, training strategy, feature engineering, and hyperparameters. Traditional approaches treat these dimensions…

Artificial Intelligence · Computer Science 2025-08-22 Yuxing Lu , Yucheng Hu , Nan Sun , Xukai Zhao

Imposing constraints on machine translation systems presents a challenging issue because these systems are not trained to make use of constraints in generating adequate, fluent translations. In this paper, we leverage the capabilities of…

Computation and Language · Computer Science 2024-07-19 Pengcheng Huang , Yongyu Mu , Yuzhang Wu , Bei Li , Chunyang Xiao , Tong Xiao , Jingbo Zhu

Large language models (LLMs) exhibit impressive capabilities across a wide range of tasks, yet the choice of which model to use often involves a trade-off between performance and cost. More powerful models, though effective, come with…

Machine Learning · Computer Science 2025-02-25 Isaac Ong , Amjad Almahairi , Vincent Wu , Wei-Lin Chiang , Tianhao Wu , Joseph E. Gonzalez , M Waleed Kadous , Ion Stoica

Large language models (LLMs) have demonstrated exceptional performance across a wide range of natural language tasks. However, selecting the optimal LLM to respond to a user query often necessitates a delicate balance between performance…

Artificial Intelligence · Computer Science 2025-06-24 Wei Song , Zhenya Huang , Cheng Cheng , Weibo Gao , Bihan Xu , GuanHao Zhao , Fei Wang , Runze Wu

Conversational Recommender Systems (CRSs) leverage natural language interactions for personalized recommendation, yet information-scarce dialogue histories and single-turn recommendation paradigms may severely hinder accurate modeling of…

Information Retrieval · Computer Science 2026-04-07 Xingyuan Xiang , Xiangchen Pan , Wei Wei

Deploying large language models (LLMs) in edge-cloud environments requires an efficient routing strategy to balance cost and response quality. Traditional approaches prioritize either human-preference data or accuracy metrics from benchmark…

Networking and Internet Architecture · Computer Science 2025-02-18 Tuo Zhang , Asal Mehradfar , Dimitrios Dimitriadis , Salman Avestimehr

A critical factor in the success of decision support systems is the accurate modeling of user preferences. Psychology research has demonstrated that users often develop their preferences during the elicitation process, highlighting the…

Human-Computer Interaction · Computer Science 2024-10-03 Connor Lawless , Jakob Schoeffer , Lindy Le , Kael Rowan , Shilad Sen , Cristina St. Hill , Jina Suh , Bahareh Sarrafzadeh

Recent advancements in explainable recommendation have greatly bolstered user experience by elucidating the decision-making rationale. However, the existing methods actually fail to provide effective feedback signals for potentially better…

Information Retrieval · Computer Science 2025-08-08 Jiakai Tang , Jingsen Zhang , Zihang Tian , Xueyang Feng , Lei Wang , Xu Chen

With the rapid development of LLMs, it is natural to ask how to harness their capabilities efficiently. In this paper, we explore whether it is feasible to direct each input query to a single most suitable LLM. To this end, we propose LLM…

Computation and Language · Computer Science 2024-05-02 KV Aditya Srivatsa , Kaushal Kumar Maurya , Ekaterina Kochmar

While previous chapters focused on recommendation systems (RSs) based on standardized, non-verbal user feedback such as purchases, views, and clicks -- the advent of LLMs has unlocked the use of natural language (NL) interactions for…

With the rapid proliferation of large language models (LLMs) -- each optimized for different strengths, style, or latency/cost profile -- routing has become an essential technique to operationalize the use of different models. However,…

Computation and Language · Computer Science 2025-06-23 Co Tran , Salman Paracha , Adil Hafeez , Shuguang Chen

LLMs now tackle a wide range of software-related tasks, yet we show that their performance varies markedly both across and within these tasks. Routing user queries to the appropriate LLMs can therefore help improve response quality while…

Software Engineering · Computer Science 2025-11-13 Adam Štorek , Vikas Upadhyay , Marianne Menglin Liu , Daniel W. Peterson , Anshul Mittal , Sujeeth Bharadwaj , Fahad Shah , Dan Roth

A key challenge in transportation planning is that the collective preferences of heterogeneous travelers often diverge from the policies produced by model-driven decision tools. This misalignment frequently results in implementation delays…

Computers and Society · Computer Science 2025-10-29 Xiaoyu Yan , Tianxing Dai , Yu Marco Nie

Multimodal large language models (MLLMs) have heterogeneous strengths across OCR, chart understanding, spatial reasoning, visual question answering, cost, and latency. Effective MLLM routing therefore requires more than estimating query…

Artificial Intelligence · Computer Science 2026-05-13 Xueqi Cheng , Yushun Dong