English
Related papers

Related papers: SEAR: Schema-Based Evaluation and Routing for LLM …

200 papers

Query rewriting is essential for database performance optimization, but existing automated rule enumeration methods suffer from exponential search spaces, severe redundancy, and poor scalability, especially when handling complex query plans…

Databases · Computer Science 2026-03-09 Yuan Zhang , Yuxing Chen , Yuekun Yu , Jinbin Huang , Rui Mao , Anqun Pan , Lixiong Zheng , Jianbin Qin

Accurate Angle-of-arrival (AoA) estimation is essential for next-generation wireless communication systems to enable reliable beamforming, high-precision localization, and integrated sensing. Unfortunately, classical high-resolution…

Signal Processing · Electrical Eng. & Systems 2025-10-31 Shih-Kai Chou , Mengran Zhao , Cheng-Nan Hu , Kuang-Chung Chou , Carolina Fortuna , Jernej Hribar

Reranking is a critical component in recommender systems, playing an essential role in refining the output of recommendation algorithms. Traditional reranking models have focused predominantly on accuracy, but modern applications demand…

Information Retrieval · Computer Science 2025-02-04 Jingtong Gao , Bo Chen , Weiwen Liu , Xiangyang Li , Yichao Wang , Wanyu Wang , Huifeng Guo , Ruiming Tang , Xiangyu Zhao

Large Language Model (LLM) workloads have distinct prefill and decode phases with different compute and memory requirements which should ideally be accounted for when scheduling input queries across different LLM instances in a cluster.…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-08 Kunal Jain , Anjaly Parayil , Ankur Mallick , Esha Choukse , Xiaoting Qin , Jue Zhang , Íñigo Goiri , Rujia Wang , Chetan Bansal , Victor Rühle , Anoop Kulkarni , Steve Kofsky , Saravan Rajmohan

Large language models (LLMs) have demonstrated exceptional potential in complex reasoning,pioneering a new paradigm for autonomous agent decision making in dynamic settings. However, in Real-Time Strategy (RTS) scenarios, LLMs suffer from a…

Multiagent Systems · Computer Science 2026-03-26 Li Ma , Hao Peng , Yiming Wang , Hongbin Luo , Jie Liu , Kongjing Gu , Guanlin Wu , Hui Lin , Lei Ren

We present a readiness harness for LLM and RAG applications that turns evaluation into a deployment decision workflow. The system combines automated benchmarks, OpenTelemetry observability, and CI quality gates under a minimal API contract,…

Artificial Intelligence · Computer Science 2026-05-22 Alexandre Cristovão Maiorano

Modern large-scale ranking systems operate within a sophisticated landscape of competing objectives, operational constraints, and evolving product requirements. Progress in this domain is increasingly bottlenecked by the engineering context…

Artificial Intelligence · Computer Science 2026-05-26 Longfei Yun , Yihan Wu , Haoran Liu , Xiaoxuan Liu , Ziyun Xu , Yi Wang , Yang Xia , Pengfei Wang , Mingze Gao , Yunxiang Wang , Changfan Chen , Wenjie Fu , Hong Yan , Junfeng Pan

We demonstrate LLARS (LLM Assisted Research System), an open-source platform that bridges the gap between domain experts and developers for building LLM-based systems. It integrates three tightly connected modules into an end-to-end…

Artificial Intelligence · Computer Science 2026-05-12 Philipp Steigerwald , Mara Stieler , Jennifer Burghardt , Eric Rudolph , Jens Albrecht

The electric vehicle (EV) battery supply chain's vulnerability to disruptions necessitates advanced predictive analytics. We present SHIELD (Schema-based Hierarchical Induction for EV supply chain Disruption), a system integrating Large…

Artificial Intelligence · Computer Science 2024-10-23 Zhi-Qi Cheng , Yifei Dong , Aike Shi , Wei Liu , Yuzhi Hu , Jason O'Connor , Alexander G. Hauptmann , Kate S. Whitefoot

The development of Large Language Models (LLMs) has catalyzed automation in customer service, yet benchmarking their performance remains challenging. Existing benchmarks predominantly rely on static paradigms and single-dimensional metrics,…

Artificial Intelligence · Computer Science 2026-04-13 Ling Shi , Yuqin Dai , Ziyin Wang , Ning Gao , Wei Zhang , Chaozheng Wang , Yujie Wang , Wei He , Jinpeng Wang , Deiyi Xiong

Traffic signal control is a critical task in intelligent transportation systems, yet conventional fixed-time and rule-based methods often struggle to adapt to dynamic traffic demand and provide limited decision interpretability. This study…

Artificial Intelligence · Computer Science 2026-04-28 Jiazhao Shi

Automated Machine Learning (AutoML) approaches encompass traditional methods that optimize fixed pipelines for model selection and ensembling, as well as newer LLM-based frameworks that autonomously build pipelines. While LLM-based agents…

Artificial Intelligence · Computer Science 2024-10-23 Yizhou Chi , Yizhang Lin , Sirui Hong , Duyi Pan , Yaying Fei , Guanghao Mei , Bangbang Liu , Tianqi Pang , Jacky Kwok , Ceyao Zhang , Bang Liu , Chenglin Wu

Text-to-SQL enables users to interact with databases through natural language, simplifying access to structured data. Although highly capable large language models (LLMs) achieve strong accuracy for complex queries, they incur unnecessary…

Databases · Computer Science 2024-11-08 Mohammadhossein Malekpour , Nour Shaheen , Foutse Khomh , Amine Mhedhbi

Large language model (LLM) routing aims to exploit the specialized strengths of different LLMs for diverse tasks. However, existing approaches typically focus on selecting LLM architectures while overlooking parameter settings, which are…

Computation and Language · Computer Science 2026-01-12 Zihang Tian , Rui Li , Jingsen Zhang , Xiaohe Bo , Wei Huo , Xu Chen

Retrieval-Augmented Generation (RAG) significantly improves the performance of Large Language Models (LLMs) on knowledge-intensive tasks. However, varying response quality across LLMs under RAG necessitates intelligent routing mechanisms,…

Computation and Language · Computer Science 2025-10-20 Jiarui Zhang , Xiangyu Liu , Yong Hu , Chaoyue Niu , Fan Wu , Guihai Chen

Fine-tuning on task-specific data to boost downstream performance is a crucial step for leveraging Large Language Models (LLMs). However, previous studies have demonstrated that fine-tuning the models on several adversarial samples or even…

Machine Learning · Computer Science 2024-10-14 Han Shen , Pin-Yu Chen , Payel Das , Tianyi Chen

Large language models (LLMs) have demonstrated exceptional performance across a wide range of natural language tasks. However, selecting the optimal LLM to respond to a user query often necessitates a delicate balance between performance…

Artificial Intelligence · Computer Science 2025-06-24 Wei Song , Zhenya Huang , Cheng Cheng , Weibo Gao , Bihan Xu , GuanHao Zhao , Fei Wang , Runze Wu

Large language models (LLMs) exhibit substantial variability in performance and computational cost across tasks and queries, motivating routing systems that select models to meet user-specific cost-performance trade-offs. However, existing…

Computation and Language · Computer Science 2026-04-13 Hui Liu , Bin Zou , Kecheng Chen , Jie Liu , Wenya Wang , Haoliang Li

Tool-using LLM agents face a reliability-cost tradeoff: routing every decision through the LLM improves correctness but incurs high latency and inference cost, while pre-coded workflow graphs reduce cost but become brittle under…

Artificial Intelligence · Computer Science 2026-03-03 Neeraj Bholani

As the demand for more personalized recommendation grows and a dramatic boom in commercial scenarios arises, the study on multi-scenario recommendation (MSR) has attracted much attention, which uses the data from all scenarios to…

Information Retrieval · Computer Science 2025-08-26 Yuhao Wang , Yichao Wang , Zichuan Fu , Xiangyang Li , Xiangyu Zhao , Huifeng Guo , Ruiming Tang