English
Related papers

Related papers: TRACER: Trace-Based Adaptive Cost-Efficient Routin…

200 papers

Template-based discriminative trackers are currently the dominant tracking methods due to their robustness and accuracy, and the Siamese-network-based methods that depend on cross-correlation operation between features extracted from…

Computer Vision and Pattern Recognition · Computer Science 2021-05-11 Moju Zhao , Kei Okada , Masayuki Inaba

Large Language Models (LLMs) often generate code with subtle but critical bugs, especially for complex tasks. Existing automated repair methods typically rely on superficial pass/fail signals, offering limited visibility into program…

Software Engineering · Computer Science 2026-02-09 Jiangping Huang , Wenguang Ye , Weisong Sun , Jian Zhang , Mingyue Zhang , Yang Liu

Efficiently routing queries to the optimal large language model (LLM) is crucial for optimizing the cost-performance trade-off in multi-model systems. However, most existing routers rely on single-model selection, making them susceptible to…

Machine Learning · Computer Science 2026-03-10 Sai Hao , Hao Zeng , Hongxin Wei , Bingyi Jing

Inference-time compute scaling has emerged as a powerful technique for improving the reliability of large language model (LLM) agents, but existing methods apply compute uniformly: every decision step receives the same budget regardless of…

Artificial Intelligence · Computer Science 2026-04-10 Khushal Sethi

Large Language Models (LLMs) deployed in agentic environments must exercise multiple capabilities across different task instances, where a capability is performing one or more actions in a trajectory that are necessary for successfully…

Artificial Intelligence · Computer Science 2026-04-08 Hangoo Kang , Tarun Suresh , Jon Saad-Falcon , Azalia Mirhoseini

Autoregressive decoding in Large Language Models (LLMs) generates one token per step, causing high inference latency. Speculative decoding (SD) mitigates this through a guess-and-verify strategy, but existing training-free variants face…

Computation and Language · Computer Science 2026-04-17 Zihong Zhang , Zuchao Li , Lefei Zhang , Ping Wang , Hai Zhao

Context: AI coding agents route every task to a single frontier large language model (LLM), paying premium inference cost even when many tasks are routine. Objectives: We propose Triage, a framework that uses code health metrics --…

Software Engineering · Computer Science 2026-04-10 Lech Madeyski

Data contamination is a known threat to the reliability of model evaluation. However, it remains underexplored in code large language models (LLMs), where contamination often goes beyond exact duplication. We present TRACER, a…

Software Engineering · Computer Science 2026-05-26 Yifeng Di , Xuliang Huang , Tianyi Zhang

Programs with constraints are hard to debug. In this paper, we describe a general architecture to help develop new debugging tools for constraint programming. The possible tools are fed by a single general-purpose tracer. A tracer-driver is…

Software Engineering · Computer Science 2007-05-23 Ludovic Langevine , Mireille Ducasse

Deploying LLMs raises two coupled challenges: (1) monitoring--estimating where a model underperforms as traffic and domains drift--and (2) improvement--prioritizing data acquisition to close the largest performance gaps. We test whether an…

Computation and Language · Computer Science 2026-05-27 Pedro Memoli Buffa , Luciano Del Corro

The proliferation of Large Language Models (LLMs) with varying capabilities and costs has created a need for efficient model selection in AI systems. LLM routers address this need by dynamically choosing the most suitable model for a given…

Machine Learning · Computer Science 2024-10-30 Zesen Zhao , Shuowei Jin , Z. Morley Mao

Spaced repetition systems are fundamental to efficient learning and memory retention, but existing algorithms often struggle with semantic interference and personalized adaptation. We present LECTOR (\textbf{L}LM-\textbf{E}nhanced…

Computation and Language · Computer Science 2025-08-06 Jiahao Zhao

Clinical decision support tools built on electronic health records often experience performance drift due to temporal population shifts, particularly when changes in the clinical environment initially affect only a subset of patients,…

Machine Learning · Computer Science 2025-12-16 Mengying Yan , Ziye Tian , Siqi Li , Nan Liu , Benjamin A. Goldstein , Molei Liu , Chuan Hong

The rapid proliferation of Large Language Models (LLMs) has led to a fragmented and inefficient ecosystem, a state of ``model lock-in'' where seamlessly integrating novel models remains a significant bottleneck. Current routing frameworks…

Machine Learning · Computer Science 2026-01-13 Cheng Yan , Wuyang Zhang , Zhiyuan Ning , Fan Xu , Ziyang Tao , Lu Zhang , Bing Yin , Yanyong Zhang

Multimodal large language models increasingly solve vision-centric tasks by calling external tools for visual inspection, OCR, retrieval, calculation, and multi-step reasoning. Current tool-using agents usually expose the executed tool…

Computation and Language · Computer Science 2026-05-12 Bihui Yu , Caijun Jia , Jing Chi , Xiaohan Liu , Yining Wang , He Bai , Yuchen Liu , Jingxuan Wei , Junnan Zhu

Modern transformer models exhibit phase transitions during training, distinct shifts from memorisation to abstraction, but the mechanisms underlying these transitions remain poorly understood. Prior work has often focused on endpoint…

Computation and Language · Computer Science 2025-05-26 Nura Aljaafari , Danilo S. Carvalho , André Freitas

Despite their capabilities, large foundation models (LFMs) remain susceptible to adversarial manipulation. Current defenses predominantly rely on the "locality hypothesis", suppressing isolated neurons or features. However, harmful…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Chuancheng Shi , Shangze Li , Wenjun Lu , Wenhua Wu , Cong Wang , Zifeng Cheng , Fei Shen , Tat-Seng Chua

LLM providers typically offer multiple LLM tiers, varying in performance and price. As NLP tasks become more complex and modularized, selecting the suitable LLM tier for each subtask is a key challenge to balance between cost and…

Computation and Language · Computer Science 2025-05-30 Injae Na , Keonwoong Noh , Woohwan Jung

Reasoning-capable large language models (LLMs) have recently been adopted as automated judges, but their benefits and costs in LLM-as-a-Judge settings remain unclear. Through controlled comparisons between reasoning and non-reasoning…

Artificial Intelligence · Computer Science 2026-05-12 Wenbo Zhang , Lijinghua Zhang , Liner Xiang , Hengrui Cai

Large language models (LLMs) deliver superior performance but require substantial computational resources and operate with relatively low efficiency, while smaller models can efficiently handle simpler tasks with fewer resources. LLM…

Databases · Computer Science 2025-12-01 Kai Mei , Wujiang Xu , Minghao Guo , Shuhang Lin , Yongfeng Zhang