English
Related papers

Related papers: CyclicJudge: Mitigating Judge Bias Efficiently in …

200 papers

Test-time scaling for code generation commonly relies on Best-of-N selection, in which multiple candidate solutions are sampled from a base model, and the best one is selected by an LLM judge. However, training reliable LLM judges is…

Machine Learning · Computer Science 2026-02-02 Peijia Qin , Ruiyi Zhang , Qi Cao , Pengtao Xie

Large Language Models (LLMs) are increasingly used to evaluate information retrieval (IR) systems, generating relevance judgments traditionally made by human assessors. Recent empirical studies suggest that LLM-based evaluations often align…

Information Retrieval · Computer Science 2026-01-21 Laura Dietz , Oleg Zendel , Peter Bailey , Charles Clarke , Ellese Cotterill , Jeff Dalton , Faegheh Hasibi , Mark Sanderson , Nick Craswell

As Large Language Models (LLMs) are increasingly adopted as automated judges in benchmarking and reward modeling, ensuring their reliability, efficiency, and robustness has become critical. In this work, we present a systematic comparison…

Artificial Intelligence · Computer Science 2026-05-12 Pratik Jayarao , Himanshu Gupta , Neeraj Varshney , Chaitanya Dwivedi

Using Large Language Models (LLMs) for relevance assessments offers promising opportunities to improve Information Retrieval (IR), Natural Language Processing (NLP), and related fields. Indeed, LLMs hold the promise of allowing IR…

Large Language Model (LLM) based judges form the underpinnings of key safety evaluation processes such as offline benchmarking, automated red-teaming, and online guardrailing. This widespread requirement raises the crucial question: can we…

Machine Learning · Computer Science 2025-03-07 Francisco Eiras , Eliott Zemour , Eric Lin , Vaikkunth Mugunthan

Large Language Models (LLMs) have demonstrated notable capabilities across various tasks, showcasing complex problem-solving abilities. Understanding and executing complex rules, along with multi-step planning, are fundamental to logical…

Artificial Intelligence · Computer Science 2024-10-15 Jiayi Gui , Yiming Liu , Jiale Cheng , Xiaotao Gu , Xiao Liu , Hongning Wang , Yuxiao Dong , Jie Tang , Minlie Huang

Multi-constraint instruction following requires verifying whether a response satisfies multiple individual requirements, yet LLM judges are often assessed only through overall-response judgments. We introduce MCJudgeBench, a benchmark for…

Computation and Language · Computer Science 2026-05-06 Jaeyun Lee , Junyoung Koh , Zeynel Tok , Hunar Batra , Ronald Clark

Evaluating large language models increasingly relies on LLM-as-a-judge protocols, but such evaluations remain costly: different judges have different prices and reliabilities, and the difficulty of each prompt-response pair can vary…

Machine Learning · Computer Science 2026-05-25 Junghyun Lee , Sanghwa Kim , Yassir Jedra , Alexandre Proutière , Se-Young Yun

Recent advances in Large Language Models (LLMs) have incentivized the development of LLM-as-a-judge, an application of LLMs where they are used as judges to decide the quality of a certain piece of text given a certain context. However,…

Computation and Language · Computer Science 2026-01-21 Xiaolin Zhou , Zheng Luo , Yicheng Gao , Qixuan Chen , Xiyang Hu , Yue Zhao , Ruishan Liu

The recent explosion of large language models (LLMs), each with its own general or specialized strengths, makes scalable, reliable benchmarking more urgent than ever. Standard practices nowadays face fundamental trade-offs: closed-ended…

The rapid advancement of Large Language Models (LLMs) has driven their expanding application across various fields. One of the most promising applications is their role as evaluators based on natural language responses, referred to as…

Computation and Language · Computer Science 2024-12-11 Haitao Li , Qian Dong , Junjie Chen , Huixue Su , Yujia Zhou , Qingyao Ai , Ziyi Ye , Yiqun Liu

Prompting large language models (LLMs) to evaluate generated text, known as LLM-as-a-judge, has become a standard evaluation approach in natural language generation (NLG), but is primarily used as a quantitative tool, i.e. with numerical…

LLM-as-a-Judge is a widely used method for evaluating the performance of Large Language Models (LLMs) across various tasks. We address the challenge of quantifying the uncertainty of LLM-as-a-Judge evaluations. While uncertainty…

Large Language Models (LLMs) have demonstrated impressive performance across diverse domains, yet they still encounter challenges such as insufficient domain-specific knowledge, biases, and hallucinations. This underscores the need for…

Computation and Language · Computer Science 2025-04-07 Hongliu Cao , Ilias Driouich , Robin Singh , Eoin Thomas

Reliable evaluation of large language models (LLMs) is critical as their deployment rapidly expands, particularly in high-stakes domains such as business and finance. The LLM-as-a-Judge framework, which uses prompted LLMs to evaluate…

Computation and Language · Computer Science 2026-04-03 Michael Krumdick , Charles Lovering , Varshini Reddy , Seth Ebner , Chris Tanner

As video language models (VLMs) gain more applications in various scenarios, the need for robust and scalable evaluation of their performance becomes increasingly critical. The traditional human expert-based evaluation of VLMs has…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Ming Liu , Wensheng Zhang

Large Language Models (LLMs) are widely used as proxies for human labelers in both training (Reinforcement Learning from AI Feedback) and large-scale response evaluation (LLM-as-a-judge). Alignment and evaluation are critical components in…

Machine Learning · Computer Science 2025-08-22 Tuhina Tripathi , Manya Wadhwa , Greg Durrett , Scott Niekum

The ability to rigorously estimate the failure rates of large language models (LLMs) is a prerequisite for their safe deployment. Currently, however, practitioners often face a tradeoff between expensive human gold standards and potentially…

Computation and Language · Computer Science 2026-04-07 Minghe Shen , Ananth Balashankar , Adam Fisch , David Madras , Miguel Rodrigues

The efficient adjudication of responsibility disputes is pivotal for maintaining marketplace fairness. However, the exponential surge in ride-hailing volume renders manual review intractable, while conventional automated methods lack the…

Artificial Intelligence · Computer Science 2026-03-19 Weiming Wu , Zi-Jian Cheng , Jie Meng , Peng Zhen , Shan Huang , Qun Li , Guobin Wu , Lan-Zhe Guo

Reasoning-capable large language models (LLMs) have recently been adopted as automated judges, but their benefits and costs in LLM-as-a-Judge settings remain unclear. Through controlled comparisons between reasoning and non-reasoning…

Artificial Intelligence · Computer Science 2026-05-12 Wenbo Zhang , Lijinghua Zhang , Liner Xiang , Hengrui Cai