English
Related papers

Related papers: Judging the Judges: Evaluating Alignment and Vulne…

200 papers

Evaluating large language model (LLM) based chat assistants is challenging due to their broad capabilities and the inadequacy of existing benchmarks in measuring human preferences. To address this, we explore using strong LLMs as judges to…

While large language models (LLMs) have been used for automated grading, they have not yet achieved the same level of performance as humans, especially when it comes to grading complex questions. Existing research on this topic focuses on a…

Artificial Intelligence · Computer Science 2024-05-31 Wenjing Xie , Juxin Niu , Chun Jason Xue , Nan Guan

Large language models (LLMs) are increasingly applied as automatic evaluators for natural language generation assessment often using pairwise comparative judgements. Existing approaches typically rely on single judges or aggregate multiple…

Computation and Language · Computer Science 2026-05-29 Mengjie Qian , Guangzhi Sun , Mark J. F. Gales , Kate M. Knill

The adoption of Large Language Models (LLMs) as automated evaluators (LLM-as-a-judge) has revealed critical inconsistencies in current evaluation frameworks. We identify two fundamental types of inconsistencies: (1) Score-Comparison…

Artificial Intelligence · Computer Science 2025-09-29 Yidong Wang , Yunze Song , Tingyuan Zhu , Xuanwang Zhang , Zhuohao Yu , Hao Chen , Chiyu Song , Qiufeng Wang , Cunxiang Wang , Zhen Wu , Xinyu Dai , Yue Zhang , Wei Ye , Shikun Zhang

As Large Language Models (LLMs) become integrated into high-stakes domains, there is a growing need for evaluation methods that are both scalable for real-time deployment and reliable for critical decision-making. While human evaluation is…

Artificial Intelligence · Computer Science 2025-12-02 Xiaochuan Li , Ke Wang , Girija Gouda , Shubham Choudhary , Yaqun Wang , Linwei Hu , Joel Vaughan , Freddy Lecue

The rapid integration of Large Language Models (LLMs) into software engineering (SE) has revolutionized tasks like code generation, producing a massive volume of software artifacts. This surge has exposed a critical bottleneck: the lack of…

Software Engineering · Computer Science 2025-10-29 Junda He , Jieke Shi , Terry Yue Zhuo , Christoph Treude , Jiamou Sun , Zhenchang Xing , Xiaoning Du , David Lo

Large language models (LLMs) are increasingly used in academic peer review, yet their reliability, alignment with human judgment, and robustness to adversarial attacks remain poorly understood. We present a systematic benchmark of…

Computation and Language · Computer Science 2026-05-26 Lingyao Li , Junjie Xiong , Changjia Zhu , Runlong Yu , Chen Chen , Junyu Wang , Renkai Ma , Zhicong Lu

Large Language Models (LLMs) are widely used as automated judges, where practical value depends on both accuracy and trustworthy, risk-aware judgments. Existing approaches predominantly focus on accuracy, overlooking the necessity of…

Artificial Intelligence · Computer Science 2025-08-19 Zailong Tian , Zhuoheng Han , Yanzhe Chen , Haozhe Xu , Xi Yang , Richeng Xuan , Houfeng Wang , Lizi Liao

The LLM-as-a-judge paradigm, in which a judge LLM system replaces human raters in rating the outputs of other generative AI (GenAI) systems, plays a critical role in scaling and standardizing GenAI evaluations. To validate such judge…

Machine Learning · Computer Science 2025-10-28 Luke Guerdan , Solon Barocas , Kenneth Holstein , Hanna Wallach , Zhiwei Steven Wu , Alexandra Chouldechova

Large Language Models (LLMs) and other automated techniques have been increasingly used to support software developers by generating software artifacts such as code snippets, patches, and comments. However, accurately assessing the…

Software Engineering · Computer Science 2025-10-13 Xin Zhou , Kisub Kim , Ting Zhang , Martin Weyssow , Luis F. Gomes , Guang Yang , Kui Liu , Xin Xia , David Lo

Human decision-making belongs to the foundation of our society and civilization, but we are on the verge of a future where much of it will be delegated to artificial intelligence. The arrival of Large Language Models (LLMs) has transformed…

Artificial Intelligence · Computer Science 2025-06-23 Hao Li , Gengrui Zhang , Petter Holme , Shuyue Hu , Zhen Wang

Large Language Model (LLM) based judges form the underpinnings of key safety evaluation processes such as offline benchmarking, automated red-teaming, and online guardrailing. This widespread requirement raises the crucial question: can we…

Machine Learning · Computer Science 2025-03-07 Francisco Eiras , Eliott Zemour , Eric Lin , Vaikkunth Mugunthan

Large Language Models (LLMs) have become increasingly powerful and ubiquitous, but their stochastic nature poses challenges to the reliability of their outputs. While deterministic settings can improve consistency, they do not guarantee…

Computation and Language · Computer Science 2025-02-19 Kayla Schroeder , Zach Wood-Doughty

Large Language Models (LLMs) have significantly advanced the state-of-the-art in various coding tasks. Beyond directly answering user queries, LLMs can also serve as judges, assessing and comparing the quality of responses generated by…

Computation and Language · Computer Science 2025-08-15 Hongchao Jiang , Yiming Chen , Yushi Cao , Hung-yi Lee , Robby T. Tan

Large Language Models (LLMs) are increasingly employed as automated evaluators to assess the safety of generated content, yet their reliability in this role remains uncertain. This study evaluates a diverse set of 11 LLM judge models across…

Computation and Language · Computer Science 2025-07-10 Hongyu Chen , Seraphina Goldfarb-Tarrant

Multimodal Large Language Models (MLLMs) have been increasingly used as automatic evaluators-a paradigm known as MLLM-as-a-Judge. However, their reliability and vulnerabilities to biases remain underexplored. We find that many MLLM judges…

Computation and Language · Computer Science 2026-04-24 Sua Lee , Sanghee Park , Jinbae Im

This paper presents the first systematic comparison investigating whether Large Reasoning Models (LRMs) are superior judges to non-reasoning LLMs. Our empirical analysis yields four key findings: 1) LRMs outperform non-reasoning LLMs in…

Computation and Language · Computer Science 2026-05-15 Hui Huang , Xuanxin Wu , Muyun Yang , Yuki Arase

Automated short-answer grading (ASAG) remains a challenging task due to the linguistic variability of student responses and the need for nuanced, rubric-aligned partial credit. While Large Language Models (LLMs) offer a promising solution,…

Computation and Language · Computer Science 2026-01-15 Haotian Deng , Chris Farber , Jiyoon Lee , David Tang

Despite the growing promise of large language models (LLMs) in automated essay scoring (AES), empirical findings regarding their reliability compared to human raters remain mixed. Following the PRISMA 2020 guidelines, we synthesized 65…

Computation and Language · Computer Science 2026-05-27 Hongli Li , Che Han Chen , Kevin Fan , Chiho Young-Johnson , Soyoung Lim , Yali Feng

One open question in the study of Large Language Models (LLMs) is whether they can emulate human ethical reasoning and act as believable proxies for human judgment. To investigate this, we introduce a benchmark dataset comprising 196…

Computation and Language · Computer Science 2025-05-14 Jiashen , Du , Jesse Yao , Allen Liu , Zhekai Zhang