English
Related papers

Related papers: No-Knowledge Alarms for Misaligned LLMs-as-Judges

200 papers

LLM-based judges have emerged as a scalable alternative to human evaluation and are increasingly used to assess, compare, and improve models. However, the reliability of LLM-based judges themselves is rarely scrutinized. As LLMs become more…

Artificial Intelligence · Computer Science 2025-04-08 Sijun Tan , Siyuan Zhuang , Kyle Montgomery , William Y. Tang , Alejandro Cuadron , Chenguang Wang , Raluca Ada Popa , Ion Stoica

Large language models (LLMs) are being widely applied across various fields, but as tasks become more complex, evaluating their responses is increasingly challenging. Compared to human evaluators, the use of LLMs to support performance…

Artificial Intelligence · Computer Science 2025-04-25 Yuran Li , Jama Hussein Mohamud , Chongren Sun , Di Wu , Benoit Boulet

Using Large Language Models (LLMs) for relevance assessments offers promising opportunities to improve Information Retrieval (IR), Natural Language Processing (NLP), and related fields. Indeed, LLMs hold the promise of allowing IR…

Reasoning abilities of LLMs have been a key focus in recent years. One challenging reasoning domain with interesting nuances is legal reasoning, which requires careful application of rules, and precedents while balancing deductive and…

Computation and Language · Computer Science 2025-02-11 Venkatesh Mishra , Bimsara Pathiraja , Mihir Parmar , Sat Chidananda , Jayanth Srinivasa , Gaowen Liu , Ali Payani , Chitta Baral

Evaluating natural language generation (NLG) systems remains a core challenge of natural language processing (NLP), further complicated by the rise of large language models (LLMs) that aims to be general-purpose. Recently, large language…

Computation and Language · Computer Science 2025-08-29 Khaoula Chehbouni , Mohammed Haddou , Jackie Chi Kit Cheung , Golnoosh Farnadi

Numerous methods have been proposed to measure LLM misgendering, including probability-based evaluations (e.g., automatically with templatic sentences) and generation-based evaluations (e.g., with automatic heuristics or human validation).…

Computation and Language · Computer Science 2025-08-05 Arjun Subramonian , Vagrant Gautam , Preethi Seshadri , Dietrich Klakow , Kai-Wei Chang , Yizhou Sun

Evaluating Large Language Models (LLMs) in open-ended scenarios is challenging because existing benchmarks and metrics can not measure them comprehensively. To address this problem, we propose to fine-tune LLMs as scalable judges (JudgeLM)…

Computation and Language · Computer Science 2025-03-04 Lianghui Zhu , Xinggang Wang , Xinlong Wang

Large Language Models (LLMs) have demonstrated exceptional capabilities, yet selecting the most reliable response from multiple LLMs remains a challenge, particularly in resource-constrained settings. Existing approaches often depend on…

Computation and Language · Computer Science 2025-10-06 Aakriti Agrawal , Rohith Aralikatti , Anirudh Satheesh , Souradip Chakraborty , Amrit Singh Bedi , Furong Huang

LLM-as-a-Judge and reward models are widely used alternatives of multiple-choice questions or human annotators for large language model (LLM) evaluation. Their efficacy shines in evaluating long-form responses, serving a critical role as…

Computation and Language · Computer Science 2024-10-03 Guijin Son , Hyunwoo Ko , Hoyoung Lee , Yewon Kim , Seunghyeok Hong

The evaluation of Large Language Models (LLMs) increasingly relies on other LLMs acting as judges. However, current evaluation paradigms typically yield a single score or ranking, answering which model is better but not why. While essential…

Computation and Language · Computer Science 2025-07-25 Asaf Yehudai , Lilach Eden , Yotam Perlitz , Roy Bar-Haim , Michal Shmueli-Scheuer

Alignment with human preferences is an important evaluation aspect of LLMs, requiring them to be helpful, honest, safe, and to precisely follow human instructions. Evaluating large language models' (LLMs) alignment typically involves…

Computation and Language · Computer Science 2025-11-26 Yixin Liu , Pengfei Liu , Arman Cohan

Generating code from a natural language programming task is one of the most successful applications of Large Language Models (LLMs). Yet, the generated program may be buggy. Without an oracle, such as an existing, correct implementation or…

Programming Languages · Computer Science 2025-12-16 Thomas Valentin , Ardi Madadi , Gaetano Sapia , Marcel Böhme

Unjudged documents or holes in information retrieval benchmarks are considered non-relevant in evaluation, yielding no gains in measuring effectiveness. However, these missing judgments may inadvertently introduce biases into the evaluation…

Information Retrieval · Computer Science 2024-05-09 Shivani Upadhyay , Ehsan Kamalloo , Jimmy Lin

LLM-as-a-Judge has been widely adopted as an evaluation method and served as supervised rewards in model training. However, existing benchmarks for LLM-as-a-Judge are mainly relying on human-annotated ground truth, which introduces human…

Computation and Language · Computer Science 2025-12-19 Yuanning Feng , Sinan Wang , Zhengxiang Cheng , Yao Wan , Dongping Chen

Already today, humans and programming assistants based on large language models (LLMs) collaborate in everyday programming tasks. Clearly, a misalignment between how LLMs and programmers comprehend code can lead to misunderstandings,…

Software Engineering · Computer Science 2025-08-27 Youssef Abdelsalam , Norman Peitek , Anna-Maria Maurer , Mariya Toneva , Sven Apel

Large language models (LLMs) have become essential tools in software development, widely used for requirements engineering, code generation and review tasks. Software engineers often rely on LLMs to assess whether system code implementation…

Software Engineering · Computer Science 2025-08-19 Haolin Jin , Huaming Chen

Evaluating Large Language Models (LLMs) often requires costly human annotations. To address this, LLM-based judges have been proposed, which compare the outputs of two LLMs enabling the ranking of models without human intervention. While…

Computation and Language · Computer Science 2025-05-28 David Salinas , Omar Swelam , Frank Hutter

Large language models (LLMs) exhibit a wide range of promising capabilities -- from step-by-step planning to commonsense reasoning -- that may provide utility for robots, but remain prone to confidently hallucinated predictions. In this…

Despite demonstrating impressive capabilities, Large Language Models (LLMs) still often struggle to accurately express the factual knowledge they possess, especially in cases where the LLMs' knowledge boundaries are ambiguous. To improve…

Computation and Language · Computer Science 2025-05-26 Boyang Xue , Fei Mi , Qi Zhu , Hongru Wang , Rui Wang , Sheng Wang , Erxin Yu , Xuming Hu , Kam-Fai Wong

As LLM-based judges become integral to industry applications, obtaining well-calibrated uncertainty estimates efficiently has become critical for production deployment. However, existing techniques, such as verbalized confidence and…

Machine Learning · Computer Science 2025-12-30 Bhaktipriya Radharapu , Eshika Saxena , Kenneth Li , Chenxi Whitehouse , Adina Williams , Nicola Cancedda