English
Related papers

Related papers: LLM-as-a-qualitative-judge: automating error analy…

200 papers

Traditional reference-based metrics, such as BLEU and ROUGE, are less effective for assessing outputs from Large Language Models (LLMs) that produce highly creative or superior-quality text, or in situations where reference outputs are…

Human-Computer Interaction · Computer Science 2024-07-08 Qian Pan , Zahra Ashktorab , Michael Desmond , Martin Santillan Cooper , James Johnson , Rahul Nair , Elizabeth Daly , Werner Geyer

Large language models (LLMs) can act as evaluators, a role studied by methods like LLM-as-a-Judge and fine-tuned judging LLMs. In the field of education, LLMs have been studied as assistant tools for students and teachers. Our research…

Computation and Language · Computer Science 2025-09-26 Valeria Ramirez-Garcia , David de-Fitero-Dominguez , Antonio Garcia-Cabot , Eva Garcia-Lopez

The paradigm of using Large Language Models (LLMs) and Multimodal Large Language Models (MLLMs) as evaluative judges has emerged as an effective approach in RLHF and inference-time scaling. In this work, we propose Multimodal Reasoner as a…

Computation and Language · Computer Science 2025-05-20 Renjie Pi , Felix Bai , Qibin Chen , Simon Wang , Jiulong Shan , Kieran Liu , Meng Cao

Multimodal Large Language Models (MLLMs) have gained significant attention recently, showing remarkable potential in artificial general intelligence. However, assessing the utility of MLLMs presents considerable challenges, primarily due to…

Computation and Language · Computer Science 2024-06-12 Dongping Chen , Ruoxi Chen , Shilin Zhang , Yinuo Liu , Yaochen Wang , Huichi Zhou , Qihui Zhang , Yao Wan , Pan Zhou , Lichao Sun

Evaluating natural language generation (NLG) is a vital but challenging problem in natural language processing. Traditional evaluation metrics mainly capturing content (e.g. n-gram) overlap between system outputs and references are far from…

Computation and Language · Computer Science 2025-05-15 Mingqi Gao , Xinyu Hu , Jie Ruan , Xiao Pu , Xiaojun Wan

As interactive LLM-based applications are created and refined, model developers need to evaluate the quality of generated text along many possible axes. For simpler systems, human evaluation may be practical, but in complicated systems like…

Computation and Language · Computer Science 2026-05-22 Zhenwei Tang , Zhaoyan Liu , Rasa Hosseinzadeh , Tongzi Wu , Keyvan Golestan , Jesse C. Cresswell

Large language models (LLMs) are increasingly used as automated evaluators of AI systems, including in high-stakes applications. In this role, LLMs are used to generate judgments about the quality, appropriateness, or even safety of model…

Machine Learning · Computer Science 2026-05-19 Jane Paik Kim

Evaluating the conversational abilities of large language models (LLMs) remains a challenging task. Current mainstream approaches primarily rely on the "LLM-as-a-judge" paradigm, where an LLM is prompted to serve as an evaluator to assess…

Computation and Language · Computer Science 2026-01-07 Yuqi Tang , Kehua Feng , Yunfeng Wang , Zhiwen Chen , Chengfei Lv , Gang Yu , Qiang Zhang , Keyan Ding , Huajun Chen

Validating evaluation metrics for NLG typically relies on expensive and time-consuming human annotations, which predominantly exist only for English datasets. We propose \textit{LLM as a Meta-Judge}, a scalable framework that utilizes LLMs…

Computation and Language · Computer Science 2026-03-11 Lukáš Eigler , Jindřich Libovický , David Hurych

The "LLM-as-a-Judge" paradigm, using Large Language Models (LLMs) as automated evaluators, is pivotal to LLM development, offering scalable feedback for complex tasks. However, the reliability of these judges is compromised by various…

Computation and Language · Computer Science 2026-05-22 Qingquan Li , Shaoyu Dou , Kailai Shao , Chao Chen , Haixiang Hu

The evaluation of Large Language Models (LLMs) increasingly relies on other LLMs acting as judges. However, current evaluation paradigms typically yield a single score or ranking, answering which model is better but not why. While essential…

Computation and Language · Computer Science 2025-07-25 Asaf Yehudai , Lilach Eden , Yotam Perlitz , Roy Bar-Haim , Michal Shmueli-Scheuer

Human evaluation is indispensable and inevitable for assessing the quality of texts generated by machine learning models or written by humans. However, human evaluation is very difficult to reproduce and its quality is notoriously unstable,…

Computation and Language · Computer Science 2023-05-04 Cheng-Han Chiang , Hung-yi Lee

Large Language Models (LLMs) are increasingly being used to autonomously evaluate the quality of content in communication systems, e.g., to assess responses in telecom customer support chatbots. However, the impartiality of these AI…

Artificial Intelligence · Computer Science 2026-03-03 Jiaxin Gao , Chen Chen , Yanwen Jia , Xueluan Gong , Kwok-Yan Lam , Qian Wang

Large language models (LLMs) are increasingly deployed across healthcare applications, including clinical documentation, diagnostic reasoning, medicine recommendation, and medical education. Their outputs are largely unstructured clinical…

Computers and Society · Computer Science 2026-05-26 Lingyao Li , Deyi Li , Chen Chen , Renkai Ma , Runlong Yu , Mingquan Lin , Rui Yin , Lizhou Fan , Cathy Shyr , Siyuan Ma , Mei Liu , Steven Bethard

While large language models (LLMs) have been used for automated grading, they have not yet achieved the same level of performance as humans, especially when it comes to grading complex questions. Existing research on this topic focuses on a…

Artificial Intelligence · Computer Science 2024-05-31 Wenjing Xie , Juxin Niu , Chun Jason Xue , Nan Guan

Large language models (LLMs) are increasingly used as automated judges to evaluate recommendation systems, search engines, and other subjective tasks, where relying on human evaluators can be costly, time-consuming, and unscalable. LLMs…

Computation and Language · Computer Science 2025-02-10 Gerrit J. J. van den Burg , Gen Suzuki , Wei Liu , Murat Sensoy

Evaluating natural language generation (NLG) systems remains a core challenge of natural language processing (NLP), further complicated by the rise of large language models (LLMs) that aims to be general-purpose. Recently, large language…

Computation and Language · Computer Science 2025-08-29 Khaoula Chehbouni , Mohammed Haddou , Jackie Chi Kit Cheung , Golnoosh Farnadi

In the rapidly evolving domain of Natural Language Generation (NLG) evaluation, introducing Large Language Models (LLMs) has opened new avenues for assessing generated content quality, e.g., coherence, creativity, and context relevance.…

Computation and Language · Computer Science 2024-06-13 Zhen Li , Xiaohan Xu , Tao Shen , Can Xu , Jia-Chen Gu , Yuxuan Lai , Chongyang Tao , Shuai Ma

Commit messages are essential in software development as they serve to document and explain code changes. Yet, their quality often falls short in practice, with studies showing significant proportions of empty or inadequate messages. While…

Software Engineering · Computer Science 2025-07-16 Qunhong Zeng , Yuxia Zhang , Zexiong Ma , Bo Jiang , Ningyuan Sun , Klaas-Jan Stol , Xingyu Mou , Hui Liu

To reduce the need for human annotations, large language models (LLMs) have been proposed as judges of the quality of other candidate models. The performance of LLM judges is typically evaluated by measuring the correlation with human…

Computation and Language · Computer Science 2025-05-14 Andreas Stephan , Dawei Zhu , Matthias Aßenmacher , Xiaoyu Shen , Benjamin Roth