English
Related papers

Related papers: Self-Preference Bias in LLM-as-a-Judge

200 papers

The "LLM-as-a-Judge" paradigm, using Large Language Models (LLMs) as automated evaluators, is pivotal to LLM development, offering scalable feedback for complex tasks. However, the reliability of these judges is compromised by various…

Computation and Language · Computer Science 2026-05-22 Qingquan Li , Shaoyu Dou , Kailai Shao , Chao Chen , Haixiang Hu

Auditing Large Language Models (LLMs) to discover their biases and preferences is an emerging challenge in creating Responsible Artificial Intelligence (AI). While various methods have been proposed to elicit the preferences of such models,…

Computation and Language · Computer Science 2024-11-12 Leif Azzopardi , Yashar Moshfeghi

Large Language Models (LLMs) as judges and LLM-based data synthesis have emerged as two fundamental LLM-driven data annotation methods in model development. While their combination significantly enhances the efficiency of model training and…

Machine Learning · Computer Science 2026-03-05 Dawei Li , Renliang Sun , Yue Huang , Ming Zhong , Bohan Jiang , Jiawei Han , Xiangliang Zhang , Wei Wang , Huan Liu

The adoption of large language models (LLMs) is transforming the peer review process, from assisting reviewers in writing detailed evaluations to generating entire reviews automatically. While these capabilities offer new opportunities,…

Computers and Society · Computer Science 2026-04-29 Sai Suresh Macharla Vasu , Ivaxi Sheth , Hui-Po Wang , Ruta Binkyte , Mario Fritz

Large Language Models (LLMs) evaluation is a patchy and inconsistent landscape, and it is becoming clear that the quality of automatic evaluation metrics is not keeping up with the pace of development of generative models. We aim to improve…

Computation and Language · Computer Science 2023-10-24 Andrea Sottana , Bin Liang , Kai Zou , Zheng Yuan

As LLMs rapidly saturate existing benchmarks, automated benchmark creation using LLMs (LLM-as-a-benchmark) -- where a model generates test inputs (LLM-as-a-testset) and evaluates outputs (LLM-as-an-evaluator) -- has gained traction as a…

Computation and Language · Computer Science 2026-05-27 Wenda Xu , Sweta Agrawal , Vilém Zouhar , Markus Freitag , Daniel Deutsch

With the rising human-like precision of Large Language Models (LLMs) in numerous tasks, their utilization in a variety of real-world applications is becoming more prevalent. Several studies have shown that LLMs excel on many standard NLP…

Computation and Language · Computer Science 2024-04-03 Rishav Hada , Varun Gumma , Mohamed Ahmed , Kalika Bali , Sunayana Sitaram

Large Language Models (LLMs) have become increasingly popular for coding tasks, with subjective coding preferences being an essential element to adapt to programmers' personal needs. Existing work overlooks such characteristics and mainly…

Human-Computer Interaction · Computer Science 2026-05-26 Anna Mokhova , Subhabrata Dutta , Iryna Gurevych , Simone Balloccu

Automatic systems are increasingly used to assess the originality of responses in creative tasks. They offer a potential solution to key limitations of human assessment (cost, fatigue, and subjectivity), but there is preliminary evidence of…

Human-Computer Interaction · Computer Science 2026-04-24 Umberto Domanti , Moritz Mock , Sergio Agnoli , Antonella De Angeli

Modern language models are trained on large amounts of data. These data inevitably include controversial and stereotypical content, which contains all sorts of biases related to gender, origin, age, etc. As a result, the models express…

Computation and Language · Computer Science 2025-09-03 Aleksandra Sorokovikova , Pavel Chizhov , Iuliia Eremenko , Ivan P. Yamshchikov

As artificial intelligence (AI) tools become widely adopted, large language models (LLMs) are increasingly involved on both sides of decision-making processes, ranging from hiring to content moderation. This dual adoption raises a critical…

Computers and Society · Computer Science 2026-02-10 Jiannan Xu , Gujie Li , Jane Yi Jiang

Large Language Models (LLMs) are widely used as proxies for human labelers in both training (Reinforcement Learning from AI Feedback) and large-scale response evaluation (LLM-as-a-judge). Alignment and evaluation are critical components in…

Machine Learning · Computer Science 2025-08-22 Tuhina Tripathi , Manya Wadhwa , Greg Durrett , Scott Niekum

Using large language models (LLMs) for automatic evaluation has become an important evaluation method in NLP research. However, it is unclear whether these LLM-based evaluators can be applied in real-world classrooms to assess student…

Computation and Language · Computer Science 2024-09-24 Cheng-Han Chiang , Wei-Chih Chen , Chun-Yi Kuan , Chienchou Yang , Hung-yi Lee

The capabilities of Large Language Models (LLMs) are routinely evaluated by other LLMs trained to predict human preferences. This framework--known as LLM-as-a-judge--is highly scalable and relatively low cost. However, it is also vulnerable…

Computation and Language · Computer Science 2026-02-03 Lisa Alazraki , Tan Yi-Chern , Jon Ander Campos , Maximilian Mozes , Marek Rei , Max Bartolo

Recently, there has been a growing trend of utilizing Large Language Model (LLM) to evaluate the quality of other LLMs. Many studies have fine-tuned judge models based on open-source LLMs for evaluation. While the fine-tuned judge models…

Computation and Language · Computer Science 2025-06-02 Hui Huang , Xingyuan Bu , Hongli Zhou , Yingqi Qu , Jing Liu , Muyun Yang , Bing Xu , Tiejun Zhao

This paper investigates various approaches using Large Language Models (LLMs) to identify gaps and misconceptions in students' self-explanations of specific instructional material, in our case explanations of code examples. This research is…

Computers and Society · Computer Science 2025-01-22 Priti Oli , Rabin Banjade , Andrew M. Olney , Vasile Rus

Preference learning is critical for aligning large language models (LLMs) with human values, with the quality of preference datasets playing a crucial role in this process. While existing metrics primarily assess data quality based on…

Machine Learning · Computer Science 2025-03-05 Kexin Huang , Junkang Wu , Ziqian Chen , Xue Wang , Jinyang Gao , Bolin Ding , Jiancan Wu , Xiangnan He , Xiang Wang

We examine whether large language models (LLMs) can predict biased decision-making in conversational settings, and whether their predictions capture not only human cognitive biases but also how those effects change under cognitive load. In…

Human-Computer Interaction · Computer Science 2026-02-06 Stephen Pilli , Vivek Nallur

Multimodal Large Language Models (MLLMs) have gained significant attention recently, showing remarkable potential in artificial general intelligence. However, assessing the utility of MLLMs presents considerable challenges, primarily due to…

Computation and Language · Computer Science 2024-06-12 Dongping Chen , Ruoxi Chen , Shilin Zhang , Yinuo Liu , Yaochen Wang , Huichi Zhou , Qihui Zhang , Yao Wan , Pan Zhou , Lichao Sun

Large language models (LLMs) are known to produce varying responses depending on prompt phrasing, indicating that subtle guidance in phrasing can steer their answers. However, the impact of this framing bias on LLM-based evaluation, where…

Computation and Language · Computer Science 2026-01-21 Yerin Hwang , Dongryeol Lee , Taegwan Kang , Minwoo Lee , Kyomin Jung