English
Related papers

Related papers: Mitigating the Bias of Large Language Model Evalua…

200 papers

Large Language Model (LLM)-based recommendation systems excel in delivering comprehensive suggestions by deeply analyzing content and user behavior. However, they often inherit biases from skewed training data, favoring mainstream content…

Information Retrieval · Computer Science 2026-02-02 Anindya Bijoy Das , Shahnewaz Karim Sakib

Large language model (LLM)-based judges are widely adopted for automated evaluation and reward modeling, yet their judgments are often affected by judgment biases. Accurately evaluating these biases is essential for ensuring the reliability…

Computation and Language · Computer Science 2026-03-10 Hongli Zhou , Hui Huang , Rui Zhang , Kehai Chen , Bing Xu , Conghui Zhu , Tiejun Zhao , Muyun Yang

Although large language models (LLMs) have demonstrated their effectiveness in a wide range of applications, they have also been observed to perpetuate unwanted biases present in the training data, potentially leading to harm for…

Computation and Language · Computer Science 2026-03-09 Schrasing Tong , Eliott Zemour , Jessica Lu , Rawisara Lohanimit , Lalana Kagal

The capabilities of Large Language Models (LLMs) are routinely evaluated by other LLMs trained to predict human preferences. This framework--known as LLM-as-a-judge--is highly scalable and relatively low cost. However, it is also vulnerable…

Computation and Language · Computer Science 2026-02-03 Lisa Alazraki , Tan Yi-Chern , Jon Ander Campos , Maximilian Mozes , Marek Rei , Max Bartolo

LLM-as-a-Judge employs large language models (LLMs), such as GPT-4, to evaluate the quality of LLM-generated responses, gaining popularity for its cost-effectiveness and strong alignment with human evaluations. However, training proxy judge…

Computation and Language · Computer Science 2025-09-19 Zhuo Liu , Moxin Li , Xun Deng , Qifan Wang , Fuli Feng

Large language models (LLMs) have become a standard for multilingual evaluation, yet they exhibit a severe systematic translationese bias. In this paper, translationese bias is characterized as LLMs systematically favoring…

Computation and Language · Computer Science 2026-03-12 Hongbin Zhang , Kehai Chen , Xuefen Bai , Youcheng Pan , Yang Xiang , Jinpeng Wang , Min Zhang

While Large Language Models (LLMs) have emerged as promising tools for evaluating Natural Language Generation (NLG) tasks, their effectiveness is limited by their inability to appropriately weigh the importance of different topics, often…

Computation and Language · Computer Science 2025-02-20 Wenwen Xie , Gray Gwizdz , Dongji Feng

Large Language Models (LLMs) are trained on large corpora written by humans and demonstrate high performance on various tasks. However, as humans are susceptible to cognitive biases, which can result in irrational judgments, LLMs can also…

Computation and Language · Computer Science 2024-12-03 Yasuaki Sumita , Koh Takeuchi , Hisashi Kashima

Large Language Models (LLMs) have emerged as promising solutions for a variety of medical and clinical decision support applications. However, LLMs are often subject to different types of biases, which can lead to unfair treatment of…

Computation and Language · Computer Science 2024-08-23 Raphael Poulain , Hamed Fayyaz , Rahmatollah Beheshti

LLM-as-a-Judge has emerged as a popular evaluation strategy, where advanced large language models assess generation results in alignment with human instructions. While these models serve as a promising alternative to human annotators, their…

Computation and Language · Computer Science 2025-05-20 Xiyan Fu , Wei Liu

Large Language Models (LLMs) are widely used as automated judges, where practical value depends on both accuracy and trustworthy, risk-aware judgments. Existing approaches predominantly focus on accuracy, overlooking the necessity of…

Artificial Intelligence · Computer Science 2025-08-19 Zailong Tian , Zhuoheng Han , Yanzhe Chen , Haozhe Xu , Xi Yang , Richeng Xuan , Houfeng Wang , Lizi Liao

Advancements in Large Language Models (LLMs) have increased the performance of different natural language understanding as well as generation tasks. Although LLMs have breached the state-of-the-art performance in various tasks, they often…

Computation and Language · Computer Science 2025-05-28 Charaka Vinayak Kumar , Ashok Urlana , Gopichand Kanumolu , Bala Mallikarjunarao Garlapati , Pruthwik Mishra

We propose an aspect-guided, multi-level perturbation framework to evaluate the robustness of Large Language Models (LLMs) in automated peer review. Our framework explores perturbations in three key components of the peer review…

Computation and Language · Computer Science 2025-02-19 Jiatao Li , Yanheng Li , Xinyu Hu , Mingqi Gao , Xiaojun Wan

Large Language Models are increasingly used as judges to evaluate code artifacts when exhaustive human review or executable test coverage is unavailable. LLM-judge is increasingly relevant in agentic software engineering workflows, where it…

Software Engineering · Computer Science 2026-04-21 Zixiao Zhao , Amirreza Esmaeili , Fatemeh Fard

LLM-as-a-Judge has become a dominant approach in automated evaluation systems, playing critical roles in model alignment, leaderboard construction, quality control, and so on. However, the scalability and trustworthiness of this approach…

Machine Learning · Computer Science 2026-05-15 Jinming Yang , Zheng Hu , Chuxian Qiu , Zhenyu Deng , Xinshan Jiao , Tao Zhou

Text classification is a crucial task encountered frequently in practical scenarios, yet it is still under-explored in the era of large language models (LLMs). This study shows that LLMs are vulnerable to changes in the number and…

Computation and Language · Computer Science 2024-06-12 Zhenyi Lu , Jie Tian , Wei Wei , Xiaoye Qu , Yu Cheng , Wenfeng xie , Dangyang Chen

As humans, we consistently interact with our peers and receive feedback in the form of natural language. This language feedback allows us to maintain appropriate behavior, and rectify potential errors. The question arises naturally: can we…

Computation and Language · Computer Science 2024-06-07 Weiwen Xu , Deng Cai , Zhisong Zhang , Wai Lam , Shuming Shi

With the growing use of large language models(LLMs) as evaluators, their application has expanded to code evaluation tasks, where they assess the correctness of generated code without relying on reference implementations. While this offers…

Computation and Language · Computer Science 2026-01-06 Jiwon Moon , Yerin Hwang , Dongryeol Lee , Taegwan Kang , Yongil Kim , Kyomin Jung

Large language models (LLMs) have shown remarkable adaptability to diverse tasks, by leveraging context prompts containing instructions, or minimal input-output examples. However, recent work revealed they also exhibit label bias -- an…

Computation and Language · Computer Science 2024-05-07 Yuval Reif , Roy Schwartz

Prompting large language models (LLMs) to evaluate generated text, known as LLM-as-a-judge, has become a standard evaluation approach in natural language generation (NLG), but is primarily used as a quantitative tool, i.e. with numerical…