English
Related papers

Related papers: Evaluating Scoring Bias in LLM-as-a-Judge

200 papers

Large Language Models (LLMs) have shown promise in Automated Essay Scoring (AES), but their zero-shot and few-shot performance often falls short compared to state-of-the-art models and human raters. However, fine-tuning LLMs for each…

Computation and Language · Computer Science 2024-07-09 Seungju Kim , Meounggun Jo

Large Language Models(LLMs) have revolutionized various applications in natural language processing (NLP) by providing unprecedented text generation, translation, and comprehension capabilities. However, their widespread deployment has…

Computation and Language · Computer Science 2024-09-26 Rajesh Ranjan , Shailja Gupta , Surya Narayan Singh

Large Language Models (LLMs) inherit explicit and implicit biases from their training datasets. Identifying and mitigating biases in LLMs is crucial to ensure fair outputs, as they can perpetuate harmful stereotypes and misinformation. This…

Machine Learning · Computer Science 2025-11-19 Fatima Kazi , Alex Young , Yash Inani , Setareh Rafatirad

Large Language Models (LLMs) have revolutionized natural language processing, but their susceptibility to biases poses significant challenges. This comprehensive review examines the landscape of bias in LLMs, from its origins to current…

Computation and Language · Computer Science 2026-05-04 Yufei Guo , Muzhe Guo , Juntao Su , Zhou Yang , Mengqiu Zhu , Hongfei Li , Mengyang Qiu , Shuo Shuo Liu

Recently, there has been a growing trend of utilizing Large Language Model (LLM) to evaluate the quality of other LLMs. Many studies have fine-tuned judge models based on open-source LLMs for evaluation. While the fine-tuned judge models…

Computation and Language · Computer Science 2025-06-02 Hui Huang , Xingyuan Bu , Hongli Zhou , Yingqi Qu , Jing Liu , Muyun Yang , Bing Xu , Tiejun Zhao

Accurate evaluation is central to the large language model (LLM) ecosystem, guiding model selection and downstream adoption across diverse use cases. In practice, however, evaluating generative outputs typically relies on rigid lexical…

Computation and Language · Computer Science 2026-04-13 Hippolyte Gisserot-Boukhlef , Nicolas Boizard , Emmanuel Malherbe , Céline Hudelot , Pierre Colombo

Course evaluation plays a critical role in ensuring instructional quality and guiding curriculum development in higher education. However, traditional evaluation methods, such as student surveys, classroom observations, and expert reviews,…

Computation and Language · Computer Science 2025-12-29 Bo Yuan , Jiazi Hu

LLM-as-a-Judge employs large language models (LLMs), such as GPT-4, to evaluate the quality of LLM-generated responses, gaining popularity for its cost-effectiveness and strong alignment with human evaluations. However, training proxy judge…

Computation and Language · Computer Science 2025-09-19 Zhuo Liu , Moxin Li , Xun Deng , Qifan Wang , Fuli Feng

Large language models (LLMs) have been increasingly deployed in real-world software engineering, fostering the development of code evaluation metrics to study the quality of LLM-generated code. Conventional rule-based metrics merely score…

Software Engineering · Computer Science 2025-12-24 Ruiqi Wang , Xinchen Wang , Cuiyun Gao , Chun Yong Chong , Xin Xia , Qing Liao

LLM-as-a-Judge (LaaJ) is a novel paradigm in which powerful language models are used to assess the quality, safety, or correctness of generated outputs. While this paradigm has significantly improved the scalability and efficiency of…

Pre-trained large language models (LLMs) can now be easily adapted for specific business purposes using custom prompts or fine tuning. These customizations are often iteratively re-engineered to improve some aspect of performance, but after…

Computation and Language · Computer Science 2024-07-15 Jennifer Healey , Laurie Byrum , Md Nadeem Akhtar , Moumita Sinha

Large Language Models (LLMs) are powerful zero-shot assessors used in real-world situations such as assessing written exams and benchmarking systems. Despite these critical applications, no existing work has analyzed the vulnerability of…

Computation and Language · Computer Science 2024-07-08 Vyas Raina , Adian Liusie , Mark Gales

Large language model (LLM) judges have often been used alongside traditional, algorithm-based metrics for tasks like summarization because they better capture semantic information, are better at reasoning, and are more robust to…

Computation and Language · Computer Science 2026-02-10 Jiangnan Fang , Cheng-Tse Liu , Hanieh Deilamsalehy , Nesreen K. Ahmed , Puneet Mathur , Nedim Lipka , Franck Dernoncourt , Ryan A. Rossi

EXplainable machine learning (XML) has recently emerged to address the mystery mechanisms of machine learning (ML) systems by interpreting their 'black box' results. Despite the development of various explanation methods, determining the…

Human-Computer Interaction · Computer Science 2025-03-03 Bo Wang , Yiqiao Li , Jianlong Zhou , Fang Chen

Large Language Models (LLMs) are being increasingly integrated into software systems, offering powerful capabilities but also raising concerns about fairness. Existing fairness benchmarks, however, focus on stereotype-specific associations,…

Software Engineering · Computer Science 2026-04-08 Gianmario Voria , Martina De Lucia , Alessandra Raia , Andrea De Lucia , Gemma Catolino , Fabio Palomba

Large Language Models (LLMs) push the bound-aries in natural language processing and generative AI, driving progress across various aspects of modern society. Unfortunately, the pervasive issue of bias in LLMs responses (i.e., predictions)…

Computation and Language · Computer Science 2025-05-20 Isabela Pereira Gregio , Ian Pons , Anna Helena Reali Costa , Artur Jordão

Large Language Models (LLMs) offer the potential to automate hiring by matching job descriptions with candidate resumes, streamlining recruitment processes, and reducing operational costs. However, biases inherent in these models may lead…

Computation and Language · Computer Science 2025-03-26 Hayate Iso , Pouya Pezeshkpour , Nikita Bhutani , Estevam Hruschka

With the broad availability of large language models and their ability to generate vast outputs using varied prompts and configurations, determining the best output for a given task requires an intensive evaluation process, one where…

Large language models (LLMs) are known to be sensitive to input phrasing, but the mechanisms by which semantic cues shape reasoning remain poorly understood. We investigate this phenomenon in the context of comparative math problems with…

Computation and Language · Computer Science 2025-06-05 Mohammadamin Shafiei , Hamidreza Saffari , Nafise Sadat Moosavi

Recently, large language models (LLMs) have been deployed to tackle various software engineering (SE) tasks like code generation, significantly advancing the automation of SE tasks. However, assessing the quality of these LLM-generated code…

Software Engineering · Computer Science 2025-04-22 Ruiqi Wang , Jiyu Guo , Cuiyun Gao , Guodong Fan , Chun Yong Chong , Xin Xia