English
Related papers

Related papers: Style Over Substance: Evaluation Biases for Large …

200 papers

Automated Essay Scoring (AES) has been explored for decades with the goal to support teachers by reducing grading workload and mitigating subjective biases. While early systems relied on handcrafted features and statistical models, recent…

Computation and Language · Computer Science 2026-03-09 Jonas Kubesch , Lena Huber , Clemens Havas

Large Language Models (LLMs) often generate responses with inherent biases, undermining their reliability in real-world applications. Existing evaluation methods often overlook biases in long-form responses and the intrinsic variability of…

Computation and Language · Computer Science 2025-10-13 Weijie Xu , Yiwen Wang , Chi Xue , Xiangkun Hu , Xi Fang , Guimin Dong , Chandan K. Reddy

As large language models (LLMs) are increasingly deployed as automated graders in educational settings, concerns about fairness and bias in their evaluations have become critical. This study investigates whether LLMs exhibit implicit…

Computation and Language · Computer Science 2026-03-20 Rudra Jadhav , Janhavi Danve , Sonalika Shaw

Researchers have proposed the use of generative large language models (LLMs) to label data for research and applied settings. This literature emphasizes the improved performance of these models relative to other natural language models,…

Computation and Language · Computer Science 2025-06-17 Megan A. Brown , Shubham Atreja , Libby Hemphill , Patrick Y. Wu

With the rise of Large Language Models (LLMs) and their ubiquitous deployment in diverse domains, measuring language model behavior on realistic data is imperative. For example, a company deploying a client-facing chatbot must ensure that…

Computation and Language · Computer Science 2023-06-30 Neel Jain , Khalid Saifullah , Yuxin Wen , John Kirchenbauer , Manli Shu , Aniruddha Saha , Micah Goldblum , Jonas Geiping , Tom Goldstein

Recently, Large Language Models (LLMs) have demonstrated a superior ability to serve as ranking models. However, concerns have arisen as LLMs will exhibit discriminatory ranking behaviors based on users' sensitive attributes (\eg gender).…

Information Retrieval · Computer Science 2024-09-26 Chen Xu , Wenjie Wang , Yuxin Li , Liang Pang , Jun Xu , Tat-Seng Chua

The manual assessment and grading of student writing is a time-consuming yet critical task for teachers. Recent developments in generative AI, such as large language models, offer potential solutions to facilitate essay-scoring tasks for…

Computation and Language · Computer Science 2024-11-26 Kathrin Seßler , Maurice Fürstenberg , Babette Bühler , Enkelejda Kasneci

Systematic reviews (SR), in which experts summarize and analyze evidence across individual studies to provide insights on a specialized topic, are a cornerstone for evidence-based clinical decision-making, research, and policy. Given the…

Computation and Language · Computer Science 2025-05-30 Christopher Polzak , Alejandro Lozano , Min Woo Sun , James Burgess , Yuhui Zhang , Kevin Wu , Serena Yeung-Levy

Topic modeling has been a widely used tool for unsupervised text analysis. However, comprehensive evaluations of a topic model remain challenging. Existing evaluation methods are either less comparable across different models (e.g.,…

Computation and Language · Computer Science 2025-01-15 Xiaohao Yang , He Zhao , Dinh Phung , Wray Buntine , Lan Du

Large Language Models (LLMs) are widely used for text generation, making it crucial to address potential bias. This study investigates ideological framing bias in LLM-generated articles, focusing on the subtle and subjective nature of such…

Computation and Language · Computer Science 2026-01-13 Molly Kennedy , Ayyoob Imani , Timo Spinde , Akiko Aizawa , Hinrich Schütze

The development and evaluation of Large Language Models (LLMs) has primarily focused on their task-solving capabilities, with recent models even surpassing human performance in some areas. However, this focus often neglects whether…

Computation and Language · Computer Science 2025-07-29 Yanzhu Guo , Guokan Shang , Chloé Clavel

Textual data annotation, the process of labeling or tagging text with relevant information, is typically costly, time-consuming, and labor-intensive. While large language models (LLMs) have demonstrated their potential as direct…

Computation and Language · Computer Science 2025-08-12 Yu-Min Tseng , Wei-Lin Chen , Chung-Chi Chen , Hsin-Hsi Chen

We study the ability of large language models (LLMs) to generate comprehensive and accurate book summaries solely from their internal knowledge, without recourse to the original text. Employing a diverse set of books and multiple LLM…

Computation and Language · Computer Science 2025-03-28 Javier Coronado-Blázquez

It is increasingly important to evaluate how text generation systems based on large language models (LLMs) behave, such as their tendency to produce harmful output or their sensitivity to adversarial inputs. Such evaluations often rely on a…

Computation and Language · Computer Science 2025-11-17 Rachel Longjohn , Shang Wu , Saatvik Kher , Catarina Belém , Padhraic Smyth

In recent years, Large Language Models (LLMs) have gained immense attention due to their notable emergent capabilities, surpassing those seen in earlier language models. A particularly intriguing application of LLMs is their role as…

Computation and Language · Computer Science 2023-11-02 Xue-Yong Fu , Md Tahmid Rahman Laskar , Cheng Chen , Shashi Bhushan TN

Relevance judgments are crucial for evaluating information retrieval systems, but traditional human-annotated labels are time-consuming and expensive. As a result, many researchers turn to automatic alternatives to accelerate method…

Information Retrieval · Computer Science 2025-07-15 Naghmeh Farzi , Laura Dietz

We propose an aspect-guided, multi-level perturbation framework to evaluate the robustness of Large Language Models (LLMs) in automated peer review. Our framework explores perturbations in three key components of the peer review…

Computation and Language · Computer Science 2025-02-19 Jiatao Li , Yanheng Li , Xinyu Hu , Mingqi Gao , Xiaojun Wan

In arena-style evaluation of large language models (LLMs), two LLMs respond to a user query, and the user chooses the winning response or deems the "battle" a draw, resulting in an adjustment to the ratings of both models. The prevailing…

Computation and Language · Computer Science 2025-10-03 Raphael Tang , Crystina Zhang , Wenyan Li , Carmen Lai , Pontus Stenetorp , Yao Lu

The evaluation of large language model (LLM) outputs is increasingly performed by other LLMs, a setup commonly known as "LLM-as-a-judge", or autograders. While autograders offer a scalable alternative to human evaluation, they have shown…

Machine Learning · Computer Science 2026-02-27 Magda Dubois , Harry Coppock , Mario Giulianelli , Timo Flesch , Lennart Luettgau , Cozmin Ududec

Recent advances in Large Language Models (LLMs) have sparked wide interest in validating and comprehending the human-like cognitive-behavioral traits LLMs may capture and convey. These cognitive-behavioral traits include typically…

Computation and Language · Computer Science 2024-10-04 Bolei Ma , Xinpeng Wang , Tiancheng Hu , Anna-Carolina Haensch , Michael A. Hedderich , Barbara Plank , Frauke Kreuter