English
Related papers

Related papers: When LLMs Benchmark Themselves: Deconstructing Sel…

200 papers

Automatic evaluation using multimodal large language models (MLLMs), commonly referred to as MLLM-as-a-Judge, has been widely used to measure model performance. If such MLLM-as-a-Judge methods were biased, they could distort model…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Shuitsu Koyama , Yuiga Wada , Daichi Yashima , Komei Sugiura

Large language models (LLMs) have shown remarkable adaptability to diverse tasks, by leveraging context prompts containing instructions, or minimal input-output examples. However, recent work revealed they also exhibit label bias -- an…

Computation and Language · Computer Science 2024-05-07 Yuval Reif , Roy Schwartz

The growing prominence of large language models (LLMs) in daily life has heightened concerns that LLMs exhibit many of the same gender-related biases as their creators. In the context of hiring decisions, we quantify the degree to which…

Computers and Society · Computer Science 2026-04-02 Nina Gerszberg , Janka Hamori , Andrew Lo

Critical thinking is essential for rational decision-making and problem-solving. This skill hinges on the ability to provide precise and reasoned critiques and is a hallmark of human intelligence. In the era of large language models (LLMs),…

Machine Learning · Computer Science 2023-10-10 Liangchen Luo , Zi Lin , Yinxiao Liu , Lei Shu , Yun Zhu , Jingbo Shang , Lei Meng

Large Language Model (LLM)-based systems present new opportunities for autonomous health monitoring in sensor-rich industrial environments. This study explores the potential of LLMs to detect and classify faults directly from sensor data,…

Artificial Intelligence · Computer Science 2025-09-30 Xian Yeow Lee , Lasitha Vidyaratne , Ahmed Farahat , Chetan Gupta

As frontier Large Language Models (LLMs) increasingly saturate new benchmarks shortly after they are published, benchmarking itself is at a juncture: if frontier models keep improving, it will become increasingly hard for humans to generate…

Natural language processing (NLP) systems are increasingly trained to generate open-ended text rather than classifying between responses. This makes research on evaluation metrics for generated language -- functions that score system output…

Computation and Language · Computer Science 2021-10-19 Thomas Scialom , Felix Hill

Large Language Models (LLMs) push the bound-aries in natural language processing and generative AI, driving progress across various aspects of modern society. Unfortunately, the pervasive issue of bias in LLMs responses (i.e., predictions)…

Computation and Language · Computer Science 2025-05-20 Isabela Pereira Gregio , Ian Pons , Anna Helena Reali Costa , Artur Jordão

In the rapidly evolving field of Explainable Natural Language Processing (NLP), textual explanations, i.e., human-like rationales, are pivotal for explaining model predictions and enriching datasets with interpretable labels. Traditional…

Computation and Language · Computer Science 2025-11-12 Mahdi Dhaini , Juraj Vladika , Ege Erdogan , Zineb Attaoui , Gjergji Kasneci

Using Large Language Models (LLMs) for relevance assessments offers promising opportunities to improve Information Retrieval (IR), Natural Language Processing (NLP), and related fields. Indeed, LLMs hold the promise of allowing IR…

Data contamination hinders fair LLM evaluation by introducing test data into newer models' training sets. Existing studies solve this challenge by updating benchmarks with newly collected data. However, they fail to guarantee…

Computation and Language · Computer Science 2025-05-30 Xiaobao Wu , Liangming Pan , Yuxi Xie , Ruiwen Zhou , Shuai Zhao , Yubo Ma , Mingzhe Du , Rui Mao , Anh Tuan Luu , William Yang Wang

Large language models (LLMs) exhibit cognitive biases -- systematic tendencies of irrational decision-making, similar to those seen in humans. Prior work has found that these biases vary across models and can be amplified by instruction…

Computation and Language · Computer Science 2025-07-15 Itay Itzhak , Yonatan Belinkov , Gabriel Stanovsky

Large language models (LLMs) have revolutionised many fields, with LLM-as-a-service (LLMSaaS) offering accessible, general-purpose solutions without costly task-specific training. In contrast to the widely studied prompt engineering for…

Computation and Language · Computer Science 2026-03-17 Md Rakibul Hasan , Yue Yao , Md Zakir Hossain , Aneesh Krishna , Imre Rudas , Shafin Rahman , Tom Gedeon

Recent observations have underscored a disparity between the inflated benchmark scores and the actual performance of LLMs, raising concerns about potential contamination of evaluation benchmarks. This issue is especially critical for…

Computation and Language · Computer Science 2024-04-05 Chunyuan Deng , Yilun Zhao , Xiangru Tang , Mark Gerstein , Arman Cohan

As large language models (LLMs) continue to advance, accurately and comprehensively evaluating their performance becomes increasingly challenging. Ranking the relative performance of LLMs based on Elo ratings, according to human judgment,…

Computation and Language · Computer Science 2023-11-14 Minghao Wu , Alham Fikri Aji

The expanding integration of Large Language Models (LLMs) into recommender systems poses critical challenges to evaluation reliability. This paper identifies and investigates a previously overlooked issue: benchmark data leakage in…

Machine Learning · Computer Science 2026-05-27 Mingqiao Zhang , Qiyao Peng , Yinghui Wang , Hongtao Liu , Yumeng Wang

Language model benchmarks are pervasive and computationally-efficient proxies for real-world performance. However, many recent works find that benchmarks often fail to predict real utility. Towards bridging this gap, we introduce benchmark…

Artificial Intelligence · Computer Science 2026-05-28 Marco Gutierrez , Xinyi Leng , Hannah Cyberey , Jonathan Richard Schwarz , Ahmed Alaa , Thomas Hartvigsen

Large Language Models (LLMs) have revolutionized artificial intelligence, demonstrating remarkable computational power and linguistic capabilities. However, these models are inherently prone to various biases stemming from their training…

Computation and Language · Computer Science 2025-02-14 Riccardo Cantini , Giada Cosenza , Alessio Orsino , Domenico Talia

Large Language Models (LLMs) have achieved impressive performance across various reasoning tasks. However, even state-of-the-art LLMs such as ChatGPT are prone to logical errors during their reasoning processes. Existing solutions, such as…

Computation and Language · Computer Science 2024-03-25 Chi Hu , Yuan Ge , Xiangnan Ma , Hang Cao , Qiang Li , Yonghua Yang , Tong Xiao , Jingbo Zhu

Large Language Models (LLMs) are widely used for text generation, making it crucial to address potential bias. This study investigates ideological framing bias in LLM-generated articles, focusing on the subtle and subjective nature of such…

Computation and Language · Computer Science 2026-01-13 Molly Kennedy , Ayyoob Imani , Timo Spinde , Akiko Aizawa , Hinrich Schütze