English
Related papers

Related papers: When Benchmarks Leak: Inference-Time Decontaminati…

200 papers

Large language models are increasingly trained on all the data ever produced by humans. Many have raised concerns about the trustworthiness of public benchmarks due to potential contamination in pre-training or fine-tuning datasets. While…

Computation and Language · Computer Science 2023-11-14 Shuo Yang , Wei-Lin Chiang , Lianmin Zheng , Joseph E. Gonzalez , Ion Stoica

The opacity in developing large language models (LLMs) is raising growing concerns about the potential contamination of public benchmarks in the pre-training data. Existing contamination detection methods are typically based on the text…

Computation and Language · Computer Science 2024-10-31 Feng Yao , Yufan Zhuang , Zihao Sun , Sunan Xu , Animesh Kumar , Jingbo Shang

The training process of large language models (LLMs) often involves varying degrees of test data contamination. Although current LLMs are achieving increasingly better performance on various benchmarks, their performance in practical…

Computation and Language · Computer Science 2024-06-25 Qin Zhu , Qingyuan Cheng , Runyu Peng , Xiaonan Li , Tengxiao Liu , Ru Peng , Xipeng Qiu , Xuanjing Huang

Data contamination hinders fair LLM evaluation by introducing test data into newer models' training sets. Existing studies solve this challenge by updating benchmarks with newly collected data. However, they fail to guarantee…

Computation and Language · Computer Science 2025-05-30 Xiaobao Wu , Liangming Pan , Yuxi Xie , Ruiwen Zhou , Shuai Zhao , Yubo Ma , Mingzhe Du , Rui Mao , Anh Tuan Luu , William Yang Wang

The problem of data contamination is now almost inevitable during the development of large language models (LLMs), with the training data commonly integrating those evaluation benchmarks even unintentionally. This problem subsequently makes…

Computation and Language · Computer Science 2025-09-19 Ruijie Hou , Yueyang Jiao , Hanxu Hu , Yingming Li , Wai Lam , Huajian Zhang , Hongyuan Lu

Publishing a large language model (LLM) benchmark on the Internet risks contaminating future LLMs: the benchmark may be unintentionally (or intentionally) used to train or select a model. A common mitigation is to keep the benchmark private…

Machine Learning · Computer Science 2025-10-07 Takashi Ishida , Thanawat Lodkaew , Ikko Yamane

In this position paper, we argue that the classical evaluation on Natural Language Processing (NLP) tasks using annotated benchmarks is in trouble. The worst kind of data contamination happens when a Large Language Model (LLM) is trained on…

Computation and Language · Computer Science 2023-10-30 Oscar Sainz , Jon Ander Campos , Iker García-Ferrero , Julen Etxaniz , Oier Lopez de Lacalle , Eneko Agirre

Recent advancements in Large Language Models (LLMs) have demonstrated significant progress in various areas, such as text generation and code synthesis. However, the reliability of performance evaluation has come under scrutiny due to data…

Computation and Language · Computer Science 2025-06-06 Yuxing Cheng , Yi Chang , Yuan Wu

In machine learning, contamination refers to situations where testing data leak into the training set. The issue is particularly relevant for the evaluation of the performance of Large Language Models (LLMs), which are generally trained on…

Computation and Language · Computer Science 2025-06-23 Nicolas Yax , Pierre-Yves Oudeyer , Stefano Palminteri

The expanding integration of Large Language Models (LLMs) into recommender systems poses critical challenges to evaluation reliability. This paper identifies and investigates a previously overlooked issue: benchmark data leakage in…

Machine Learning · Computer Science 2026-05-27 Mingqiao Zhang , Qiyao Peng , Yinghui Wang , Hongtao Liu , Yumeng Wang

Benchmark contamination poses a significant challenge to the reliability of Large Language Models (LLMs) evaluations, as it is difficult to assert whether a model has been trained on a test set. We introduce a solution to this problem by…

Cryptography and Security · Computer Science 2025-07-22 Tom Sander , Pierre Fernandez , Saeed Mahloujifar , Alain Durmus , Chuan Guo

Large language models pretrained on extensive web corpora demonstrate remarkable performance across a wide range of downstream tasks. However, a growing concern is data contamination, where evaluation datasets may be contained in the…

Computation and Language · Computer Science 2024-07-12 Medha Palavalli , Amanda Bertsch , Matthew R. Gormley

Amid the expanding use of pre-training data, the phenomenon of benchmark dataset leakage has become increasingly prominent, exacerbated by opaque training processes and the often undisclosed inclusion of supervised data in contemporary…

Computation and Language · Computer Science 2024-04-30 Ruijie Xu , Zengzhi Wang , Run-Ze Fan , Pengfei Liu

Benchmark contamination refers to the presence of test datasets in Large Language Model (LLM) pre-training or post-training data. Contamination can lead to inflated scores on benchmarks, compromising evaluation results and making it…

Computation and Language · Computer Science 2024-10-22 Sanchit Ahuja , Varun Gumma , Sunayana Sitaram

Large language models (LLMs) are known to be trained on vast amounts of data, which may unintentionally or intentionally include data from commonly used benchmarks. This inclusion can lead to cheatingly high scores on model leaderboards,…

Computation and Language · Computer Science 2025-03-19 Huixuan Zhang , Yun Lin , Xiaojun Wan

Benchmark datasets are critical for reproducible, reliable, and discriminative evaluation of LLMs. However, recent studies reveal that many benchmark datasets are included in pretraining corpora, i.e., $\textit{contaminated}$, which…

Machine Learning · Computer Science 2026-05-20 Ali Al-Lawati , Jason Lucas , Dongwon Lee , Suhang Wang

Recent observations have underscored a disparity between the inflated benchmark scores and the actual performance of LLMs, raising concerns about potential contamination of evaluation benchmarks. This issue is especially critical for…

Computation and Language · Computer Science 2024-04-05 Chunyuan Deng , Yilun Zhao , Xiangru Tang , Mark Gerstein , Arman Cohan

Public benchmarks play an essential role in the evaluation of large language models. However, data contamination can lead to inflated performance, rendering them unreliable for model comparison. It is therefore crucial to detect…

Computation and Language · Computer Science 2024-05-28 Jasper Dekoninck , Mark Niklas Müller , Martin Vechev

Data contamination has received increasing attention in the era of large language models (LLMs) due to their reliance on vast Internet-derived training corpora. To mitigate the risk of potential data contamination, LLM benchmarking has…

Machine Learning · Computer Science 2025-10-01 Simin Chen , Yiming Chen , Zexin Li , Yifan Jiang , Zhongwei Wan , Yixin He , Dezhi Ran , Tianle Gu , Haizhou Li , Tao Xie , Baishakhi Ray

Public benchmarks increasingly govern how large language models (LLMs) are ranked, selected, and deployed. We frame this benchmark-centered regime as Silicon Bureaucracy and AI Test-Oriented Education, and argue that it rests on a fragile…

Artificial Intelligence · Computer Science 2026-03-31 Yiliang Song , Hongjun An , Jiangan Chen , Xuanchen Yan , Huan Song , Jiawei Shao , Xuelong Li
‹ Prev 1 2 3 10 Next ›