English
Related papers

Related papers: Towards Contamination Resistant Benchmarks

200 papers

With the rise of Large Language Models (LLMs) in recent years, abundant new opportunities are emerging, but also new challenges, among which contamination is quickly becoming critical. Business applications and fundraising in Artificial…

Computation and Language · Computer Science 2025-07-11 Mathieu Ravaut , Bosheng Ding , Fangkai Jiao , Hailin Chen , Xingxuan Li , Ruochen Zhao , Chengwei Qin , Caiming Xiong , Shafiq Joty

The opacity in developing large language models (LLMs) is raising growing concerns about the potential contamination of public benchmarks in the pre-training data. Existing contamination detection methods are typically based on the text…

Computation and Language · Computer Science 2024-10-31 Feng Yao , Yufan Zhuang , Zihao Sun , Sunan Xu , Animesh Kumar , Jingbo Shang

Data contamination has received increasing attention in the era of large language models (LLMs) due to their reliance on vast Internet-derived training corpora. To mitigate the risk of potential data contamination, LLM benchmarking has…

Machine Learning · Computer Science 2025-10-01 Simin Chen , Yiming Chen , Zexin Li , Yifan Jiang , Zhongwei Wan , Yixin He , Dezhi Ran , Tianle Gu , Haizhou Li , Tao Xie , Baishakhi Ray

As large language models achieve increasingly impressive results, questions arise about whether such performance is from generalizability or mere data memorization. Thus, numerous data contamination detection methods have been proposed.…

Computation and Language · Computer Science 2024-12-10 Vinay Samuel , Yue Zhou , Henry Peng Zou

Test set contamination, wherein test data from a benchmark ends up in a newer model's training set, is a well-documented obstacle for fair LLM evaluation and can quickly render benchmarks obsolete. To mitigate this, many recent benchmarks…

Recent advancements in Large Language Models (LLMs) have demonstrated significant progress in various areas, such as text generation and code synthesis. However, the reliability of performance evaluation has come under scrutiny due to data…

Computation and Language · Computer Science 2025-06-06 Yuxing Cheng , Yi Chang , Yuan Wu

Large language models (LLMs) are known to be trained on vast amounts of data, which may unintentionally or intentionally include data from commonly used benchmarks. This inclusion can lead to cheatingly high scores on model leaderboards,…

Computation and Language · Computer Science 2025-03-19 Huixuan Zhang , Yun Lin , Xiaojun Wan

Benchmark contamination poses a significant challenge to the reliability of Large Language Models (LLMs) evaluations, as it is difficult to assert whether a model has been trained on a test set. We introduce a solution to this problem by…

Cryptography and Security · Computer Science 2025-07-22 Tom Sander , Pierre Fernandez , Saeed Mahloujifar , Alain Durmus , Chuan Guo

Public benchmarks increasingly govern how large language models (LLMs) are ranked, selected, and deployed. We frame this benchmark-centered regime as Silicon Bureaucracy and AI Test-Oriented Education, and argue that it rests on a fragile…

Artificial Intelligence · Computer Science 2026-03-31 Yiliang Song , Hongjun An , Jiangan Chen , Xuanchen Yan , Huan Song , Jiawei Shao , Xuelong Li

Benchmark datasets are critical for reproducible, reliable, and discriminative evaluation of LLMs. However, recent studies reveal that many benchmark datasets are included in pretraining corpora, i.e., $\textit{contaminated}$, which…

Machine Learning · Computer Science 2026-05-20 Ali Al-Lawati , Jason Lucas , Dongwon Lee , Suhang Wang

Benchmark contamination refers to the presence of test datasets in Large Language Model (LLM) pre-training or post-training data. Contamination can lead to inflated scores on benchmarks, compromising evaluation results and making it…

Computation and Language · Computer Science 2024-10-22 Sanchit Ahuja , Varun Gumma , Sunayana Sitaram

Large language models (LLMs) are widely used, but concerns about data contamination challenge the reliability of LLM evaluations. Existing contamination detection methods are often task-specific or require extra prerequisites, limiting…

Computation and Language · Computer Science 2024-10-22 Yi Zhao , Jing Li , Linyi Yang

Large language models (LLMs) are increasingly exposed to data contamination, i.e., performance gains driven by prior exposure of test datasets rather than generalization. However, in the context of tabular data, this problem is largely…

Computation and Language · Computer Science 2026-03-31 Matteo Silvestri , Fabiano Veglianti , Flavio Giorgi , Fabrizio Silvestri , Gabriele Tolomei

Data contamination hinders fair LLM evaluation by introducing test data into newer models' training sets. Existing studies solve this challenge by updating benchmarks with newly collected data. However, they fail to guarantee…

Computation and Language · Computer Science 2025-05-30 Xiaobao Wu , Liangming Pan , Yuxi Xie , Ruiwen Zhou , Shuai Zhao , Yubo Ma , Mingzhe Du , Rui Mao , Anh Tuan Luu , William Yang Wang

The rapid development of Large Language Models (LLMs) like GPT-4, Claude-3, and Gemini has transformed the field of natural language processing. However, it has also resulted in a significant issue known as Benchmark Data Contamination…

Computation and Language · Computer Science 2024-06-07 Cheng Xu , Shuhao Guan , Derek Greene , M-Tahar Kechadi

In this position paper, we argue that the classical evaluation on Natural Language Processing (NLP) tasks using annotated benchmarks is in trouble. The worst kind of data contamination happens when a Large Language Model (LLM) is trained on…

Computation and Language · Computer Science 2023-10-30 Oscar Sainz , Jon Ander Campos , Iker García-Ferrero , Julen Etxaniz , Oier Lopez de Lacalle , Eneko Agirre

Benchmark-based evaluation is the de facto standard for comparing large language models (LLMs). However, its reliability is increasingly threatened by test set contamination, where test samples or their close variants leak into training…

Computation and Language · Computer Science 2026-01-28 Jianzhe Chai , Yu Zhe , Jun Sakuma

When deploying large language models (LLMs), it is important to ensure that these models are not only capable, but also reliable. Many benchmarks have been created to track LLMs' growing capabilities, however there has been no similar focus…

Machine Learning · Computer Science 2025-02-06 Joshua Vendrow , Edward Vendrow , Sara Beery , Aleksander Madry

Publishing a large language model (LLM) benchmark on the Internet risks contaminating future LLMs: the benchmark may be unintentionally (or intentionally) used to train or select a model. A common mitigation is to keep the benchmark private…

Machine Learning · Computer Science 2025-10-07 Takashi Ishida , Thanawat Lodkaew , Ikko Yamane

While large language models have achieved remarkable performance on various code generation benchmarks, there have been growing concerns regarding potential contamination of these benchmarks as they may be leaked into pretraining and…

Software Engineering · Computer Science 2024-03-11 Martin Riddell , Ansong Ni , Arman Cohan
‹ Prev 1 2 3 10 Next ›