English
Related papers

Related papers: An Open Source Data Contamination Report for Large…

200 papers

We propose the Data Contamination Quiz (DCQ), a simple and effective approach to detect data contamination in large language models (LLMs) and estimate the amount of it. Specifically, we frame data contamination detection as a series of…

Computation and Language · Computer Science 2025-04-29 Shahriar Golchin , Mihai Surdeanu

Language models pre-trained on web-scale corpora demonstrate impressive capabilities on diverse downstream tasks. However, there is increasing concern whether such capabilities might arise from evaluation datasets being included in the…

Computation and Language · Computer Science 2024-01-12 Minhao Jiang , Ken Ziyu Liu , Ming Zhong , Rylan Schaeffer , Siru Ouyang , Jiawei Han , Sanmi Koyejo

Natural Language Processing (NLP) research is increasingly focusing on the use of Large Language Models (LLMs), with some of the most popular ones being either fully or partially closed-source. The lack of access to model details,…

Computation and Language · Computer Science 2024-02-23 Simone Balloccu , Patrícia Schmidtová , Mateusz Lango , Ondřej Dušek

Large language models are trained on vast amounts of internet data, prompting concerns and speculation that they have memorized public benchmarks. Going from speculation to proof of contamination is challenging, as the pretraining data used…

Computation and Language · Computer Science 2023-11-27 Yonatan Oren , Nicole Meister , Niladri Chatterji , Faisal Ladhak , Tatsunori B. Hashimoto

The problem of data contamination is now almost inevitable during the development of large language models (LLMs), with the training data commonly integrating those evaluation benchmarks even unintentionally. This problem subsequently makes…

Computation and Language · Computer Science 2025-09-19 Ruijie Hou , Yueyang Jiao , Hanxu Hu , Yingming Li , Wai Lam , Huajian Zhang , Hongyuan Lu

We are currently in an era of fierce competition among various large language models (LLMs) continuously pushing the boundaries of benchmark performance. However, genuinely assessing the capabilities of these LLMs has become a challenging…

Computation and Language · Computer Science 2024-06-04 Wenhong Zhu , Hongkun Hao , Zhiwei He , Yunze Song , Yumeng Zhang , Hanxu Hu , Yiran Wei , Rui Wang , Hongyuan Lu

Data contamination has received increasing attention in the era of large language models (LLMs) due to their reliance on vast Internet-derived training corpora. To mitigate the risk of potential data contamination, LLM benchmarking has…

Machine Learning · Computer Science 2025-10-01 Simin Chen , Yiming Chen , Zexin Li , Yifan Jiang , Zhongwei Wan , Yixin He , Dezhi Ran , Tianle Gu , Haizhou Li , Tao Xie , Baishakhi Ray

As large language models achieve impressive scores on traditional benchmarks, an increasing number of researchers are becoming concerned about benchmark data leakage during pre-training, commonly known as the data contamination problem. To…

Computation and Language · Computer Science 2024-06-27 Kun Qian , Shunji Wan , Claudia Tang , Youzhi Wang , Xuanming Zhang , Maximillian Chen , Zhou Yu

Large language models are increasingly trained on all the data ever produced by humans. Many have raised concerns about the trustworthiness of public benchmarks due to potential contamination in pre-training or fine-tuning datasets. While…

Computation and Language · Computer Science 2023-11-14 Shuo Yang , Wei-Lin Chiang , Lianmin Zheng , Joseph E. Gonzalez , Ion Stoica

Preference learning is a central component for aligning current LLMs, but this process can be vulnerable to data poisoning attacks. To address this concern, we introduce PoisonBench, a benchmark for evaluating large language models'…

Cryptography and Security · Computer Science 2025-06-09 Tingchen Fu , Mrinank Sharma , Philip Torr , Shay B. Cohen , David Krueger , Fazl Barez

Data contamination, i.e., the presence of test data from downstream tasks in the training data of large language models (LLMs), is a potential major issue in measuring LLMs' real effectiveness on other tasks. We propose a straightforward…

Computation and Language · Computer Science 2024-02-23 Shahriar Golchin , Mihai Surdeanu

The emerging success of large language models (LLMs) heavily relies on collecting abundant training data from external (untrusted) sources. Despite substantial efforts devoted to data cleaning and curation, well-constructed LLMs have been…

Computation and Language · Computer Science 2024-02-26 Tianlin Li , Qian Liu , Tianyu Pang , Chao Du , Qing Guo , Yang Liu , Min Lin

Pretrained language models are typically trained on massive web-based datasets, which are often "contaminated" with downstream test sets. It is not clear to what extent models exploit the contaminated data for downstream tasks. We present a…

Computation and Language · Computer Science 2022-03-17 Inbal Magar , Roy Schwartz

Large language models (LLMs) are known to be trained on vast amounts of data, which may unintentionally or intentionally include data from commonly used benchmarks. This inclusion can lead to cheatingly high scores on model leaderboards,…

Computation and Language · Computer Science 2025-03-19 Huixuan Zhang , Yun Lin , Xiaojun Wan

In recent years, code intelligence has gained increasing importance in the field of automated software engineering. Meanwhile, the widespread adoption of Pretrained Language Models (PLMs) and Large Language Models (LLMs) has raised concerns…

Software Engineering · Computer Science 2026-02-09 Zhen Yang , Hongyi Lin , Yifan He , Junqi Wang , Zeyu Sun , Shuo Liu , Jie Xu , Pengpeng Wang , Zhongxing Yu , Qingyuan Liang

Recent advances in large language models (LLMs) have shown significant promise, yet their evaluation raises concerns, particularly regarding data contamination due to the lack of access to proprietary training data. To address this issue,…

Computation and Language · Computer Science 2025-05-30 Yanyang Li , Tin Long Wong , Cheung To Hung , Jianqiao Zhao , Duo Zheng , Ka Wai Liu , Michael R. Lyu , Liwei Wang

The leakage of benchmark data into the training data has emerged as a significant challenge for evaluating the capabilities of large language models (LLMs). In this work, we challenge the common assumption that small-scale contamination…

Machine Learning · Computer Science 2025-06-17 Sebastian Bordt , Suraj Srinivas , Valentyn Boreiko , Ulrike von Luxburg

Multimodal Large Language Models (MLLMs) show impressive vision-language benchmark performance, yet growing concerns about data contamination (test set exposure during training) risk masking true generalization. This concern extends to…

Artificial Intelligence · Computer Science 2025-06-10 Ming Liu , Wensheng Zhang

Large Language Models (LLMs) have revolutionized code generation, achieving exceptional results on various established benchmarking frameworks. However, concerns about data contamination - where benchmark data inadvertently leaks into…

Hardware Architecture · Computer Science 2025-06-13 Zeng Wang , Minghao Shao , Jitendra Bhandari , Likhitha Mankali , Ramesh Karri , Ozgur Sinanoglu , Muhammad Shafique , Johann Knechtel

The rapid evolution of code largelanguage models underscores the need for effective and transparent benchmarking of their reasoning capabilities. However, the current benchmarking approach heavily depends on publicly available,…

Software Engineering · Computer Science 2025-06-05 Simin Chen , Pranav Pusarla , Baishakhi Ray