English
Related papers

Related papers: Data Contamination Quiz: A Tool to Detect and Esti…

200 papers

Large-scale models are pretrained on massive web-crawled datasets containing documents of mixed quality, making data filtering essential. A popular method is Classifier-based Quality Filtering (CQF), which trains a binary classifier to…

Machine Learning · Computer Science 2025-10-03 Thiziri Nait Saada , Louis Bethune , Michal Klein , David Grangier , Marco Cuturi , Pierre Ablin

The success of Large Language Models (LLMs) relies heavily on the huge amount of pre-training data learned in the pre-training phase. The opacity of the pre-training process and the training data causes the results of many benchmark tests…

Computation and Language · Computer Science 2025-03-03 Shiwen Ni , Xiangtao Kong , Chengming Li , Xiping Hu , Ruifeng Xu , Jia Zhu , Min Yang

Recent advances in Vision-Language Models (VLMs) have achieved state-of-the-art performance on numerous benchmark tasks. However, the use of internet-scale, often proprietary, pretraining corpora raises a critical concern for both…

Machine Learning · Computer Science 2026-02-03 Jaden Park , Mu Cai , Feng Yao , Jingbo Shang , Soochahn Lee , Yong Jae Lee

Public benchmarks play an essential role in the evaluation of large language models. However, data contamination can lead to inflated performance, rendering them unreliable for model comparison. It is therefore crucial to detect…

Computation and Language · Computer Science 2024-05-28 Jasper Dekoninck , Mark Niklas Müller , Martin Vechev

Benchmark contamination refers to the presence of test datasets in Large Language Model (LLM) pre-training or post-training data. Contamination can lead to inflated scores on benchmarks, compromising evaluation results and making it…

Computation and Language · Computer Science 2024-10-22 Sanchit Ahuja , Varun Gumma , Sunayana Sitaram

Large language models are increasingly trained on all the data ever produced by humans. Many have raised concerns about the trustworthiness of public benchmarks due to potential contamination in pre-training or fine-tuning datasets. While…

Computation and Language · Computer Science 2023-11-14 Shuo Yang , Wei-Lin Chiang , Lianmin Zheng , Joseph E. Gonzalez , Ion Stoica

Evidence-enhanced detectors present remarkable abilities in identifying malicious social text. However, the rise of large language models (LLMs) brings potential risks of evidence pollution to confuse detectors. This paper explores…

Computation and Language · Computer Science 2025-05-30 Herun Wan , Minnan Luo , Zhixiong Su , Guang Dai , Xiang Zhao

Machine learning (ML) technologies have become substantial in practically all aspects of our society, and data quality (DQ) is critical for the performance, fairness, robustness, safety, and scalability of ML models. With the large and…

Machine Learning · Computer Science 2024-07-01 Yuhan Zhou , Fengjiao Tu , Kewei Sha , Junhua Ding , Haihua Chen

Data contamination -- the accidental consumption of evaluation examples within the pre-training data -- can undermine the validity of evaluation benchmarks. In this paper, we present a rigorous analysis of the effects of contamination on…

Computation and Language · Computer Science 2025-02-03 Muhammed Yusuf Kocyigit , Eleftheria Briakou , Daniel Deutsch , Jiaming Luo , Colin Cherry , Markus Freitag

While many have shown how Large Language Models (LLMs) can be applied to a diverse set of tasks, the critical issues of data contamination and memorization are often glossed over. In this work, we address this concern for tabular data.…

Machine Learning · Computer Science 2024-03-12 Sebastian Bordt , Harsha Nori , Rich Caruana

The difficulty of multiple-choice questions (MCQs) is a crucial factor for educational assessments. Predicting MCQ difficulty is challenging since it requires understanding both the complexity of reaching the correct option and the…

Artificial Intelligence · Computer Science 2025-03-12 Wanyong Feng , Peter Tran , Stephen Sireci , Andrew Lan

While large language models have achieved remarkable performance on various code generation benchmarks, there have been growing concerns regarding potential contamination of these benchmarks as they may be leaked into pretraining and…

Software Engineering · Computer Science 2024-03-11 Martin Riddell , Ansong Ni , Arman Cohan

As Large Language Models (LLMs) are pre-trained on ultra-large-scale corpora, the problem of data contamination is becoming increasingly serious, and there is a risk that static evaluation benchmarks overestimate the performance of LLMs. To…

Computation and Language · Computer Science 2025-08-13 Yang Fan

The emerging success of large language models (LLMs) heavily relies on collecting abundant training data from external (untrusted) sources. Despite substantial efforts devoted to data cleaning and curation, well-constructed LLMs have been…

Computation and Language · Computer Science 2024-02-26 Tianlin Li , Qian Liu , Tianyu Pang , Chao Du , Qing Guo , Yang Liu , Min Lin

Question decomposition has emerged as an effective strategy for prompting Large Language Models (LLMs) to answer complex questions. However, while existing methods primarily focus on unimodal language models, the question decomposition…

Computation and Language · Computer Science 2024-10-08 Haowei Zhang , Jianzhe Liu , Zhen Han , Shuo Chen , Bailan He , Volker Tresp , Zhiqiang Xu , Jindong Gu

Data contamination hinders fair LLM evaluation by introducing test data into newer models' training sets. Existing studies solve this challenge by updating benchmarks with newly collected data. However, they fail to guarantee…

Computation and Language · Computer Science 2025-05-30 Xiaobao Wu , Liangming Pan , Yuxi Xie , Ruiwen Zhou , Shuai Zhao , Yubo Ma , Mingzhe Du , Rui Mao , Anh Tuan Luu , William Yang Wang

Large Language Models (LLMs) have revolutionized code generation, achieving exceptional results on various established benchmarking frameworks. However, concerns about data contamination - where benchmark data inadvertently leaks into…

Hardware Architecture · Computer Science 2025-06-13 Zeng Wang , Minghao Shao , Jitendra Bhandari , Likhitha Mankali , Ramesh Karri , Ozgur Sinanoglu , Muhammad Shafique , Johann Knechtel

Large language models (LLMs) have demonstrated impressive reasoning abilities across a wide range of tasks, but data contamination undermines the objective evaluation of these capabilities. This problem is further exacerbated by malicious…

Machine Learning · Computer Science 2026-05-22 Yifan Lan , Yuanpu Cao , Hanyu Wang , Lu Lin , Jinghui Chen

Automatic evaluation methods for large language models (LLMs) are hindered by data contamination, leading to inflated assessments of their effectiveness. Existing strategies, which aim to detect contaminated texts, focus on quantifying…

Computation and Language · Computer Science 2024-06-04 Zhuohao Yu , Chang Gao , Wenjin Yao , Yidong Wang , Wei Ye , Jindong Wang , Xing Xie , Yue Zhang , Shikun Zhang

Automatically extracting effective queries is challenging in information retrieval, especially in toxic content exploration, as such content is likely to be disguised. With the recent achievements in generative Large Language Model (LLM),…

Information Retrieval · Computer Science 2025-02-27 Shaola Ren , Li Ke , Longtao Huang , Dehong Gao , Hui Xue