English
Related papers

Related papers: Towards Data Contamination Detection for Modern La…

200 papers

CDD, or Contamination Detection via output Distribution, identifies data contamination by measuring the peakedness of a model's sampled outputs. We study the conditions under which this approach succeeds and fails on small language models…

Artificial Intelligence · Computer Science 2026-03-12 Omer Sela

Evaluating large language models (LLMs) is increasingly confounded by \emph{variant contamination}: the training corpus contains semantically equivalent yet lexically or syntactically altered versions of test items. Unlike verbatim leakage,…

Artificial Intelligence · Computer Science 2026-01-09 Renzhao Liang , Jingru Chen , Bo Jia , Bo Deng , Chenggang Xie , Yidong Wang , Ke Jin , Xin Wang , Linfeng Zhang , Cunxiang Wang

In the pursuit of developing Large Language Models (LLMs) that adhere to societal standards, it is imperative to detect the toxicity in the generated text. The majority of existing toxicity metrics rely on encoder models trained on specific…

Computation and Language · Computer Science 2024-11-15 Hyukhun Koh , Dohyung Kim , Minwoo Lee , Kyomin Jung

The rapid advancements of Large Language Models (LLMs) tightly associate with the expansion of the training data size. However, the unchecked ultra-large-scale training sets introduce a series of potential risks like data contamination,…

Machine Learning · Computer Science 2024-06-04 Wentao Ye , Jiaqi Hu , Liyao Li , Haobo Wang , Gang Chen , Junbo Zhao

Detecting text generated by large language models (LLMs) is of great recent interest. With zero-shot methods like DetectGPT, detection capabilities have reached impressive levels. However, the reliability of existing detectors in real-world…

Computation and Language · Computer Science 2025-03-13 Junchao Wu , Runzhe Zhan , Derek F. Wong , Shu Yang , Xinyi Yang , Yulin Yuan , Lidia S. Chao

With the widespread availability of pretrained Large Language Models (LLMs) and their training datasets, concerns about the security risks associated with their usage has increased significantly. One of these security risks is the threat of…

Cryptography and Security · Computer Science 2025-06-10 Neil Fendley , Edward W. Staley , Joshua Carney , William Redman , Marie Chau , Nathan Drenkow

Data contamination -- the accidental consumption of evaluation examples within the pre-training data -- can undermine the validity of evaluation benchmarks. In this paper, we present a rigorous analysis of the effects of contamination on…

Computation and Language · Computer Science 2025-02-03 Muhammed Yusuf Kocyigit , Eleftheria Briakou , Daniel Deutsch , Jiaming Luo , Colin Cherry , Markus Freitag

Large language models are trained on vast amounts of internet data, prompting concerns and speculation that they have memorized public benchmarks. Going from speculation to proof of contamination is challenging, as the pretraining data used…

Computation and Language · Computer Science 2023-11-27 Yonatan Oren , Nicole Meister , Niladri Chatterji , Faisal Ladhak , Tatsunori B. Hashimoto

Recently, advances in deep learning have been observed in various fields, including computer vision, natural language processing, and cybersecurity. Machine learning (ML) has demonstrated its ability as a potential tool for anomaly…

Cryptography and Security · Computer Science 2023-10-31 D'Jeff Kanda Nkashama , Arian Soltani , Jean-Charles Verdier , Marc Frappier , Pierre-Martin Tardif , Froduald Kabanza

We are currently in an era of fierce competition among various large language models (LLMs) continuously pushing the boundaries of benchmark performance. However, genuinely assessing the capabilities of these LLMs has become a challenging…

Computation and Language · Computer Science 2024-06-04 Wenhong Zhu , Hongkun Hao , Zhiwei He , Yunze Song , Yumeng Zhang , Hanxu Hu , Yiran Wei , Rui Wang , Hongyuan Lu

Publishing a large language model (LLM) benchmark on the Internet risks contaminating future LLMs: the benchmark may be unintentionally (or intentionally) used to train or select a model. A common mitigation is to keep the benchmark private…

Machine Learning · Computer Science 2025-10-07 Takashi Ishida , Thanawat Lodkaew , Ikko Yamane

The advancement of large language models (LLMs) relies on evaluation using public benchmarks, but data contamination can lead to overestimated performance. Previous researches focus on detecting contamination by determining whether the…

Computation and Language · Computer Science 2024-09-24 Shangqing Tu , Kejian Zhu , Yushi Bai , Zijun Yao , Lei Hou , Juanzi Li

The advancement of large language models (LLMs) has led to a greater challenge of having a rigorous and systematic evaluation of complex tasks performed, especially in enterprise applications. Therefore, LLMs need to be able to benchmark…

Computation and Language · Computer Science 2024-10-18 Bing Zhang , Mikio Takeuchi , Ryo Kawahara , Shubhi Asthana , Md. Maruf Hossain , Guang-Jie Ren , Kate Soule , Yada Zhu

With the increasing reliance on LLMs as research agents, distinguishing between LLM and human-generated ideas has become crucial for understanding the cognitive nuances of LLMs' research capabilities. While detecting LLM-generated text has…

Machine Learning · Computer Science 2025-12-08 Sadat Shahriar , Navid Ayoobi , Arjun Mukherjee

Large language models (LLMs) are commonly evaluated on challenging benchmarks such as AIME and Math500, where benchmark contamination can make memorized solutions appear as genuine reasoning. Existing detection methods largely rely on…

Computation and Language · Computer Science 2026-05-12 Zirui He , Haiyan Zhao , Yingcong Li , Ali Payani , Mengnan du

Benchmark contamination refers to the presence of test datasets in Large Language Model (LLM) pre-training or post-training data. Contamination can lead to inflated scores on benchmarks, compromising evaluation results and making it…

Computation and Language · Computer Science 2024-10-22 Sanchit Ahuja , Varun Gumma , Sunayana Sitaram

Large Language Models (LLMs) have shown their impressive capabilities, while also raising concerns about the data contamination problems due to privacy issues and leakage of benchmark datasets in the pre-training phase. Therefore, it is…

Computation and Language · Computer Science 2024-06-04 Zhenhua Liu , Tong Zhu , Chuanyuan Tan , Haonan Lu , Bing Liu , Wenliang Chen

Large language models (LLMs) have exploded in popularity due to their ability to perform a wide array of natural language tasks. Text-based content moderation is one LLM use case that has received recent enthusiasm, however, there is little…

Human-Computer Interaction · Computer Science 2024-01-18 Deepak Kumar , Yousef AbuHashem , Zakir Durumeric

Existing approaches for Large language model (LLM) detoxification generally rely on training on large-scale non-toxic or human-annotated preference data, designing prompts to instruct the LLM to generate safe content, or modifying the model…

Computation and Language · Computer Science 2025-06-03 Yuanhe Tian , Mingjie Deng , Guoqing Jin , Yan Song

While large language models (LLMs) present significant potential for supporting numerous real-world applications and delivering positive social impacts, they still face significant challenges in terms of the inherent risk of privacy…

Artificial Intelligence · Computer Science 2025-01-17 Huandong Wang , Wenjie Fu , Yingzhou Tang , Zhilong Chen , Yuxi Huang , Jinghua Piao , Chen Gao , Fengli Xu , Tao Jiang , Yong Li
‹ Prev 1 3 4 5 6 7 10 Next ›