English
Related papers

Related papers: Evading Data Contamination Detection for Language …

200 papers

Large scale adoption of large language models has introduced a new era of convenient knowledge transfer for a slew of natural language processing tasks. However, these models also run the risk of undermining user trust by exposing unwanted…

Computation and Language · Computer Science 2022-04-21 Richard Plant , Valerio Giuffrida , Dimitra Gkatzia

Machine unlearning aims to remove sensitive or undesired data from large language models. However, recent studies suggest that unlearning is often shallow, claiming that removed knowledge can easily be recovered. In this work, we critically…

Machine Learning · Computer Science 2025-06-03 Zhili Feng , Yixuan Even Xu , Alexander Robey , Robert Kirk , Xander Davies , Yarin Gal , Avi Schwarzschild , J. Zico Kolter

Large language models (LLMs) have become integral to our professional workflows and daily lives. Nevertheless, these machine companions of ours have a critical flaw: the huge amount of data which endows them with vast and diverse knowledge,…

Computation and Language · Computer Science 2024-05-21 Tinh Son Luong , Thanh-Thien Le , Linh Ngo Van , Thien Huu Nguyen

Large language models (LLMs) are increasingly used in sensitive domains, where their ability to infer personal data from seemingly benign text introduces emerging privacy risks. While recent LLM-based anonymization methods help mitigate…

Computation and Language · Computer Science 2025-10-27 Kyuyoung Kim , Hyunjun Jeon , Jinwoo Shin

Hampering the interpretation of benchmark scores, evaluation data contamination has become a growing concern in the evaluation of LLMs, and an active area of research studies its effects. While evaluation data contamination is easily…

Computation and Language · Computer Science 2024-11-07 Aaditya K. Singh , Muhammed Yusuf Kocyigit , Andrew Poulton , David Esiobu , Maria Lomeli , Gergely Szilvasy , Dieuwke Hupkes

In the evolving landscape of online communication, hate speech detection remains a formidable challenge, further compounded by the diversity of digital platforms. This study investigates the effectiveness and adaptability of pre-trained and…

Computation and Language · Computer Science 2025-05-01 Ahmad Nasir , Aadish Sharma , Kokil Jaidka , Saifuddin Ahmed

Language models pre-trained on web-scale corpora demonstrate impressive capabilities on diverse downstream tasks. However, there is increasing concern whether such capabilities might arise from evaluation datasets being included in the…

Computation and Language · Computer Science 2024-01-12 Minhao Jiang , Ken Ziyu Liu , Ming Zhong , Rylan Schaeffer , Siru Ouyang , Jiawei Han , Sanmi Koyejo

Recent advances in large language models (LLMs) have shown significant promise, yet their evaluation raises concerns, particularly regarding data contamination due to the lack of access to proprietary training data. To address this issue,…

Computation and Language · Computer Science 2025-05-30 Yanyang Li , Tin Long Wong , Cheung To Hung , Jianqiao Zhao , Duo Zheng , Ka Wai Liu , Michael R. Lyu , Liwei Wang

The leakage of benchmark data into the training data has emerged as a significant challenge for evaluating the capabilities of large language models (LLMs). In this work, we challenge the common assumption that small-scale contamination…

Machine Learning · Computer Science 2025-06-17 Sebastian Bordt , Suraj Srinivas , Valentyn Boreiko , Ulrike von Luxburg

Data contamination poses a significant challenge to the fairness of LLM evaluations in natural language processing tasks by inadvertently exposing models to test data during training. Current studies attempt to mitigate this issue by…

Computation and Language · Computer Science 2025-11-25 Jingqian Zhao , Bingbing Wang , Geng Tu , Yice Zhang , Qianlong Wang , Bin Liang , Jing Li , Ruifeng Xu

As large language models (LLMs) become more capable and agentic, the requirement for trust in their outputs grows significantly, yet at the same time concerns have been mounting that models may learn to lie in pursuit of their goals. To…

Deep neural networks are proven to be vulnerable to data poisoning attacks. Recently, a specific type of data poisoning attack known as availability attacks has led to the failure of data utilization for model learning by adding…

Cryptography and Security · Computer Science 2024-08-16 Yi Yu , Qichen Zheng , Siyuan Yang , Wenhan Yang , Jun Liu , Shijian Lu , Yap-Peng Tan , Kwok-Yan Lam , Alex Kot

Pretrained language models are typically trained on massive web-based datasets, which are often "contaminated" with downstream test sets. It is not clear to what extent models exploit the contaminated data for downstream tasks. We present a…

Computation and Language · Computer Science 2022-03-17 Inbal Magar , Roy Schwartz

Industry practitioners care about small improvements in malware detection accuracy because their models are deployed to hundreds of millions of machines, meaning a 0.1\% change can cause an overwhelming number of false positives. However,…

Machine Learning · Computer Science 2023-12-27 Tirth Patel , Fred Lu , Edward Raff , Charles Nicholas , Cynthia Matuszek , James Holt

Benchmark Data Contamination (BDC)-the inclusion of benchmark testing samples in the training set-has raised increasing concerns in Large Language Model (LLM) evaluation, leading to falsely inflated performance estimates and undermining…

Artificial Intelligence · Computer Science 2025-03-21 Yifan Sun , Han Wang , Dongbai Li , Gang Wang , Huan Zhang

The emerging success of large language models (LLMs) heavily relies on collecting abundant training data from external (untrusted) sources. Despite substantial efforts devoted to data cleaning and curation, well-constructed LLMs have been…

Computation and Language · Computer Science 2024-02-26 Tianlin Li , Qian Liu , Tianyu Pang , Chao Du , Qing Guo , Yang Liu , Min Lin

There has been recent interest in leveraging federated learning (FL) for radio signal classification tasks. In FL, model parameters are periodically communicated from participating devices, training on their own local datasets, to a central…

Signal Processing · Electrical Eng. & Systems 2023-01-24 Su Wang , Rajeev Sahay , Christopher G. Brinton

Mislabeled examples are ubiquitous in real-world machine learning datasets, advocating the development of techniques for automatic detection. We show that most mislabeled detection methods can be viewed as probing trained machine learning…

Machine Learning · Computer Science 2024-10-22 Thomas George , Pierre Nodet , Alexis Bondu , Vincent Lemaire

With the increase in machine learning (ML) applications in different domains, incentives for deceiving these models have reached more than ever. As data is the core backbone of ML algorithms, attackers shifted their interest toward…

Cryptography and Security · Computer Science 2023-01-04 Kshitiz Aryal , Maanak Gupta , Mahmoud Abdelsalam

Social media bot detection has always been an arms race between advancements in machine learning bot detectors and adversarial bot strategies to evade detection. In this work, we bring the arms race to the next level by investigating the…

Computation and Language · Computer Science 2024-07-08 Shangbin Feng , Herun Wan , Ningnan Wang , Zhaoxuan Tan , Minnan Luo , Yulia Tsvetkov
‹ Prev 1 4 5 6 7 8 10 Next ›