English
Related papers

Related papers: Detecting Data Contamination in Large Language Mod…

200 papers

As large language models (LLMs) are trained on increasingly vast and opaque text corpora, determining which data contributed to training has become essential for copyright enforcement, compliance auditing, and user trust. While prior work…

Computation and Language · Computer Science 2026-03-30 Pranav Shetty , Mirazul Haque , Zhiqiang Ma , Xiaomo Liu

This paper presents how to leak private information from a wireless signal classifier by launching an over-the-air membership inference attack (MIA). As machine learning (ML) algorithms are used to process wireless signals to make decisions…

Signal Processing · Electrical Eng. & Systems 2020-06-26 Yi Shi , Kemal Davaslioglu , Yalin E. Sagduyu

While large language models (LLMs) are extensively used, there are raising concerns regarding privacy, security, and copyright due to their opaque training data, which brings the problem of detecting pre-training data on the table. Current…

Computation and Language · Computer Science 2024-08-01 Anqi Zhang , Chaofeng Wu

Generative audio models, based on diffusion and autoregressive architectures, have advanced rapidly in both quality and expressiveness. This progress, however, raises pressing copyright concerns, as such models are often trained on vast…

Membership inference attacks (MIAs) are used to test practical privacy of machine learning models. MIAs complement formal guarantees from differential privacy (DP) under a more realistic adversary model. We analyse MIA vulnerability of…

Cryptography and Security · Computer Science 2026-02-03 Marlon Tobaben , Hibiki Ito , Joonas Jälkö , Yuan He , Antti Honkela

Large language models (LLMs) can leak sensitive training data through memorization and membership inference attacks. Prior work has primarily focused on strong adversarial assumptions, including attacker access to entire samples or long,…

Machine Learning · Computer Science 2025-05-21 Lucas Rosenblatt , Bin Han , Robert Wolfe , Bill Howe

Most existing membership inference attacks (MIAs) utilize metrics (e.g., loss) calculated on the model's final state, while recent advanced attacks leverage metrics computed at various stages, including both intermediate and final stages,…

Cryptography and Security · Computer Science 2024-07-23 Hao Li , Zheng Li , Siyuan Wu , Chengrui Hu , Yutong Ye , Min Zhang , Dengguo Feng , Yang Zhang

Large Language Models (LLMs) have demonstrated impressive capabilities in generating diverse and contextually rich text. However, concerns regarding copyright infringement arise as LLMs may inadvertently produce copyrighted material. In…

Training machine learning models on privacy-sensitive data has become a popular practice, driving innovation in ever-expanding fields. This has opened the door to new attacks that can have serious privacy implications. One such attack, the…

Cryptography and Security · Computer Science 2023-06-16 Thomas Humphries , Simon Oya , Lindsey Tulloch , Matthew Rafuse , Ian Goldberg , Urs Hengartner , Florian Kerschbaum

Membership inference attacks allow adversaries to determine whether a particular example was contained in the model's training dataset. While previous works have confirmed the feasibility of such attacks in various applications, none has…

Cryptography and Security · Computer Science 2023-11-28 Guangke Chen , Yedi Zhang , Fu Song

Data is the foundation of most science. Unfortunately, sharing data can be obstructed by the risk of violating data privacy, impeding research in fields like healthcare. Synthetic data is a potential solution. It aims to generate data that…

Machine Learning · Computer Science 2023-02-27 Boris van Breugel , Hao Sun , Zhaozhi Qian , Mihaela van der Schaar

Diffusion models have achieved remarkable progress in image generation, but their increasing deployment raises serious concerns about privacy. In particular, fine-tuned models are highly vulnerable, as they are often fine-tuned on small and…

Cryptography and Security · Computer Science 2026-01-30 Puwei Lian , Yujun Cai , Songze Li , Bingkun Bao

The problem of pre-training data detection for large language models (LLMs) has received growing attention due to its implications in critical issues like copyright violation and test data contamination. Despite improved performance,…

Computation and Language · Computer Science 2025-02-13 Jingyang Zhang , Jingwei Sun , Eric Yeats , Yang Ouyang , Martin Kuo , Jianyi Zhang , Hao Frank Yang , Hai Li

Membership Inference Attacks (MIAs) pose a critical privacy threat by enabling adversaries to determine whether a specific sample was included in a model's training dataset. Despite extensive research on MIAs, systematic comparisons between…

Cryptography and Security · Computer Science 2025-10-21 Owais Makroo , Siva Rajesh Kasa , Sumegh Roychowdhury , Karan Gupta , Nikhil Pattisapu , Santhosh Kasa , Sumit Negi

Membership inference attacks (MIAs) pose a critical threat to the privacy of training data in deep learning. Despite significant progress in attack methodologies, our understanding of when and how models encode membership information during…

Machine Learning · Computer Science 2025-08-05 Yuetian Chen , Zhiqi Wang , Nathalie Baracaldo , Swanand Ravindra Kadhe , Lei Yu

Machine learning (ML) models are vulnerable to membership inference attacks (MIAs), which determine whether a given input is used for training the target model. While there have been many efforts to mitigate MIAs, they often suffer from…

Cryptography and Security · Computer Science 2023-07-06 Zitao Chen , Karthik Pattabiraman

Federated Learning (FL) is an emerging solution to the data scarcity problem for training deep learning models in hardware assurance. While FL is designed to enhance privacy by not sharing raw data, it remains vulnerable to Membership…

Cryptography and Security · Computer Science 2026-04-23 Gijung Lee , Wavid Bowman , Olivia P. Dizon-Paradis , Reiner N. Dizon-Paradis , Ronald Wilson , Damon L. Woodard , Domenic Forte

Model explanations improve the transparency of black-box machine learning (ML) models and their decisions; however, they can also be exploited to carry out privacy threats such as membership inference attacks (MIA). Existing works have only…

Artificial Intelligence · Computer Science 2024-04-11 Kavita Kumari , Murtuza Jadliwala , Sumit Kumar Jha , Anindya Maiti

Despite efforts to align large language models (LLMs) with societal and moral values, these models remain susceptible to jailbreak attacks -- methods designed to elicit harmful responses. Jailbreaking black-box LLMs is considered…

Computation and Language · Computer Science 2025-09-23 Muyang Zheng , Yuanzhi Yao , Changting Lin , Caihong Kai , Yanxiang Chen , Zhiquan Liu

Multimodal large language models (MLLMs) demonstrate remarkable capabilities in handling complex multimodal tasks and are increasingly adopted in video understanding applications. However, their rapid advancement raises serious data privacy…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Qi Li , Runpeng Yu , Xinchao Wang