English
Related papers

Related papers: Biologically-Informed Hybrid Membership Inference …

200 papers

Machine learning algorithms, when applied to sensitive data, pose a potential threat to privacy. A growing body of prior work has demonstrated that membership inference attack (MIA) can disclose specific private information in the training…

Cryptography and Security · Computer Science 2020-01-27 Bo Zhang , Ruotong Yu , Haipei Sun , Yanying Li , Jun Xu , Hui Wang

Large language models (LLMs) have demonstrated significant success in various domain-specific tasks, with their performance often improving substantially after fine-tuning. However, fine-tuning with real-world data introduces privacy risks.…

Cryptography and Security · Computer Science 2025-01-30 Atilla Akkus , Masoud Poorghaffar Aghdam , Mingjie Li , Junjie Chu , Michael Backes , Yang Zhang , Sinem Sav

Membership Inference Attacks (MIAs) aim to determine whether a specific data point was included in the training set of a target model. Although there are have been numerous methods developed for detecting data contamination in large…

Machine Learning · Computer Science 2025-12-03 Anton Emelyanov , Sergei Kudriashov , Alena Fenogenova

Document Visual Question Answering (DocVQA) has introduced a new paradigm for end-to-end document understanding, and quickly became one of the standard benchmarks for multimodal LLMs. Automating document processing workflows, driven by…

Machine Learning · Computer Science 2025-02-07 Khanh Nguyen , Raouf Kerkouche , Mario Fritz , Dimosthenis Karatzas

Membership inference attacks (MIA) attempt to verify the membership of a given data sample in the training set for a model. MIA has become relevant in recent years, following the rapid development of large language models (LLM). Many are…

Computation and Language · Computer Science 2025-02-04 Haritz Puerto , Martin Gubri , Sangdoo Yun , Seong Joon Oh

Machine learning (ML) models have been widely applied to various applications, including image classification, text generation, audio recognition, and graph data analysis. However, recent studies have shown that ML models are vulnerable to…

Machine Learning · Computer Science 2022-02-04 Hongsheng Hu , Zoran Salcic , Lichao Sun , Gillian Dobbie , Philip S. Yu , Xuyun Zhang

When acting as a privacy-enhancing technology, synthetic data generation (SDG) aims to maintain a resemblance to the real data while excluding personally-identifiable information. Many SDG algorithms provide robust differential privacy (DP)…

Cryptography and Security · Computer Science 2025-04-02 Steven Golob , Sikha Pentyala , Anuar Maratkhan , Martine De Cock

Large language models (LLMs) are trained on massive corpora that may contain sensitive information, creating privacy risks under membership inference attacks (MIAs). Knowledge distillation is widely used to compress LLMs into smaller…

Machine Learning · Computer Science 2026-01-13 Ziyao Cui , Minxing Zhang , Jian Pei

Large Language Models (LLMs) utilize large amounts of data for their training, some of which may come from copyrighted sources. Membership Inference Attacks (MIA) aim to detect those documents and whether they have been included in the…

Artificial Intelligence · Computer Science 2026-04-22 Juliusz Janicki , Savvas Chamezopoulos , Evangelos Kanoulas , Georgios Tsatsaronis

Machine learning models can leak private information about their training data. The standard methods to measure this privacy risk, based on membership inference attacks (MIAs), only check if a given data point \textit{exactly} matches a…

Machine Learning · Computer Science 2025-09-11 Jiashu Tao , Reza Shokri

Model inversion attacks (MIAs) aim to reconstruct private images from a target classifier's training set, thereby raising privacy concerns in AI applications. Previous GAN-based MIAs tend to suffer from inferior generative fidelity due to…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Ouxiang Li , Yanbin Hao , Zhicai Wang , Bin Zhu , Shuo Wang , Zaixi Zhang , Fuli Feng

Adapting Large Language Models (LLMs) to specific tasks introduces concerns about computational efficiency, prompting an exploration of efficient methods such as In-Context Learning (ICL). However, the vulnerability of ICL to privacy…

Cryptography and Security · Computer Science 2024-09-04 Rui Wen , Zheng Li , Michael Backes , Yang Zhang

The lack of data transparency in Large Language Models (LLMs) has highlighted the importance of Membership Inference Attack (MIA), which differentiates trained (member) and untrained (non-member) data. Though it shows success in previous…

Computation and Language · Computer Science 2024-12-19 Bowen Chen , Namgi Han , Yusuke Miyao

Large language models (LLMs) based recommender systems (RecSys) can adapt to different domains flexibly. It utilizes in-context learning (ICL), i.e., prompts, to customize the recommendation functions, which include sensitive historical…

Information Retrieval · Computer Science 2026-01-23 Jiajie He , Min-Chun Chen , Xintong Chen , Xinyang Fang , Yuechun Gu , Keke Chen

Recent work shows membership inference attacks (MIAs) on large language models (LLMs) produce inconclusive results, partly due to difficulties in creating non-member datasets without temporal shifts. While researchers have turned to…

Computation and Language · Computer Science 2025-01-22 Ali Naseh , Niloofar Mireshghallah

With the emergence of powerful large-scale foundation models, the training paradigm is increasingly shifting from from-scratch training to transfer learning. This enables high utility training with small, domain-specific datasets typical in…

Machine Learning · Computer Science 2025-10-09 Yuxuan Bai , Gauri Pradhan , Marlon Tobaben , Antti Honkela

Large language models (LLMs) do not preserve privacy at inference-time. The LLM's outputs can inadvertently reveal information about the model's context, which presents a privacy challenge when the LLM is augmented via tools or databases…

Computation and Language · Computer Science 2026-02-03 Rushil Thareja , Preslav Nakov , Praneeth Vepakomma , Nils Lukas

The membership inference attack (MIA) is a popular paradigm for compromising the privacy of a machine learning (ML) model. MIA exploits the natural inclination of ML models to overfit upon the training data. MIAs are trained to distinguish…

Synthetic tabular data has gained attention for enabling privacy-preserving data sharing. While substantial progress has been made in single-table synthetic generation where data are modeled at the row or item level, most real-world data…

Machine Learning · Computer Science 2026-05-12 Joshua Ward , Chi-Hua Wang , Guang Cheng

Generative models have demonstrated revolutionary success in various visual creation tasks, but in the meantime, they have been exposed to the threat of leaking private information of their training data. Several membership inference…

Cryptography and Security · Computer Science 2023-10-31 Minxing Zhang , Ning Yu , Rui Wen , Michael Backes , Yang Zhang