English
Related papers

Related papers: Membership Inference Attacks Against Fine-tuned Di…

200 papers

Video large language models (VideoLLMs) are increasingly trained or instruction-tuned on large-scale video--text corpora collected from heterogeneous sources, raising an immediate privacy question: can an external auditor determine whether…

Cryptography and Security · Computer Science 2026-05-01 Wei Song , Yuxin Cao , Ziqi Ding , Yi Liu , Gelei Deng , Yuekang Li

Machine learning (ML) has become a core component of many real-world applications and training data is a key factor that drives current progress. This huge success has led Internet companies to deploy machine learning as a service (MLaaS).…

Cryptography and Security · Computer Science 2018-12-18 Ahmed Salem , Yang Zhang , Mathias Humbert , Pascal Berrang , Mario Fritz , Michael Backes

Membership Inference Attacks (MIAs) infer whether a data point is in the training data of a machine learning model. It is a threat while being in the training data is private information of a data point. MIA correctly infers some data…

Cryptography and Security · Computer Science 2022-10-31 Mauro Conti , Jiaxin Li , Stjepan Picek

Analyzing time-series data that contains personal information, particularly in the medical field, presents serious privacy concerns. Sensitive health data from patients is often used to train machine learning models for diagnostics and…

Machine Learning · Computer Science 2024-09-24 Noam Koren , Abigail Goldsteen , Guy Amit , Ariel Farkash

Sparse autoencoders (SAEs) have become a standard tool for mechanistic interpretability in autoregressive large language models (LLMs), enabling researchers to extract sparse, human-interpretable features and intervene on model behavior.…

Machine Learning · Computer Science 2026-02-06 Xu Wang , Bingqing Jiang , Yu Wan , Baosong Yang , Lingpeng Kong , Difan Zou

In the age of agentic AI, the growing deployment of multi-modal models (MMs) has introduced new attack vectors that can leak sensitive training data in MMs, causing privacy leakage. This paper investigates a black-box privacy attack, i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 David Amebley , Sayanton Dibbo

As large language models (LLMs) become progressively more embedded in clinical decision-support, documentation, and patient-information systems, ensuring their privacy and trustworthiness has emerged as an imperative challenge for the…

Cryptography and Security · Computer Science 2025-10-22 Alexander Nemecek , Zebin Yun , Zahra Rahmani , Yaniv Harel , Vipin Chaudhary , Mahmood Sharif , Erman Ayday

In Embedding-as-an-Interface (EaaI) settings, pre-trained models are queried for Intermediate Representations (IRs). The distributional properties of IRs can leak training-set membership signals, enabling Membership Inference Attacks (MIAs)…

Machine Learning · Computer Science 2026-05-12 Jiayang Meng , Tao Huang , Chen Hou , Guolong Zheng , Hong Chen

The rapid advancement of Large Language Models (LLMs) has been driven by extensive datasets that may contain sensitive information, raising serious privacy concerns. One notable threat is the Membership Inference Attack (MIA), where…

Cryptography and Security · Computer Science 2025-12-17 Yihan Liao , Jacky Keung , Xiaoxue Ma , Jingyu Zhang , Yicheng Sun

Membership inference attacks (MIAs) have become the standard tool for evaluating privacy leakage in machine learning (ML). Among them, the Likelihood-Ratio Attack (LiRA) is widely regarded as the state of the art when sufficient shadow…

Cryptography and Security · Computer Science 2026-03-10 Najeeb Jebreel , Mona Khalil , David Sánchez , Josep Domingo-Ferrer

A Membership Inference Attack (MIA) assesses how much a target machine learning model reveals about its training data by determining whether specific query instances were part of the training set. State-of-the-art MIAs rely on training…

Cryptography and Security · Computer Science 2026-01-13 Yuntao Du , Yuetian Chen , Hanshen Xiao , Bruno Ribeiro , Ninghui Li

Diffusion models have attracted attention in recent years as innovative generative models. In this paper, we investigate whether a diffusion model is resistant to a membership inference attack, which evaluates the privacy leakage of a…

Cryptography and Security · Computer Science 2023-03-23 Tomoya Matsumoto , Takayuki Miura , Naoto Yanai

Diffusion language models (DLMs) are emerging as a compelling alternative to the dominant autoregressive paradigm, offering inherent advantages in parallel generation and bidirectional context modeling. However, for the tasks with strict…

Artificial Intelligence · Computer Science 2026-04-30 Yihong Dong , Zhaoyu Ma , Xue Jiang , Zhiyuan Fan , Jiaru Qian , Yongmin Li , Jianha Xiao , Zhi Jin , Rongyu Cao , Binhua Li , Fei Huang , Yongbin Li , Ge Li

Membership inference attacks (MIAs) pose a serious threat to the privacy of machine learning models by allowing adversaries to determine whether a specific data sample was included in the training set. Although federated learning (FL) is…

Cryptography and Security · Computer Science 2026-01-27 Mohammad Zare , Pirooz Shamsinejadbabaki

Deep learning models have an intrinsic privacy issue as they memorize parts of their training data, creating a privacy leakage. Membership Inference Attacks (MIA) exploit it to obtain confidential information about the data used for…

Cryptography and Security · Computer Science 2025-03-13 Daniel Jiménez-López , Nuria Rodríguez-Barroso , M. Victoria Luzón , Francisco Herrera

The increasing reliance on diffusion models for generating synthetic images has amplified concerns about the unauthorized use of personal data, particularly facial images, in model training. In this paper, we introduce a novel identity…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Jayneel Vora , Aditya Krishnan , Nader Bouacida , Prabhu RV Shankar , Prasant Mohapatra

The memorization of training data in large language models (LLMs) poses significant privacy and copyright concerns. Existing data extraction methods, particularly heuristic-based divergence attacks, often exhibit limited success and offer…

Computation and Language · Computer Science 2025-11-11 Myeongseob Ko , Nikhil Reddy Billa , Adam Nguyen , Charles Fleming , Ming Jin , Ruoxi Jia

Recent work shows membership inference attacks (MIAs) on large language models (LLMs) produce inconclusive results, partly due to difficulties in creating non-member datasets without temporal shifts. While researchers have turned to…

Computation and Language · Computer Science 2025-01-22 Ali Naseh , Niloofar Mireshghallah

Masked diffusion language models (MDLMs) are emerging as a compelling new paradigm for text generation, but their training-time security remains largely unexplored. Existing backdoor attacks on Gaussian diffusion models or autoregressive…

Machine Learning · Computer Science 2026-05-20 Daniel Yiming Cao , Chengzhong Wang , Sheng-Yen Chou , Chengyu Huang , Pin-Yu Chen , Shengwei An

The capabilities of large language models (LLMs) are widely regarded as relying on autoregressive models (ARMs). We challenge this notion by introducing LLaDA, a diffusion model trained from scratch under the pre-training and supervised…

Computation and Language · Computer Science 2025-10-21 Shen Nie , Fengqi Zhu , Zebin You , Xiaolu Zhang , Jingyang Ou , Jun Hu , Jun Zhou , Yankai Lin , Ji-Rong Wen , Chongxuan Li