English
Related papers

Related papers: Embedding Attack Project (Work Report)

200 papers

Determining which data samples were used to train a model, known as Membership Inference Attack (MIA), is a well-studied and important problem with implications on data privacy. SotA methods (which are black-box attacks) rely on training…

Machine Learning · Computer Science 2026-02-26 Yuval Golbari , Navve Wasserman , Gal Vardi , Michal Irani

Membership inference attacks (MIAs) pose a critical privacy threat to fine-tuned large language models (LLMs), especially when models are adapted to domain-specific tasks using sensitive data. While prior black-box MIA techniques rely on…

Cryptography and Security · Computer Science 2025-12-23 Zhexi Lu , Hongliang Chi , Nathalie Baracaldo , Swanand Ravindra Kadhe , Yuseok Jeon , Lei Yu

We present the first systematic Membership Inference Attack (MIA) evaluation of Large Audio Language Models (LALMs). As audio encodes non-semantic information, it induces severe train and test distribution shifts and can lead to spurious…

Sound · Computer Science 2026-03-31 Jia-Kai Dong , Yu-Xiang Lin , Hung-Yi Lee

Most existing membership inference attacks (MIAs) utilize metrics (e.g., loss) calculated on the model's final state, while recent advanced attacks leverage metrics computed at various stages, including both intermediate and final stages,…

Cryptography and Security · Computer Science 2024-07-23 Hao Li , Zheng Li , Siyuan Wu , Chengrui Hu , Yutong Ye , Min Zhang , Dengguo Feng , Yang Zhang

Cognitive diagnosis models (CDMs) are pivotal for creating fine-grained learner profiles in modern intelligent education platforms. However, these models are trained on sensitive student data, raising significant privacy concerns. While…

Cryptography and Security · Computer Science 2025-11-10 Mingliang Hou , Yinuo Wang , Teng Guo , Zitao Liu , Wenzhou Dou , Jiaqi Zheng , Renqiang Luo , Mi Tian , Weiqi Luo

Federated Learning enables collaborative learning among clients via a coordinating server while avoiding direct data sharing, offering a perceived solution to preserve privacy. However, recent studies on Membership Inference Attacks (MIAs)…

Cryptography and Security · Computer Science 2025-08-04 Quan Nguyen , Minh N. Vu , Truc Nguyen , My T. Thai

In several jurisdictions, the regulatory framework on the release and sharing of personal data is being extended to machine learning (ML). The implicit assumption is that disclosing a trained ML model entails a privacy risk for any personal…

Cryptography and Security · Computer Science 2025-11-14 Josep Domingo-Ferrer

Membership Inference Attacks (MIAs) pose a significant privacy risk by enabling adversaries to determine if a specific data point was part of a model's training set. This work empirically investigates whether MU algorithms can function as a…

Membership Inference Attacks (MIAs) aim to estimate whether a specific data point was used in the training of a given model. Existing state-of-the-art attacks typically rely on training multiple reference models to approximate the…

Machine Learning · Computer Science 2026-05-26 Zhenlong Liu , Wenyu Jiang , Feng Zhou , Hongxin Wei

Diffusion-based generative models have shown great potential for image synthesis, but there is a lack of research on the security and privacy risks they may pose. In this paper, we investigate the vulnerability of diffusion models to…

Computer Vision and Pattern Recognition · Computer Science 2023-05-31 Jinhao Duan , Fei Kong , Shiqi Wang , Xiaoshuang Shi , Kaidi Xu

Balancing strong privacy guarantees with high predictive performance is critical for time series forecasting (TSF) tasks involving Electronic Health Records (EHR). In this study, we explore how data augmentation can mitigate Membership…

Machine Learning · Computer Science 2025-11-10 Marius Fracarolli , Michael Staniek , Stefan Riezler

We develop practical and theoretically grounded membership inference attacks (MIAs) against both independent and identically distributed (i.i.d.) data and graph-structured data. Building on the Bayesian decision-theoretic framework of…

Machine Learning · Computer Science 2025-10-29 Marcus Lassila , Johan Östman , Khac-Hoang Ngo , Alexandre Graell i Amat

Recommender systems (RecSys) have been widely applied to various applications, including E-commerce, finance, healthcare, social media and have become increasingly influential in shaping user behavior and decision-making, highlighting their…

Information Retrieval · Computer Science 2026-01-09 Jiajie He , Xintong Chen , Xinyang Fang , Min-Chun Chen , Yuechun Gu , Keke Chen

While in-processing fairness approaches show promise in mitigating biased predictions, their potential impact on privacy leakage remains under-explored. We aim to address this gap by assessing the privacy risks of fairness-enhanced binary…

Machine Learning · Computer Science 2025-05-29 Huan Tian , Guangsheng Zhang , Bo Liu , Tianqing Zhu , Ming Ding , Wanlei Zhou

Large Language Models (LLMs) are increasingly used in a variety of applications, but concerns around membership inference have grown in parallel. Previous efforts focus on black-to-grey-box models, thus neglecting the potential benefit from…

Cryptography and Security · Computer Science 2025-01-13 Luis Ibanez-Lissen , Lorena Gonzalez-Manzano , Jose Maria de Fuentes , Nicolas Anciaux , Joaquin Garcia-Alfaro

Membership inference attacks (MIAs) are critical tools for assessing privacy risks and ensuring compliance with regulations like the General Data Protection Regulation (GDPR). However, their potential for auditing unauthorized use of data…

Cryptography and Security · Computer Science 2024-11-28 Depeng Chen , Hao Chen , Hulin Jin , Jie Cui , Hong Zhong

Federated learning is known for its capability to safeguard the participants' data privacy. However, recently emerged model inversion attacks (MIAs) have shown that a malicious parameter server can reconstruct individual users' local data…

Machine Learning · Computer Science 2024-12-02 Shanghao Shi , Ning Wang , Yang Xiao , Chaoyu Zhang , Yi Shi , Y. Thomas Hou , Wenjing Lou

Collaborative inference (CI) improves computational efficiency for edge devices by transmitting intermediate features to cloud models. However, this process inevitably exposes feature representations to model inversion attacks (MIAs),…

Cryptography and Security · Computer Science 2025-06-23 Rongke Liu , Youwen Zhu , Dong Wang , Gaoning Pan , Xingyu He , Weizhi Meng

Since machine learning model is often trained on a limited data set, the model is trained multiple times on the same data sample, which causes the model to memorize most of the training set data. Membership Inference Attacks (MIAs) exploit…

Machine Learning · Computer Science 2024-11-19 Depeng Chen , Xiao Liu , Jie Cui , Hong Zhong

Membership Inference Attacks (MIA) enable to empirically assess the privacy of a machine learning algorithm. In this paper, we propose TAMIS, a novel MIA against differentially-private synthetic data generation methods that rely on…

Machine Learning · Computer Science 2025-11-13 Paul Andrey , Batiste Le Bars , Marc Tommasi