English
Related papers

Related papers: How Breakable Is Privacy: Probing and Resisting Mo…

200 papers

Training machine learning models on privacy-sensitive data has become a popular practice, driving innovation in ever-expanding fields. This has opened the door to new attacks that can have serious privacy implications. One such attack, the…

Cryptography and Security · Computer Science 2023-06-16 Thomas Humphries , Simon Oya , Lindsey Tulloch , Matthew Rafuse , Ian Goldberg , Urs Hengartner , Florian Kerschbaum

Model inversion attacks (MIAs) aim to reconstruct class-representative samples from trained models. Recent generative MIAs utilize generative adversarial networks to learn image priors that guide the inversion process, yielding…

Machine Learning · Computer Science 2025-09-25 Xiong Peng , Bo Han , Fengfei Yu , Tongliang Liu , Feng Liu , Mingyuan Zhou

Model inversion attacks (MIAs) aim to create synthetic images that reflect the class-wise characteristics from a target classifier's private training data by exploiting the model's learned knowledge. Previous research has developed…

Machine Learning · Computer Science 2022-06-10 Lukas Struppek , Dominik Hintersdorf , Antonio De Almeida Correia , Antonia Adler , Kristian Kersting

As large-scale models such as Large Language Models (LLMs) and Large Multimodal Models (LMMs) see increasing deployment, their privacy risks remain underexplored. Membership Inference Attacks (MIAs), which reveal whether a data point was…

Machine Learning · Computer Science 2025-09-03 Hengyu Wu , Yang Cao

Federated learning (FL) facilitates collaborative model training among multiple clients without raw data exposure. However, recent studies have shown that clients' private training data can be reconstructed from shared gradients in FL, a…

Cryptography and Security · Computer Science 2025-02-06 Jiacheng Du , Jiahui Hu , Zhibo Wang , Peng Sun , Neil Zhenqiang Gong , Kui Ren , Chun Chen

Federated Unlearning (FU) has emerged as a promising solution to respond to the right to be forgotten of clients, by allowing clients to erase their data from global models without compromising model performance. Unfortunately, researchers…

Cryptography and Security · Computer Science 2025-08-12 Wei Wang , Xiangyun Tang , Yajie Wang , Yijing Lin , Tao Zhang , Meng Shen , Dusit Niyato , Liehuang Zhu

Recommender systems (RecSys) have been widely applied to various applications, including E-commerce, finance, healthcare, social media and have become increasingly influential in shaping user behavior and decision-making, highlighting their…

Information Retrieval · Computer Science 2026-01-09 Jiajie He , Xintong Chen , Xinyang Fang , Min-Chun Chen , Yuechun Gu , Keke Chen

Membership Inference attacks (MIAs) aim to predict whether a data sample was present in the training data of a machine learning model or not, and are widely used for assessing the privacy risks of language models. Most existing attacks rely…

Computation and Language · Computer Science 2023-08-08 Justus Mattern , Fatemehsadat Mireshghallah , Zhijing Jin , Bernhard Schölkopf , Mrinmaya Sachan , Taylor Berg-Kirkpatrick

The vulnerability of machine learning models to Membership Inference Attacks (MIAs) has garnered considerable attention in recent years. These attacks determine whether a data sample belongs to the model's training set or not. Recent…

Cryptography and Security · Computer Science 2024-09-05 Yu He , Boheng Li , Yao Wang , Mengda Yang , Juan Wang , Hongxin Hu , Xingyu Zhao

Machine learning algorithms, when applied to sensitive data, pose a potential threat to privacy. A growing body of prior work has demonstrated that membership inference attack (MIA) can disclose specific private information in the training…

Cryptography and Security · Computer Science 2020-01-27 Bo Zhang , Ruotong Yu , Haipei Sun , Yanying Li , Jun Xu , Hui Wang

It is observed in the literature that data augmentation can significantly mitigate membership inference (MI) attack. However, in this work, we challenge this observation by proposing new MI attacks to utilize the information of augmented…

Machine Learning · Computer Science 2021-03-01 Da Yu , Huishuai Zhang , Wei Chen , Jian Yin , Tie-Yan Liu

Deploying machine learning (ML) models on user devices can improve privacy (by keeping data local) and reduce inference latency. Trusted Execution Environments (TEEs) are a practical solution for protecting proprietary models, yet existing…

Cryptography and Security · Computer Science 2025-12-02 Sina Abdollahi , Mohammad Maheri , Sandra Siby , Marios Kogias , Hamed Haddadi

Traditional machine learning (ML) raises serious privacy concerns, while federated learning (FL) mitigates the risk of data leakage by keeping data on local devices. However, the training process of FL can still leak sensitive information,…

Machine Learning · Computer Science 2025-05-13 Heqing Ren , Chao Feng , Alberto Huertas , Burkhard Stiller

An over-the-air membership inference attack (MIA) is presented to leak private information from a wireless signal classifier. Machine learning (ML) provides powerful means to classify wireless signals, e.g., for PHY-layer authentication. As…

Cryptography and Security · Computer Science 2021-07-27 Yi Shi , Yalin E. Sagduyu

Membership inference attacks (MIAs) on code completion models offer an effective way to assess privacy risks by inferring whether a given code snippet was part of the training data. Existing black- and gray-box MIAs rely on expensive…

Software Engineering · Computer Science 2025-11-20 Yuan Jiang , Zehao Li , Shan Huang , Christoph Treude , Xiaohong Su , Tiantian Wang

Label smoothing -- using softened labels instead of hard ones -- is a widely adopted regularization method for deep learning, showing diverse benefits such as enhanced generalization and calibration. Its implications for preserving model…

Machine Learning · Computer Science 2024-07-09 Lukas Struppek , Dominik Hintersdorf , Kristian Kersting

Machine learning poses severe privacy concerns as it has been shown that the learned models can reveal sensitive information about their training data. Many works have investigated the effect of widely adopted data augmentation and…

Machine Learning · Computer Science 2024-03-26 Xiao Li , Qiongxiu Li , Zhanhao Hu , Xiaolin Hu

Model Inversion (MI) attacks, which reconstruct the training dataset of neural networks, pose significant privacy concerns in machine learning. Recent MI attacks have managed to reconstruct realistic label-level private data, such as the…

Machine Learning · Computer Science 2025-02-27 Haoyang Li , Li Bai , Qingqing Ye , Haibo Hu , Yaxin Xiao , Huadi Zheng , Jianliang Xu

Counterfactual explanations (CFs) are increasingly integrated into Machine Learning as a Service (MLaaS) systems to improve transparency; however, ML models deployed via APIs are already vulnerable to privacy attacks such as membership…

Machine Learning · Computer Science 2026-02-04 Fatima Ezzeddine , Osama Zammar , Silvia Giordano , Omran Ayoub

To address the scarcity and privacy concerns of network traffic data, various generative models have been developed to produce synthetic traffic. However, synthetic traffic is not inherently privacy-preserving, and the extent to which it…

Artificial Intelligence · Computer Science 2025-11-26 Van Tran , Shinan Liu , Tian Li , Nick Feamster