English
Related papers

Related papers: CompLeak: Deep Learning Model Compression Exacerba…

200 papers

Machine learning models leak information about the datasets on which they are trained. An adversary can build an algorithm to trace the individual members of a model's training dataset. As a fundamental inference attack, he aims to…

Machine Learning · Statistics 2018-07-17 Milad Nasr , Reza Shokri , Amir Houmansadr

Membership Inference Attacks have emerged as a dominant method for empirically measuring privacy leakage from machine learning models. Here, privacy is measured by the {\em{advantage}} or gap between a score or a function computed on the…

Machine Learning · Computer Science 2024-05-27 Ruihan Wu , Pengrun Huang , Kamalika Chaudhuri

Machine learning models have been shown to be vulnerable to membership inference attacks, i.e., inferring whether individuals' data have been used for training models. The lack of understanding about factors contributing success of these…

Machine Learning · Computer Science 2020-04-29 Farhad Farokhi , Mohamed Ali Kaafar

Transfer learning (TL) has been demonstrated to improve DNN model performance when faced with a scarcity of training samples. However, the suitability of TL as a solution to reduce vulnerability of overfitted DNNs to privacy attacks is…

In a backdoor attack on a machine learning model, an adversary produces a model that performs well on normal inputs but outputs targeted misclassifications on inputs containing a small trigger pattern. Model compression is a widely-used…

Cryptography and Security · Computer Science 2021-05-03 Yulong Tian , Fnu Suya , Fengyuan Xu , David Evans

Label smoothing -- using softened labels instead of hard ones -- is a widely adopted regularization method for deep learning, showing diverse benefits such as enhanced generalization and calibration. Its implications for preserving model…

Machine Learning · Computer Science 2024-07-09 Lukas Struppek , Dominik Hintersdorf , Kristian Kersting

The recent advances in deep neural networks (DNNs) make them attractive for embedded systems. However, it can take a long time for DNNs to make an inference on resource-constrained computing devices. Model compression techniques can address…

Machine Learning · Computer Science 2018-10-23 Qing Qin , Jie Ren , Jialong Yu , Ling Gao , Hai Wang , Jie Zheng , Yansong Feng , Jianbin Fang , Zheng Wang

While Federated Learning (FL) mitigates direct data exposure, the resulting trained models remain susceptible to membership inference attacks (MIAs). This paper presents an empirical evaluation of Differential Privacy (DP) as a defense…

Cryptography and Security · Computer Science 2026-04-16 Gustavo de Carvalho Bertoli

Deep neural networks (DNNs) have been quite successful in solving many complex learning problems. However, DNNs tend to have a large number of learning parameters, leading to a large memory and computation requirement. In this paper, we…

Machine Learning · Computer Science 2019-05-21 Sangkyun Lee , Jeonghyun Lee

Large language models (LLMs) have been applied in various applications due to their astonishing capabilities. With advancements in technologies such as chain-of-thought (CoT) prompting and in-context learning (ICL), the prompts fed to LLMs…

Computation and Language · Computer Science 2023-12-07 Huiqiang Jiang , Qianhui Wu , Chin-Yew Lin , Yuqing Yang , Lili Qiu

While being deployed in many critical applications as core components, machine learning (ML) models are vulnerable to various security and privacy attacks. One major privacy attack in this domain is membership inference, where an adversary…

Cryptography and Security · Computer Science 2020-09-11 Yang Zou , Zhikun Zhang , Michael Backes , Yang Zhang

With the widespread adoption of Large Language Models (LLMs) and increasingly stringent privacy regulations, protecting data privacy in LLMs has become essential, especially for privacy-sensitive applications. Membership Inference Attacks…

Cryptography and Security · Computer Science 2026-01-30 Md Tasnim Jawad , Mingyan Xiao , Yanzhao Wu

In-Context Learning (ICL) has become a standard technique for adapting Large Language Models (LLMs) to specialized tasks by supplying task-specific exemplars within the prompt. However, when these exemplars contain sensitive information,…

Cryptography and Security · Computer Science 2026-04-22 Jacob Choi , Shuying Cao , Xingjian Dong , Amin Banayeeanzade , Wang Bill Zhu , Robin Jia , Sai Praneeth Karimireddy

The large model size, high computational operations, and vulnerability against membership inference attack (MIA) have impeded deep learning or deep neural networks (DNNs) popularity, especially on mobile devices. To address the challenge,…

Machine Learning · Computer Science 2021-07-06 Yijue Wang , Chenghong Wang , Zigeng Wang , Shanglin Zhou , Hang Liu , Jinbo Bi , Caiwen Ding , Sanguthevar Rajasekaran

After training complex deep learning models, a common task is to compress the model to reduce compute and storage demands. When compressing, it is desirable to preserve the original model's per-example decisions (e.g., to go beyond top-1…

Machine Learning · Computer Science 2022-10-18 Jerry Chee , Megan Renz , Anil Damle , Christopher De Sa

Neural models for vulnerability prediction (VP) have achieved impressive performance by learning from large-scale code repositories. However, their susceptibility to Membership Inference Attacks (MIAs), where adversaries aim to infer…

Cryptography and Security · Computer Science 2025-12-10 Yihan Liao , Jacky Keung , Xiaoxue Ma , Jingyu Zhang , Yicheng Sun

Deep learning techniques based on neural networks have shown significant success in a wide range of AI tasks. Large-scale training datasets are one of the critical factors for their success. However, when the training datasets are…

Cryptography and Security · Computer Science 2019-12-23 Lei Yu , Ling Liu , Calton Pu , Mehmet Emre Gursoy , Stacey Truex

Model Inversion Attacks (MIAs) pose a significant threat to data privacy by reconstructing sensitive training samples from the knowledge embedded in trained machine learning models. Despite recent progress in enhancing the effectiveness of…

Cryptography and Security · Computer Science 2025-12-03 Hongyao Yu , Yixiang Qiu , Hao Fang , Tianqu Zhuang , Bin Chen , Sijin Yu , Bin Wang , Shu-Tao Xia , Ke Xu

Large language models (LLMs) are increasingly trained on tabular data, which, unlike unstructured text, often contains personally identifiable information (PII) in a highly structured and explicit format. As a result, privacy risks arise,…

Cryptography and Security · Computer Science 2025-07-24 Eyal German , Sagiv Antebi , Daniel Samira , Asaf Shabtai , Yuval Elovici

The rapid advancement of Large Language Models (LLMs) has been driven by extensive datasets that may contain sensitive information, raising serious privacy concerns. One notable threat is the Membership Inference Attack (MIA), where…

Cryptography and Security · Computer Science 2025-12-17 Yihan Liao , Jacky Keung , Xiaoxue Ma , Jingyu Zhang , Yicheng Sun