中文
相关论文

相关论文: Lessons Learned: Defending Against Property Infere…

200 篇论文

Among all privacy attacks against Machine Learning (ML), membership inference attacks (MIA) attracted the most attention. In these attacks, the attacker is given an ML model and a data point, and they must infer whether the data point was…

密码学与安全 · 计算机科学 2025-12-02 Bram van Dartel , Marc Damie , Florian Hahn

Membership inference attacks (MIAs) against machine learning models can lead to serious privacy risks for the training dataset used in the model training. In this paper, we propose a novel and effective Neuron-Guided Defense method named…

密码学与安全 · 计算机科学 2022-12-14 Nuo Xu , Binghui Wang , Ran Ran , Wujie Wen , Parv Venkitasubramaniam

With the emergence of powerful large-scale foundation models, the training paradigm is increasingly shifting from from-scratch training to transfer learning. This enables high utility training with small, domain-specific datasets typical in…

机器学习 · 计算机科学 2025-10-09 Yuxuan Bai , Gauri Pradhan , Marlon Tobaben , Antti Honkela

In this paper we develop state-of-the-art privacy attacks against Large Language Models (LLMs), where an adversary with some access to the model tries to learn something about the underlying training data. Our headline results are new…

密码学与安全 · 计算机科学 2024-07-16 Jeffrey G. Wang , Jason Wang , Marvin Li , Seth Neel

Transfer learning, successful in knowledge translation across related tasks, faces a substantial privacy threat from membership inference attacks (MIAs). These attacks, despite posing significant risk to ML model's training data, remain…

密码学与安全 · 计算机科学 2025-01-22 Cong Wu , Jing Chen , Qianru Fang , Kun He , Ziming Zhao , Hao Ren , Guowen Xu , Yang Liu , Yang Xiang

In distributed learning settings, models are iteratively updated with shared gradients computed from potentially sensitive user data. While previous work has studied various privacy risks of sharing gradients, our paper aims to provide a…

机器学习 · 计算机科学 2024-09-02 Zhuohang Li , Andrew Lowy , Jing Liu , Toshiaki Koike-Akino , Kieran Parsons , Bradley Malin , Ye Wang

Data augmentation is widely used to mitigate data bias in the training dataset. However, data augmentation exposes machine learning models to privacy attacks, such as membership inference attacks. In this paper, we propose an effective…

机器学习 · 计算机科学 2024-04-23 Zhixin Pan , Emma Andrews , Laura Chang , Prabhat Mishra

Machine unlearning has become a promising solution for fulfilling the "right to be forgotten", under which individuals can request the deletion of their data from machine learning models. However, existing studies of machine unlearning…

密码学与安全 · 计算机科学 2024-04-05 Hongsheng Hu , Shuo Wang , Tian Dong , Minhui Xue

Membership Inference Attacks (MIAs) are currently a dominant approach for evaluating privacy in machine learning applications. Despite their significance in identifying records belonging to the training dataset, several concerns remain…

机器学习 · 计算机科学 2026-01-23 Cristina Pêra , Tânia Carvalho , Maxime Cordy , Luís Antunes

Training a machine learning model with data following a meaningful order, i.e., from easy to hard, has been proven to be effective in accelerating the training process and achieving better model performance. The key enabling technique is…

密码学与安全 · 计算机科学 2023-10-17 Joann Qiongna Chen , Xinlei He , Zheng Li , Yang Zhang , Zhou Li

Model Inversion Attacks (MIAs) pose a significant threat to data privacy by reconstructing sensitive training samples from the knowledge embedded in trained machine learning models. Despite recent progress in enhancing the effectiveness of…

密码学与安全 · 计算机科学 2025-12-03 Hongyao Yu , Yixiang Qiu , Hao Fang , Tianqu Zhuang , Bin Chen , Sijin Yu , Bin Wang , Shu-Tao Xia , Ke Xu

Large Language Models (LLMs) embed sensitive, human-generated data, prompting the need for unlearning methods. Although certified unlearning offers strong privacy guarantees, its restrictive assumptions make it unsuitable for LLMs, giving…

机器学习 · 计算机科学 2025-06-03 Rongzhe Wei , Mufei Li , Mohsen Ghassemi , Eleonora Kreačić , Yifan Li , Xiang Yue , Bo Li , Vamsi K. Potluru , Pan Li , Eli Chien

Federated Learning (FL) enables multiple clients, such as mobile phones and IoT devices, to collaboratively train a global machine learning model while keeping their data localized. However, recent studies have revealed that the training…

机器学习 · 计算机科学 2025-04-17 Francesco Diana , Othmane Marfoq , Chuan Xu , Giovanni Neglia , Frédéric Giroire , Eoin Thomas

A Membership Inference Attack (MIA) assesses how much a target machine learning model reveals about its training data by determining whether specific query instances were part of the training set. State-of-the-art MIAs rely on training…

密码学与安全 · 计算机科学 2026-01-13 Yuntao Du , Yuetian Chen , Hanshen Xiao , Bruno Ribeiro , Ninghui Li

The use of machine learning (ML) has become increasingly prevalent in various domains, highlighting the importance of understanding and ensuring its safety. One pressing concern is the vulnerability of ML applications to model stealing…

机器学习 · 计算机科学 2026-04-07 Ganghua Wang , Yuhong Yang , Jie Ding

Membership Inference Attacks (MIAs) have emerged as a valuable framework for evaluating privacy leakage by machine learning models. Score-based MIAs are distinguished, in particular, by their ability to exploit the confidence scores that…

机器学习 · 计算机科学 2025-02-28 Gauri Pradhan , Joonas Jälkö , Marlon Tobaben , Antti Honkela

This paper presents how to leak private information from a wireless signal classifier by launching an over-the-air membership inference attack (MIA). As machine learning (ML) algorithms are used to process wireless signals to make decisions…

信号处理 · 电气工程与系统科学 2020-06-26 Yi Shi , Kemal Davaslioglu , Yalin E. Sagduyu

The right to be forgotten states that a data owner has the right to erase their data from an entity storing it. In the context of machine learning (ML), the right to be forgotten requires an ML model owner to remove the data owner's data…

密码学与安全 · 计算机科学 2021-09-15 Min Chen , Zhikun Zhang , Tianhao Wang , Michael Backes , Mathias Humbert , Yang Zhang

As large-scale models such as Large Language Models (LLMs) and Large Multimodal Models (LMMs) see increasing deployment, their privacy risks remain underexplored. Membership Inference Attacks (MIAs), which reveal whether a data point was…

机器学习 · 计算机科学 2025-09-03 Hengyu Wu , Yang Cao

The increasing prominence of deep learning applications and reliance on personalized data underscore the urgent need to address privacy vulnerabilities, particularly Membership Inference Attacks (MIAs). Despite numerous MIA studies,…

机器学习 · 计算机科学 2024-07-02 Chenxi Li , Abhinav Kumar , Zhen Guo , Jie Hou , Reza Tourani