中文
相关论文

相关论文: Membership Inference Attacks Cannot Prove that a M…

200 篇论文

Machine learning models, especially deep neural networks have been shown to be susceptible to privacy attacks such as membership inference where an adversary can detect whether a data point was used for training a black-box model. Such…

机器学习 · 计算机科学 2020-07-20 Shruti Tople , Amit Sharma , Aditya Nori

Malicious adversaries can attack machine learning models to infer sensitive information or damage the system by launching a series of evasion attacks. Although various work addresses privacy and security concerns, they focus on individual…

机器学习 · 计算机科学 2024-01-22 Janvi Thakkar , Giulio Zizzo , Sergio Maffeis

Generative audio models, based on diffusion and autoregressive architectures, have advanced rapidly in both quality and expressiveness. This progress, however, raises pressing copyright concerns, as such models are often trained on vast…

We address the problem of defending predictive models, such as machine learning classifiers (Defender models), against membership inference attacks, in both the black-box and white-box setting, when the trainer and the trained model are…

机器学习 · 计算机科学 2022-02-07 Joseph Pedersen , Rafael Muñoz-Gómez , Jiangnan Huang , Haozhe Sun , Wei-Wei Tu , Isabelle Guyon

Machine unlearning is motivated by desire for data autonomy: a person can request to have their data's influence removed from deployed models, and those models should be updated as if they were retrained without the person's data. We show…

机器学习 · 计算机科学 2024-05-31 Martin Bertran , Shuai Tang , Michael Kearns , Jamie Morgenstern , Aaron Roth , Zhiwei Steven Wu

Text-to-image generation models have recently attracted unprecedented attention as they unlatch imaginative applications in all areas of life. However, developing such models requires huge amounts of data that might contain…

密码学与安全 · 计算机科学 2022-10-04 Yixin Wu , Ning Yu , Zheng Li , Michael Backes , Yang Zhang

The right to be forgotten states that a data owner has the right to erase their data from an entity storing it. In the context of machine learning (ML), the right to be forgotten requires an ML model owner to remove the data owner's data…

密码学与安全 · 计算机科学 2021-09-15 Min Chen , Zhikun Zhang , Tianhao Wang , Michael Backes , Mathias Humbert , Yang Zhang

The high cost of model training makes it increasingly desirable to develop techniques for unlearning. These techniques seek to remove the influence of a training example without having to retrain the model from scratch. Intuitively, once a…

机器学习 · 计算机科学 2024-05-22 Jamie Hayes , Ilia Shumailov , Eleni Triantafillou , Amr Khalifa , Nicolas Papernot

While machine learning (ML) has made tremendous progress during the past decade, recent research has shown that ML models are vulnerable to various security and privacy attacks. So far, most of the attacks in this field focus on…

密码学与安全 · 计算机科学 2021-11-16 Junhao Zhou , Yufei Chen , Chao Shen , Yang Zhang

The state-of-the-art for membership inference attacks on machine learning models is a class of attacks based on shadow models that mimic the behavior of the target model on subsets of held-out nonmember data. However, we find that this…

机器学习 · 计算机科学 2025-10-28 Pratiksha Thaker , Neil Kale , Zhiwei Steven Wu , Virginia Smith

It is commonplace to produce application-specific models by fine-tuning large pre-trained models using a small bespoke dataset. The widespread availability of foundation model checkpoints on the web poses considerable risks, including the…

密码学与安全 · 计算机科学 2024-04-02 Yuxin Wen , Leo Marchyok , Sanghyun Hong , Jonas Geiping , Tom Goldstein , Nicholas Carlini

Natural language processing models have experienced a significant upsurge in recent years, with numerous applications being built upon them. Many of these applications require fine-tuning generic base models on customized, proprietary…

机器学习 · 计算机科学 2024-03-14 Guy Amit , Abigail Goldsteen , Ariel Farkash

Determining whether a dataset was part of a machine learning model's training data pool can reveal privacy vulnerabilities, a challenge often addressed through membership inference attacks (MIAs). Traditional MIAs typically require access…

机器学习 · 计算机科学 2025-06-03 Yongchao Huang

In several jurisdictions, the regulatory framework on the release and sharing of personal data is being extended to machine learning (ML). The implicit assumption is that disclosing a trained ML model entails a privacy risk for any personal…

密码学与安全 · 计算机科学 2025-11-14 Josep Domingo-Ferrer

Today's success of state of the art methods for semantic segmentation is driven by large datasets. Data is considered an important asset that needs to be protected, as the collection and annotation of such datasets comes at significant…

计算机视觉与模式识别 · 计算机科学 2020-09-22 Yang He , Shadi Rahimian , Bernt Schiele , Mario Fritz

The rise of deep learning (DL) has led to a surging demand for training data, which incentivizes the creators of DL models to trawl through the Internet for training materials. Meanwhile, users often have limited control over whether their…

密码学与安全 · 计算机科学 2025-05-23 Zitao Chen , Karthik Pattabiraman

Membership inference attacks are used as a key tool for disclosure auditing. They aim to infer whether an individual record was used to train a model. While such evaluations are useful to demonstrate risk, they are computationally expensive…

机器学习 · 计算机科学 2024-12-20 Anshuman Suri , Xiao Zhang , David Evans

Many current Internet services rely on inferences from models trained on user data. Commonly, both the training and inference tasks are carried out using cloud resources fed by personal data collected at scale from users. Holding and using…

机器学习 · 计算机科学 2018-04-04 Sandra Servia-Rodriguez , Liang Wang , Jianxin R. Zhao , Richard Mortier , Hamed Haddadi

As in-the-wild data are increasingly involved in the training stage, machine learning applications become more susceptible to data poisoning attacks. Such attacks typically lead to test-time accuracy degradation or controlled misprediction.…

密码学与安全 · 计算机科学 2022-11-02 Yufei Chen , Chao Shen , Yun Shen , Cong Wang , Yang Zhang

Deep learning models for time series imputation are now essential in fields such as healthcare, the Internet of Things (IoT), and finance. However, their deployment raises critical privacy concerns. Beyond the well-known issue of unintended…

机器学习 · 计算机科学 2026-03-26 Faiz Taleb , Ivan Gazeau , Maryline Laurent