中文
相关论文

相关论文: Do Backdoors Assist Membership Inference Attacks?

200 篇论文

Research in adversarial machine learning (AML) has shown that statistical models are vulnerable to maliciously altered data. However, despite advances in Bayesian machine learning models, most AML research remains concentrated on classical…

机器学习 · 统计学 2025-06-04 Matthieu Carreau , Roi Naveiro , William N. Caballero

Backdoor attacks are an insidious security threat against machine learning models. Adversaries can manipulate the predictions of compromised models by inserting triggers into the training phase. Various backdoor attacks have been devised…

计算与语言 · 计算机科学 2023-05-29 Xuanli He , Jun Wang , Benjamin Rubinstein , Trevor Cohn

Deep learning has come a long way and has enjoyed an unprecedented success. Despite high accuracy, however, deep models are brittle and are easily fooled by imperceptible adversarial perturbations. In contrast to common inference-time…

计算机视觉与模式识别 · 计算机科学 2020-05-14 Ali Borji

Backdoor attacks have been shown to be a serious security threat against deep learning models, and detecting whether a given model has been backdoored becomes a crucial task. Existing defenses are mainly built upon the observation that the…

密码学与安全 · 计算机科学 2022-08-16 Tong Wang , Yuan Yao , Feng Xu , Miao Xu , Shengwei An , Ting Wang

Adversarial machine learning has exposed several security hazards of neural models and has become an important research topic in recent times. Thus far, the concept of an "adversarial perturbation" has exclusively been used with reference…

机器学习 · 计算机科学 2020-09-22 Siddhant Garg , Adarsh Kumar , Vibhor Goel , Yingyu Liang

Recent studies have revealed a security threat to natural language processing (NLP) models, called the Backdoor Attack. Victim models can maintain competitive performance on clean samples while behaving abnormally on samples with a specific…

计算与语言 · 计算机科学 2021-03-30 Wenkai Yang , Lei Li , Zhiyuan Zhang , Xuancheng Ren , Xu Sun , Bin He

With the wide-spread application of machine learning models, it has become critical to study the potential data leakage of models trained on sensitive data. Recently, various membership inference (MI) attacks are proposed to determine if a…

密码学与安全 · 计算机科学 2023-05-01 Shahbaz Rezaei , Xin Liu

Machine learning systems are vulnerable to backdoor attacks, where attackers manipulate model behavior through data tampering or architectural modifications. Traditional backdoor attacks involve injecting malicious samples with specific…

密码学与安全 · 计算机科学 2025-09-24 Yuan Ma , Jiankang Wei , Yilun Lyu , Kehao Chen , Jingtong Huang

Machine learning models are prone to memorizing sensitive data, making them vulnerable to membership inference attacks in which an adversary aims to guess if an input sample was used to train the model. In this paper, we show that prior…

密码学与安全 · 计算机科学 2020-12-10 Liwei Song , Prateek Mittal

Recently, backdoor attacks pose a new security threat to the training process of deep neural networks (DNNs). Attackers intend to inject hidden backdoors into DNNs, such that the attacked model performs well on benign samples, whereas its…

密码学与安全 · 计算机科学 2021-08-16 Yuezun Li , Yiming Li , Baoyuan Wu , Longkang Li , Ran He , Siwei Lyu

Membership Inference Attacks have emerged as a dominant method for empirically measuring privacy leakage from machine learning models. Here, privacy is measured by the {\em{advantage}} or gap between a score or a function computed on the…

机器学习 · 计算机科学 2024-05-27 Ruihan Wu , Pengrun Huang , Kamalika Chaudhuri

A large body of research has shown that machine learning models are vulnerable to membership inference (MI) attacks that violate the privacy of the participants in the training data. Most MI research focuses on the case of a single…

机器学习 · 计算机科学 2022-05-16 Matthew Jagielski , Stanley Wu , Alina Oprea , Jonathan Ullman , Roxana Geambasu

As collaborative learning and the outsourcing of data collection become more common, malicious actors (or agents) which attempt to manipulate the learning process face an additional obstacle as they compete with each other. In backdoor…

机器学习 · 计算机科学 2021-10-12 Siddhartha Datta , Giulio Lovisotto , Ivan Martinovic , Nigel Shadbolt

Backdoor attacks are serious security threats to machine learning models where an adversary can inject poisoned samples into the training set, causing a backdoored model which predicts poisoned samples with particular triggers to particular…

机器学习 · 计算机科学 2023-07-21 Shaokui Wei , Mingda Zhang , Hongyuan Zha , Baoyuan Wu

Machine learning models are prone to memorizing sensitive data, making them vulnerable to membership inference attacks in which an adversary aims to infer whether an input sample was used to train the model. Over the past few years,…

密码学与安全 · 计算机科学 2022-08-23 Xinlei He , Zheng Li , Weilin Xu , Cory Cornelius , Yang Zhang

Recently, recommender systems have achieved promising performances and become one of the most widely used web applications. However, recommender systems are often trained on highly sensitive user data, thus potential data leakage from…

密码学与安全 · 计算机科学 2021-09-17 Minxing Zhang , Zhaochun Ren , Zihan Wang , Pengjie Ren , Zhumin Chen , Pengfei Hu , Yang Zhang

The tremendous progress of autoencoders and generative adversarial networks (GANs) has led to their application to multiple critical tasks, such as fraud detection and sanitized data generation. This increasing adoption has fostered the…

密码学与安全 · 计算机科学 2020-10-09 Ahmed Salem , Yannick Sautter , Michael Backes , Mathias Humbert , Yang Zhang

We investigate security concerns of the emergent instruction tuning paradigm, that models are trained on crowdsourced datasets with task instructions to achieve superior performance. Our studies demonstrate that an attacker can inject…

计算与语言 · 计算机科学 2024-04-04 Jiashu Xu , Mingyu Derek Ma , Fei Wang , Chaowei Xiao , Muhao Chen

Backdoor data poisoning is an emerging form of adversarial attack usually against deep neural network image classifiers. The attacker poisons the training set with a relatively small set of images from one (or several) source class(es),…

机器学习 · 计算机科学 2020-10-16 Zhen Xiang , David J. Miller , George Kesidis

Large amounts of incremental learning algorithms have been proposed to alleviate the catastrophic forgetting issue arises while dealing with sequential data on a time series. However, the adversarial robustness of incremental learners has…

密码学与安全 · 计算机科学 2023-05-31 Yiqi Zhong , Xianming Liu , Deming Zhai , Junjun Jiang , Xiangyang Ji