中文
相关论文

相关论文: Vicious Classifiers: Assessing Inference-time Data…

200 篇论文

Decentralised learning has recently gained traction as an alternative to federated learning in which both data and coordination are distributed. To preserve the confidentiality of users' data, decentralised learning relies on differential…

密码学与安全 · 计算机科学 2024-12-03 Florine W. Dekker , Zekeriya Erkin , Mauro Conti

Many of today's machine learning (ML) systems are built by reusing an array of, often pre-trained, primitive models, each fulfilling distinct functionality (e.g., feature extraction). The increasing use of primitive models significantly…

密码学与安全 · 计算机科学 2018-12-04 Yujie Ji , Xinyang Zhang , Shouling Ji , Xiapu Luo , Ting Wang

Increasing use of ML technologies in privacy-sensitive domains such as medical diagnoses, lifestyle predictions, and business decisions highlights the need to better understand if these ML technologies are introducing leakages of sensitive…

密码学与安全 · 计算机科学 2020-12-08 Shagufta Mehnaz , Ninghui Li , Elisa Bertino

Backdoor attacks are an insidious security threat against machine learning models. Adversaries can manipulate the predictions of compromised models by inserting triggers into the training phase. Various backdoor attacks have been devised…

计算与语言 · 计算机科学 2023-05-29 Xuanli He , Jun Wang , Benjamin Rubinstein , Trevor Cohn

The use of personal data for training machine learning systems comes with a privacy threat and measuring the level of privacy of a model is one of the major challenges in machine learning today. Identifying training data based on a trained…

机器学习 · 计算机科学 2022-03-24 Ganesh Del Grosso , Hamid Jalalzai , Georg Pichler , Catuscia Palamidessi , Pablo Piantanida

Large-scale pre-trained models are increasingly adapted to downstream tasks through a new paradigm called prompt learning. In contrast to fine-tuning, prompt learning does not update the pre-trained model's parameters. Instead, it only…

密码学与安全 · 计算机科学 2023-10-19 Yixin Wu , Rui Wen , Michael Backes , Pascal Berrang , Mathias Humbert , Yun Shen , Yang Zhang

Backdoor data poisoning is an emerging form of adversarial attack usually against deep neural network image classifiers. The attacker poisons the training set with a relatively small set of images from one (or several) source class(es),…

机器学习 · 计算机科学 2020-10-16 Zhen Xiang , David J. Miller , George Kesidis

It is commonplace to produce application-specific models by fine-tuning large pre-trained models using a small bespoke dataset. The widespread availability of foundation model checkpoints on the web poses considerable risks, including the…

密码学与安全 · 计算机科学 2024-04-02 Yuxin Wen , Leo Marchyok , Sanghyun Hong , Jonas Geiping , Tom Goldstein , Nicholas Carlini

Given the ubiquity of deep neural networks, it is important that these models do not reveal information about sensitive data that they have been trained on. In model inversion attacks, a malicious user attempts to recover the private…

机器学习 · 计算机科学 2022-01-27 Kuan-Chieh Wang , Yan Fu , Ke Li , Ashish Khisti , Richard Zemel , Alireza Makhzani

Machine learning models leak information about the datasets on which they are trained. An adversary can build an algorithm to trace the individual members of a model's training dataset. As a fundamental inference attack, he aims to…

机器学习 · 统计学 2018-07-17 Milad Nasr , Reza Shokri , Amir Houmansadr

The usage of deep learning is being escalated in many applications. Due to its outstanding performance, it is being used in a variety of security and privacy-sensitive areas in addition to conventional applications. One of the key aspects…

密码学与安全 · 计算机科学 2022-05-17 Zhaoxi Zhang , Leo Yu Zhang , Xufei Zheng , Bilal Hussain Abbasi , Shengshan Hu

Deep neural networks are susceptible to \emph{adversarial} attacks. In computer vision, well-crafted perturbations to images can cause neural networks to make mistakes such as confusing a cat with a computer. Previous adversarial attacks…

机器学习 · 计算机科学 2019-09-12 Gamaleldin F. Elsayed , Ian Goodfellow , Jascha Sohl-Dickstein

Federated Learning enables entities to collaboratively learn a shared prediction model while keeping their training data locally. It prevents data collection and aggregation and, therefore, mitigates the associated privacy risks. However,…

密码学与安全 · 计算机科学 2020-10-16 Raouf Kerkouche , Gergely Ács , Claude Castelluccia

The increased deployment of machine learning inference in various applications has sparked privacy concerns. In response, private inference (PI) protocols have been created to allow parties to perform inference without revealing their…

密码学与安全 · 计算机科学 2026-02-24 Jiaqi Xue , Mengxin Zheng , Qian Lou

Reconstruction attacks allow an adversary to regenerate data samples of the training set using access to only a trained model. It has been recently shown that simple heuristics can reconstruct data samples from language models, making this…

机器学习 · 计算机科学 2022-02-16 Pierre Stock , Igor Shilov , Ilya Mironov , Alexandre Sablayrolles

Understanding when and how much a model gradient leaks information about the training sample is an important question in privacy. In this paper, we present a surprising result: even without training or memorizing the data, we can fully…

机器学习 · 计算机科学 2023-06-13 Zihan Wang , Jason D. Lee , Qi Lei

Deep neural networks are susceptible to various inference attacks as they remember information about their training data. We design white-box inference attacks to perform a comprehensive privacy analysis of deep learning models. We measure…

机器学习 · 统计学 2020-06-09 Milad Nasr , Reza Shokri , Amir Houmansadr

Models can expose sensitive information about their training data. In an attribute inference attack, an adversary has partial knowledge of some training records and access to a model trained on those records, and infers the unknown values…

密码学与安全 · 计算机科学 2022-09-07 Bargav Jayaraman , David Evans

Federated learning is considered as an effective privacy-preserving learning mechanism that separates the client's data and model training process. However, federated learning is still under the risk of privacy leakage because of the…

机器学习 · 计算机科学 2022-06-03 Yuxuan Wan , Han Xu , Xiaorui Liu , Jie Ren , Wenqi Fan , Jiliang Tang

In addition to signature-based and heuristics-based detection techniques, machine learning (ML) is widely used to generalize to new, never-before-seen malicious software (malware). However, it has been demonstrated that ML models can be…

密码学与安全 · 计算机科学 2022-03-31 Tony Quertier , Benjamin Marais , Stéphane Morucci , Bertrand Fournel