English
Related papers

Related papers: SNAP: Efficient Extraction of Private Properties w…

200 papers

While being deployed in many critical applications as core components, machine learning (ML) models are vulnerable to various security and privacy attacks. One major privacy attack in this domain is membership inference, where an adversary…

Cryptography and Security · Computer Science 2020-09-11 Yang Zou , Zhikun Zhang , Michael Backes , Yang Zhang

Machine learning models often pose a threat to the privacy of individuals whose data is part of the training set. Several recent attacks have been able to infer sensitive information from trained models, including model inversion or…

Machine Learning · Computer Science 2020-06-30 Abigail Goldsteen , Gilad Ezov , Ariel Farkash

Deep learning models have recently shown to be vulnerable to backdoor poisoning, an insidious attack where the victim model predicts clean images correctly but classifies the same images as the target class when a trigger poison pattern is…

Computer Vision and Pattern Recognition · Computer Science 2019-11-20 Alvin Chan , Yew-Soon Ong

Data poisoning is one of the most relevant security threats against machine learning and data-driven technologies. Since many applications rely on untrusted training data, an attacker can easily craft malicious samples and inject them into…

Cryptography and Security · Computer Science 2021-12-01 Nicolas M. Müller , Simon Roschmann , Konstantin Böttinger

Recent attacks on Machine Learning (ML) models such as evasion attacks with adversarial examples and models stealing through extraction attacks pose several security and privacy threats. Prior work proposes to use adversarial training to…

Machine Learning · Computer Science 2022-08-23 Kacem Khaled , Gabriela Nicolescu , Felipe Gohring de Magalhães

Privacy attacks on machine learning models aim to identify the data that is used to train such models. Such attacks, traditionally, are studied on static models that are trained once and are accessible by the adversary. Motivated to meet…

Machine Learning · Computer Science 2022-02-09 Ji Gao , Sanjam Garg , Mohammad Mahmoody , Prashant Nalini Vasudevan

Machine learning algorithms, when applied to sensitive data, pose a distinct threat to privacy. A growing body of prior work demonstrates that models produced by these algorithms may leak specific private information in the training data to…

Cryptography and Security · Computer Science 2018-05-08 Samuel Yeom , Irene Giacomelli , Matt Fredrikson , Somesh Jha

In adversarial machine learning, new defenses against attacks on deep learning systems are routinely broken soon after their release by more powerful attacks. In this context, forensic tools can offer a valuable complement to existing…

Cryptography and Security · Computer Science 2022-06-17 Shawn Shan , Arjun Nitin Bhagoji , Haitao Zheng , Ben Y. Zhao

Deploying deep neural networks (DNNs) on edge devices exposes valuable intellectual property to model-stealing attacks. While TEE-shielded DNN partitioning (TSDP) mitigates this by isolating sensitive computations, existing paradigms fail…

Cryptography and Security · Computer Science 2026-03-09 Donghwa Kang , Hojun Choe , Doohyun Kim , Hyeongboo Baek , Brent ByungHoon Kang

Semi-supervised machine learning models learn from a (small) set of labeled training examples, and a (large) set of unlabeled training examples. State-of-the-art models can reach within a few percentage points of fully-supervised training,…

Machine Learning · Computer Science 2021-08-11 Nicholas Carlini

With an increase in low-cost machine learning APIs, advanced machine learning models may be trained on private datasets and monetized by providing them as a service. However, privacy researchers have demonstrated that these models may leak…

Modern machine learning (ML) ecosystems offer a surging number of ML frameworks and code repositories that can greatly facilitate the development of ML models. Today, even ordinary data holders who are not ML experts can apply off-the-shelf…

Cryptography and Security · Computer Science 2024-07-03 Zitao Chen , Karthik Pattabiraman

Recent research has successfully demonstrated new types of data poisoning attacks. To address this problem, some researchers have proposed both offline and online data poisoning detection defenses which employ machine learning algorithms to…

Cryptography and Security · Computer Science 2021-05-24 Jack W. Stokes , Paul England , Kevin Kane

Malicious adversaries can attack machine learning models to infer sensitive information or damage the system by launching a series of evasion attacks. Although various work addresses privacy and security concerns, they focus on individual…

Machine Learning · Computer Science 2024-01-22 Janvi Thakkar , Giulio Zizzo , Sergio Maffeis

Transfer learning is a popular method for tuning pretrained (upstream) models for different downstream tasks using limited data and computational resources. We study how an adversary with control over an upstream model used in transfer…

Machine Learning · Computer Science 2023-03-22 Yulong Tian , Fnu Suya , Anshuman Suri , Fengyuan Xu , David Evans

A backdoor or Trojan attack is an important type of data poisoning attack against deep neural network (DNN) classifiers, wherein the training dataset is poisoned with a small number of samples that each possess the backdoor pattern (usually…

Machine Learning · Computer Science 2023-03-15 H. Wang , S. Karami , O. Dia , H. Ritter , E. Emamjomeh-Zadeh , J. Chen , Z. Xiang , D. J. Miller , G. Kesidis

Deep neural networks (DNNs) have played a key role in a wide range of machine learning applications. However, DNN classifiers are vulnerable to human-imperceptible adversarial perturbations, which can cause them to misclassify inputs with…

Machine Learning · Computer Science 2020-05-20 Jeffrey Z. Pan , Nicholas Zufelt

Recent studies have proven that deep neural networks are vulnerable to backdoor attacks. Specifically, by mixing a small number of poisoned samples into the training set, the behavior of the trained model can be maliciously controlled.…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Pengfei Xia , Ziqiang Li , Wei Zhang , Bin Li

Deep neural networks (DNNs) are vulnerable to backdoor attack, which does not affect the network's performance on clean data but would manipulate the network behavior once a trigger pattern is added. Existing defense methods have greatly…

Machine Learning · Computer Science 2025-04-08 Min Liu , Alberto Sangiovanni-Vincentelli , Xiangyu Yue

As machine learning becomes widely used for automated decisions, attackers have strong incentives to manipulate the results and models generated by machine learning algorithms. In this paper, we perform the first systematic study of…

Cryptography and Security · Computer Science 2021-09-29 Matthew Jagielski , Alina Oprea , Battista Biggio , Chang Liu , Cristina Nita-Rotaru , Bo Li