中文
相关论文

相关论文: Defending Against Machine Learning Model Stealing …

200 篇论文

Current graph neural network (GNN) model-stealing methods rely heavily on queries to the victim model, assuming no hard query limits. However, in reality, the number of allowed queries can be severely limited. In this paper, we demonstrate…

Modern machine learning increasingly requires training on a large collection of data from multiple sources, not all of which can be trusted. A particularly concerning scenario is when a small fraction of poisoned data changes the behavior…

机器学习 · 计算机科学 2021-04-26 Jonathan Hayase , Weihao Kong , Raghav Somani , Sewoong Oh

Machine learning (ML) models may be deemed confidential due to their sensitive training data, commercial value, or use in security applications. Increasingly often, confidential ML models are being deployed with publicly accessible query…

密码学与安全 · 计算机科学 2016-10-04 Florian Tramèr , Fan Zhang , Ari Juels , Michael K. Reiter , Thomas Ristenpart

State-of-the-art machine learning models are vulnerable to data poisoning attacks whose purpose is to undermine the integrity of the model. However, the current literature on data poisoning attacks is mainly focused on ad hoc techniques…

机器学习 · 计算机科学 2021-02-12 Pooya Tavallali , Vahid Behzadan , Peyman Tavallali , Mukesh Singhal

Operating in a dynamic real world environment requires a forward thinking and adversarial aware design for classifiers, beyond fitting the model to the training data. In such scenarios, it is necessary to make classifiers - a) harder to…

机器学习 · 计算机科学 2018-03-28 Tegjyot Singh Sethi , Mehmed Kantardzic , Lingyu Lyua , Jiashun Chen

Adversarial training was introduced as a way to improve the robustness of deep learning models to adversarial attacks. This training method improves robustness against adversarial attacks, but increases the models vulnerability to privacy…

Model Inversion (MI) attacks aim to reconstruct private training data by abusing access to machine learning models. Contemporary MI attacks have achieved impressive attack performance, posing serious threats to privacy. Meanwhile, all…

机器学习 · 计算机科学 2024-05-10 Sy-Tuyen Ho , Koh Jun Hao , Keshigeyan Chandrasegaran , Ngoc-Bao Nguyen , Ngai-Man Cheung

As machine learning becomes widely used for automated decisions, attackers have strong incentives to manipulate the results and models generated by machine learning algorithms. In this paper, we perform the first systematic study of…

密码学与安全 · 计算机科学 2021-09-29 Matthew Jagielski , Alina Oprea , Battista Biggio , Chang Liu , Cristina Nita-Rotaru , Bo Li

Machine unlearning algorithms, designed for selective removal of training data from models, have emerged as a promising approach to growing privacy concerns. In this work, we expose a critical yet underexplored vulnerability in the…

密码学与安全 · 计算机科学 2024-10-15 Yangsibo Huang , Daogao Liu , Lynn Chua , Badih Ghazi , Pritish Kamath , Ravi Kumar , Pasin Manurangsi , Milad Nasr , Amer Sinha , Chiyuan Zhang

Deep neural networks have been successfully applied in various machine learning tasks. However, studies show that neural networks are susceptible to adversarial attacks. This exposes a potential threat to neural network-based intelligent…

计算机视觉与模式识别 · 计算机科学 2024-01-30 Haimin Zhang , Min Xu

It is critical to understand the privacy and robustness vulnerabilities of machine learning models, as their implementation expands in scope. In membership inference attacks, adversaries can determine whether a particular set of data was…

Convolutional Neural Networks and Deep Learning classification systems in general have been shown to be vulnerable to attack by specially crafted data samples that appear to belong to one class but are instead classified as another,…

机器学习 · 计算机科学 2019-02-18 Cody Burkard , Brent Lagesse

Model stealing aims at inferring a victim model's functionality at a fraction of the original training cost. While the goal is clear, in practice the model's architecture, weight dimension, and original training data can not be determined…

机器学习 · 计算机科学 2023-08-21 David Pape , Sina Däubener , Thorsten Eisenhofer , Antonio Emanuele Cinà , Lea Schönherr

Malicious clients can attack federated learning systems using malicious data, including backdoor samples, during the training phase. The compromised global model will perform well on the validation dataset designed for the task, but a small…

密码学与安全 · 计算机科学 2021-01-18 Chen Wu , Xian Yang , Sencun Zhu , Prasenjit Mitra

Machine learning is vulnerable to a wide variety of attacks. It is now well understood that by changing the underlying data distribution, an adversary can poison the model trained with it or introduce backdoors. In this paper we present a…

Machine-learning models can be fooled by adversarial examples, i.e., carefully-crafted input perturbations that force models to output wrong predictions. While uncertainty quantification has been recently proposed to detect adversarial…

计算机视觉与模式识别 · 计算机科学 2023-09-20 Emanuele Ledda , Daniele Angioni , Giorgio Piras , Giorgio Fumera , Battista Biggio , Fabio Roli

Machine learning based system are increasingly being used for sensitive tasks such as security surveillance, guiding autonomous vehicle, taking investment decisions, detecting and blocking network intrusion and malware etc. However, recent…

人工智能 · 计算机科学 2017-07-12 Atul Kumar , Sameep Mehta

Poisoning attacks, in which an attacker adversarially manipulates the training dataset of a machine learning (ML) model, pose a significant threat to ML security. Beta Poisoning is a recently proposed poisoning attack that disrupts model…

密码学与安全 · 计算机科学 2025-08-05 Nilufer Gulciftci , M. Emre Gursoy

Machine Learning is becoming a pivotal aspect of many systems today, offering newfound performance on classification and prediction tasks, but this rapid integration also comes with new unforeseen vulnerabilities. To harden these systems…

密码学与安全 · 计算机科学 2022-02-22 Ahmed Abdou , Ryan Sheatsley , Yohan Beugin , Tyler Shipp , Patrick McDaniel

Deep neural network architectures are considered to be robust to random perturbations. Nevertheless, it was shown that they could be severely vulnerable to slight but carefully crafted perturbations of the input, termed as adversarial…

机器学习 · 计算机科学 2021-02-16 Omer Faruk Tuna , Ferhat Ozgur Catak , M. Taner Eskil