中文
相关论文

相关论文: Stealing Machine Learning Models via Prediction AP…

200 篇论文

Cloud service providers have launched Machine-Learning-as-a-Service (MLaaS) platforms to allow users to access large-scale cloudbased models via APIs. In addition to prediction outputs, these APIs can also provide other information in a…

密码学与安全 · 计算机科学 2022-05-16 Yongjie Wang , Hangwei Qian , Chunyan Miao

With an increase in low-cost machine learning APIs, advanced machine learning models may be trained on private datasets and monetized by providing them as a service. However, privacy researchers have demonstrated that these models may leak…

In this paper we consider the setting where machine learning models are retrained on updated datasets in order to incorporate the most up-to-date information or reflect distribution shifts. We investigate whether one can infer information…

机器学习 · 计算机科学 2024-01-04 Tian Hui , Farhad Farokhi , Olga Ohrimenko

Models can expose sensitive information about their training data. In an attribute inference attack, an adversary has partial knowledge of some training records and access to a model trained on those records, and infers the unknown values…

密码学与安全 · 计算机科学 2022-09-07 Bargav Jayaraman , David Evans

Machine learning models have been shown to leak information violating the privacy of their training set. We focus on membership inference attacks on machine learning models which aim to determine whether a data point was used to train the…

密码学与安全 · 计算机科学 2020-09-02 Shadi Rahimian , Tribhuvanesh Orekondy , Mario Fritz

Inference attacks against Machine Learning (ML) models allow adversaries to learn sensitive information about training data, model parameters, etc. While researchers have studied, in depth, several kinds of attacks, they have done so in…

密码学与安全 · 计算机科学 2021-10-07 Yugeng Liu , Rui Wen , Xinlei He , Ahmed Salem , Zhikun Zhang , Michael Backes , Emiliano De Cristofaro , Mario Fritz , Yang Zhang

Machine unlearning has become a promising solution for fulfilling the "right to be forgotten", under which individuals can request the deletion of their data from machine learning models. However, existing studies of machine unlearning…

密码学与安全 · 计算机科学 2024-04-05 Hongsheng Hu , Shuo Wang , Tian Dong , Minhui Xue

In model extraction attacks, adversaries can steal a machine learning model exposed via a public API by repeatedly querying it and adjusting their own model based on obtained predictions. To prevent model stealing, existing defenses focus…

密码学与安全 · 计算机科学 2022-12-13 Adam Dziedzic , Muhammad Ahmad Kaleem , Yu Shen Lu , Nicolas Papernot

Large Language Models are typically trained on datasets collected from the web, which may inadvertently contain harmful or sensitive personal information. To address growing privacy concerns, unlearning methods have been proposed to remove…

机器学习 · 计算机科学 2025-10-23 Xiaoyu Wu , Yifei Pang , Terrance Liu , Zhiwei Steven Wu

The advance of explainable artificial intelligence, which provides reasons for its predictions, is expected to accelerate the use of deep neural networks in the real world like Machine Learning as a Service (MLaaS) that returns predictions…

密码学与安全 · 计算机科学 2021-07-20 Takayuki Miura , Satoshi Hasegawa , Toshiki Shibahara

As machine learning (ML) becomes more and more powerful and easily accessible, attackers increasingly leverage ML to perform automated large-scale inference attacks in various domains. In such an ML-equipped inference attack, an attacker…

密码学与安全 · 计算机科学 2019-09-20 Jinyuan Jia , Neil Zhenqiang Gong

Machine learning models leak information about the datasets on which they are trained. An adversary can build an algorithm to trace the individual members of a model's training dataset. As a fundamental inference attack, he aims to…

机器学习 · 统计学 2018-07-17 Milad Nasr , Reza Shokri , Amir Houmansadr

Data privacy is an important issue for "machine learning as a service" providers. We focus on the problem of membership inference attacks: given a data sample and black-box access to a model's API, determine whether the sample existed in…

机器学习 · 计算机科学 2020-03-17 Sorami Hisamoto , Matt Post , Kevin Duh

Increasing use of ML technologies in privacy-sensitive domains such as medical diagnoses, lifestyle predictions, and business decisions highlights the need to better understand if these ML technologies are introducing leakages of sensitive…

密码学与安全 · 计算机科学 2020-12-08 Shagufta Mehnaz , Ninghui Li , Elisa Bertino

Machine learning models often pose a threat to the privacy of individuals whose data is part of the training set. Several recent attacks have been able to infer sensitive information from trained models, including model inversion or…

机器学习 · 计算机科学 2020-06-30 Abigail Goldsteen , Gilad Ezov , Ariel Farkash

The collection and availability of big data, combined with advances in pre-trained models (e.g., BERT, XLNET, etc), have revolutionized the predictive performance of modern natural language processing tasks, ranging from text classification…

密码学与安全 · 计算机科学 2021-12-28 Chen Chen , Xuanli He , Lingjuan Lyu , Fangzhao Wu

Federated Learning (FL) is a collaborative learning framework designed to protect client data, yet it remains highly vulnerable to Intellectual Property (IP) threats. Model extraction (ME) attacks pose a significant risk to Machine Learning…

Machine learning (ML) models have been widely applied to various applications, including image classification, text generation, audio recognition, and graph data analysis. However, recent studies have shown that ML models are vulnerable to…

机器学习 · 计算机科学 2022-02-04 Hongsheng Hu , Zoran Salcic , Lichao Sun , Gillian Dobbie , Philip S. Yu , Xuyun Zhang

Recently, machine learning (ML) has introduced advanced solutions to many domains. Since ML models provide business advantage to model owners, protecting intellectual property of ML models has emerged as an important consideration.…

机器学习 · 计算机科学 2020-05-28 Buse Gul Atli , Sebastian Szyller , Mika Juuti , Samuel Marchal , N. Asokan

Machine unlearning is motivated by desire for data autonomy: a person can request to have their data's influence removed from deployed models, and those models should be updated as if they were retrained without the person's data. We show…

机器学习 · 计算机科学 2024-05-31 Martin Bertran , Shuai Tang , Michael Kearns , Jamie Morgenstern , Aaron Roth , Zhiwei Steven Wu