English
Related papers

Related papers: A Framework for Understanding Model Extraction Att…

200 papers

The remarkable success of machine learning has fostered a growing number of cloud-based intelligent services for mobile users. Such a service requires a user to send data, e.g. image, voice and video, to the provider, which presents a…

Machine Learning · Computer Science 2020-06-12 Sicong Liu , Junzhao Du , Anshumali Shrivastava , Lin Zhong

Model stealing attacks present a dilemma for public machine learning APIs. To protect financial investments, companies may be forced to withhold important information about their models that could facilitate theft, including uncertainty…

Machine Learning · Computer Science 2022-06-29 Mantas Mazeika , Bo Li , David Forsyth

The ubiquity of distributed machine learning (ML) in sensitive public domain applications calls for algorithms that protect data privacy, while being robust to faults and adversarial behaviors. Although privacy and robustness have been…

Machine Learning · Computer Science 2023-05-30 Youssef Allouah , Rachid Guerraoui , Nirupam Gupta , Rafael Pinot , John Stephan

Empirical defenses for machine learning privacy forgo the provable guarantees of differential privacy in the hope of achieving higher utility while resisting realistic adversaries. We identify severe pitfalls in existing empirical privacy…

Cryptography and Security · Computer Science 2024-09-06 Michael Aerni , Jie Zhang , Florian Tramèr

Model Extraction Attacks (MEAs) threaten modern machine learning systems by enabling adversaries to steal models, exposing intellectual property and training data. With the increasing deployment of machine learning models in distributed…

Cryptography and Security · Computer Science 2025-02-25 Kaixiang Zhao , Lincan Li , Kaize Ding , Neil Zhenqiang Gong , Yue Zhao , Yushun Dong

Machine learning models are vulnerable to simple model stealing attacks if the adversary can obtain output labels for chosen inputs. To protect against these attacks, it has been proposed to limit the information provided to the adversary…

Machine Learning · Computer Science 2018-12-14 Taesung Lee , Benjamin Edwards , Ian Molloy , Dong Su

In this work, we propose information laundering, a novel framework for enhancing model privacy. Unlike data privacy that concerns the protection of raw data information, model privacy aims to protect an already-learned model that is to be…

Cryptography and Security · Computer Science 2020-09-16 Xinran Wang , Yu Xiang , Jun Gao , Jie Ding

Machine learning models have made many decision support systems to be faster, more accurate, and more efficient. However, applications of machine learning in network security face a more disproportionate threat of active adversarial attacks…

Cryptography and Security · Computer Science 2023-03-22 Olakunle Ibitoye , Rana Abou-Khamis , Mohamed el Shehaby , Ashraf Matrawy , M. Omair Shafiq

The objective of machine learning is to extract useful information from data, while privacy is preserved by concealing information. Thus it seems hard to reconcile these competing interests. However, they frequently must be balanced when…

Machine Learning · Computer Science 2014-12-25 Zhanglong Ji , Zachary C. Lipton , Charles Elkan

In distributed learning settings, models are iteratively updated with shared gradients computed from potentially sensitive user data. While previous work has studied various privacy risks of sharing gradients, our paper aims to provide a…

Machine Learning · Computer Science 2024-09-02 Zhuohang Li , Andrew Lowy , Jing Liu , Toshiaki Koike-Akino , Kieran Parsons , Bradley Malin , Ye Wang

In model extraction attacks, adversaries can steal a machine learning model exposed via a public API by repeatedly querying it and adjusting their own model based on obtained predictions. To prevent model stealing, existing defenses focus…

Cryptography and Security · Computer Science 2022-12-13 Adam Dziedzic , Muhammad Ahmad Kaleem , Yu Shen Lu , Nicolas Papernot

Due to the recent popularity of online social networks, coupled with people's propensity to disclose personal information in an effort to achieve certain gratifications, the problem of navigating the tradeoff between privacy and utility…

Information Theory · Computer Science 2020-03-12 Chandra Sharma , George Amariucai

Machine learning algorithms are used to construct a mathematical model for a system based on training data. Such a model is capable of making highly accurate predictions without being explicitly programmed to do so. These techniques have a…

Cryptography and Security · Computer Science 2022-02-22 Cato Pauling , Michael Gimson , Muhammed Qaid , Ahmad Kida , Basel Halak

Federated Learning (FL) is a novel privacy-protection distributed machine learning paradigm that guarantees user privacy and prevents the risk of data leakage due to the advantage of the client's local training. Researchers have struggled…

Machine Learning · Computer Science 2023-12-01 Kangkang Sun , Xiaojin Zhang , Xi Lin , Gaolei Li , Jing Wang , Jianhua Li

Deploying machine learning models in production may allow adversaries to infer sensitive information about training data. There is a vast literature analyzing different types of inference risks, ranging from membership inference to…

The remarkable success of machine learning, especially deep learning, has produced a variety of cloud-based services for mobile users. Such services require an end user to send data to the service provider, which presents a serious…

Machine Learning · Computer Science 2019-01-28 Sicong Liu , Anshumali Shrivastava , Junzhao Du , Lin Zhong

This paper investigates recently proposed approaches for defending against adversarial examples and evaluating adversarial robustness. We motivate 'adversarial risk' as an objective for achieving models robust to worst-case inputs. We then…

Machine Learning · Computer Science 2018-06-13 Jonathan Uesato , Brendan O'Donoghue , Aaron van den Oord , Pushmeet Kohli

Model extraction attacks are designed to steal trained models with only query access, as is often provided through APIs that ML-as-a-Service providers offer. Machine Learning (ML) models are expensive to train, in part because data is hard…

Machine Learning · Computer Science 2024-06-14 Avital Shafran , Ilia Shumailov , Murat A. Erdogdu , Nicolas Papernot

In addition to their security properties, adversarial machine-learning attacks and defenses have political dimensions. They enable or foreclose certain options for both the subjects of the machine learning systems and for those who deploy…

Computers and Society · Computer Science 2020-04-28 Kendra Albert , Jonathon Penney , Bruce Schneier , Ram Shankar Siva Kumar

Leakage of data from publicly available Machine Learning (ML) models is an area of growing significance as commercial and government applications of ML can draw on multiple sources of data, potentially including users' and clients'…