English
Related papers

Related papers: How to Steer Your Adversary: Targeted and Efficien…

200 papers

Machine learning models are vulnerable to simple model stealing attacks if the adversary can obtain output labels for chosen inputs. To protect against these attacks, it has been proposed to limit the information provided to the adversary…

Machine Learning · Computer Science 2018-12-14 Taesung Lee , Benjamin Edwards , Ian Molloy , Dong Su

Federated Learning (FL) has become a cornerstone of privacy protection, shifting the paradigm towards localizing sensitive data while only sending model gradients to a central server. This strategy is designed to reinforce privacy…

Machine Learning · Computer Science 2024-10-14 H. Yi , H. Ren , C. Hu , Y. Li , J. Deng , X. Xie

Deep learning models have been shown to be vulnerable to adversarial attacks. In particular, gradient-based attacks have demonstrated high success rates recently. The gradient measures how each image pixel affects the model output, which…

Computer Vision and Pattern Recognition · Computer Science 2022-02-03 Hanbin Hong , Yuan Hong , Yu Kong

Model stealing attacks endanger the confidentiality of machine learning models offered as a service. Although these models are kept secret, a malicious party can query a model to label data samples and train their own substitute model,…

Cryptography and Security · Computer Science 2025-09-01 Daryna Oliynyk , Rudolf Mayer , Kathrin Grosse , Andreas Rauber

Model-sharing offers significant business value by enabling firms with well-established Machine Learning (ML) models to monetize and share their models with others who lack the resources to develop ML models from scratch. However, concerns…

Cryptography and Security · Computer Science 2025-09-23 Yunfan Yang , Jiarong Xu , Hongzhe Zhang , Xiao Fang

Exchanging gradients is a widely used method in modern multi-node machine learning system (e.g., distributed training, collaborative learning). For a long time, people believed that gradients are safe to share: i.e., the training data will…

Machine Learning · Computer Science 2019-12-20 Ligeng Zhu , Zhijian Liu , Song Han

Reconstruction attacks and defenses are essential in understanding the data leakage problem in machine learning. However, prior work has centered around empirical observations of gradient inversion attacks, lacks theoretical grounding, and…

Cryptography and Security · Computer Science 2025-03-25 Sheng Liu , Zihan Wang , Yuxiao Chen , Qi Lei

Adversarial training, especially projected gradient descent (PGD), has proven to be a successful approach for improving robustness against adversarial attacks. After adversarial training, gradients of models with respect to their inputs…

Machine Learning · Statistics 2023-04-21 Ricardo Bigolin Lanfredi , Joyce D. Schroeder , Tolga Tasdizen

Machine learning (ML) applications are increasingly prevalent. Protecting the confidentiality of ML models becomes paramount for two reasons: (a) a model can be a business advantage to its owner, and (b) an adversary may use a stolen model…

Cryptography and Security · Computer Science 2019-04-02 Mika Juuti , Sebastian Szyller , Samuel Marchal , N. Asokan

Recent works have brought attention to the vulnerability of Federated Learning (FL) systems to gradient leakage attacks. Such attacks exploit clients' uploaded gradients to reconstruct their sensitive data, thereby compromising the privacy…

Machine Learning · Computer Science 2025-06-11 Mingyuan Fan , Cen Chen , Chengyu Wang , Xiaodan Li , Wenmeng Zhou

Over the years, most research towards defenses against adversarial attacks on machine learning models has been in the image recognition domain. The ML-based malware detection domain has received less attention despite its importance.…

Machine Learning · Computer Science 2023-04-25 Aqib Rashid , Jose Such

Evading adversarial example detection defenses requires finding adversarial examples that must simultaneously (a) be misclassified by the model and (b) be detected as non-adversarial. We find that existing attacks that attempt to satisfy…

Machine Learning · Computer Science 2021-06-30 Oliver Bryniarski , Nabeel Hingun , Pedro Pachuca , Vincent Wang , Nicholas Carlini

The Deep Leakage from Gradient (DLG) attack has emerged as a prevalent and highly effective method for extracting sensitive training data by inspecting exchanged gradients. This approach poses a substantial threat to the privacy of…

Machine Learning · Computer Science 2023-11-27 Chenyang Li , Zhao Song , Weixin Wang , Chiwun Yang

Machine Learning as a Service (MLaaS) enables users to leverage powerful machine learning models through cloud-based APIs, offering scalability and ease of deployment. However, these services are vulnerable to model extraction attacks,…

Cryptography and Security · Computer Science 2025-05-27 Amit Chakraborty , Sayyed Farid Ahamed , Sandip Roy , Soumya Banerjee , Kevin Choi , Abdul Rahman , Alison Hu , Edward Bowen , Sachin Shetty

Operating in a dynamic real world environment requires a forward thinking and adversarial aware design for classifiers, beyond fitting the model to the training data. In such scenarios, it is necessary to make classifiers - a) harder to…

Machine Learning · Computer Science 2018-03-28 Tegjyot Singh Sethi , Mehmed Kantardzic , Lingyu Lyua , Jiashun Chen

Improving the resistance of deep neural networks against adversarial attacks is important for deploying models to realistic applications. However, most defense methods are designed to defend against intensity perturbations and ignore…

Machine Learning · Computer Science 2020-10-07 Pengfei Xia , Bin Li

Recent work has shown that gradient updates in federated learning (FL) can unintentionally reveal sensitive information about a client's local data. This risk becomes significantly greater when a malicious server manipulates the global…

Machine Learning · Computer Science 2025-06-26 Fei Wang , Baochun Li

Obtaining a well-trained model involves expensive data collection and training procedures, therefore the model is a valuable intellectual property. Recent studies revealed that adversaries can `steal' deployed models even when they have no…

Cryptography and Security · Computer Science 2021-12-08 Yiming Li , Linghui Zhu , Xiaojun Jia , Yong Jiang , Shu-Tao Xia , Xiaochun Cao

In the rapidly evolving field of artificial intelligence, machine learning emerges as a key technology characterized by its vast potential and inherent risks. The stability and reliability of these models are important, as they are frequent…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Haibo Zhang , Zhihua Yao , Kouichi Sakurai , Takeshi Saitoh

Federated learning is an established method for training machine learning models without sharing training data. However, recent work has shown that it cannot guarantee data privacy as shared gradients can still leak sensitive information.…

Machine Learning · Computer Science 2022-03-18 Mislav Balunović , Dimitar I. Dimitrov , Robin Staab , Martin Vechev