English
Related papers

Related papers: Reconstructing Training Data with Informed Adversa…

200 papers

Machine learning is vulnerable to a wide variety of attacks. It is now well understood that by changing the underlying data distribution, an adversary can poison the model trained with it or introduce backdoors. In this paper we present a…

Machine Learning · Computer Science 2021-06-08 Ilia Shumailov , Zakhar Shumaylov , Dmitry Kazhdan , Yiren Zhao , Nicolas Papernot , Murat A. Erdogdu , Ross Anderson

It is well known that adversarial attacks can fool deep neural networks with imperceptible perturbations. Although adversarial training significantly improves model robustness, failure cases of defense still broadly exist. In this work, we…

Machine Learning · Computer Science 2021-06-10 Boxi Wu , Heng Pan , Li Shen , Jindong Gu , Shuai Zhao , Zhifeng Li , Deng Cai , Xiaofei He , Wei Liu

The use of personal data for training machine learning systems comes with a privacy threat and measuring the level of privacy of a model is one of the major challenges in machine learning today. Identifying training data based on a trained…

Machine Learning · Computer Science 2022-03-24 Ganesh Del Grosso , Hamid Jalalzai , Georg Pichler , Catuscia Palamidessi , Pablo Piantanida

Differential privacy (DP) is by far the most widely accepted framework for mitigating privacy risks in machine learning. However, exactly how small the privacy parameter $\epsilon$ needs to be to protect against certain privacy risks in…

Machine Learning · Computer Science 2023-08-11 Chuan Guo , Alexandre Sablayrolles , Maziar Sanjabi

Generative models are subject to overfitting and thus may potentially leak sensitive information from the training data. In this work. we investigate the privacy risks that can potentially arise from the use of generative adversarial…

Cryptography and Security · Computer Science 2024-04-02 Abdallah Alshantti , Adil Rasheed , Frank Westad

Adversarial examples are inputs to machine learning models that an attacker has intentionally designed to confuse the model into making a mistake. Such examples pose a serious threat to the applicability of machine-learning-based systems,…

Machine Learning · Computer Science 2023-10-18 Peiyu Xiong , Michael Tegegn , Jaskeerat Singh Sarin , Shubhraneel Pal , Julia Rubin

Model Inversion (MI), in which an adversary abuses access to a trained Machine Learning (ML) model attempting to infer sensitive information about its original training data, has attracted increasing research attention. During MI, the…

Machine Learning · Computer Science 2021-11-09 Qian Wang , Daniel Kurz

Historically, machine learning methods have not been designed with security in mind. In turn, this has given rise to adversarial examples, carefully perturbed input samples aimed to mislead detection at test time, which have been applied to…

Machine Learning · Computer Science 2022-01-11 Jamie Hayes

The rise of deep learning technique has raised new privacy concerns about the training data and test data. In this work, we investigate the model inversion problem in the adversarial settings, where the adversary aims at inferring…

Cryptography and Security · Computer Science 2019-02-25 Ziqi Yang , Ee-Chien Chang , Zhenkai Liang

Deep learning (DL) methods have become the state-of-the-art for reconstructing sub-sampled magnetic resonance imaging (MRI) data. However, studies have shown that these methods are susceptible to small adversarial input perturbations, or…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Mahdi Saberi , Chi Zhang , Mehmet Akçakaya

\ac{fl} proposed a distributed \ac{ml} framework where every distributed worker owns a complete copy of global model and their own data. The training is occurred locally, which assures no direct transmission of training data. However, the…

Cryptography and Security · Computer Science 2021-11-08 Jia Qian , Hiba Nassar , Lars Kai Hansen

Despite the efficacy on a variety of computer vision tasks, deep neural networks (DNNs) are vulnerable to adversarial attacks, limiting their applications in security-critical systems. Recent works have shown the possibility of generating…

Computer Vision and Pattern Recognition · Computer Science 2018-12-21 Ziang Yan , Yiwen Guo , Changshui Zhang

We study a privacy-preserving data-sharing setting where a privatizer transforms private data into a sanitized version observed by an authorized reconstructor and two unauthorized adversaries, each with access to side information correlated…

Information Theory · Computer Science 2025-07-25 Amirarsalan Moatazedian , Yauhen Yakimenka , Rémi A. Chou , Jörg Kliewer

Although federated learning improves privacy of training data by exchanging local gradients or parameters rather than raw data, the adversary still can leverage local gradients and parameters to obtain local training data by launching…

Machine Learning · Computer Science 2021-08-17 Xue Yang , Yan Feng , Weijun Fang , Jun Shao , Xiaohu Tang , Shu-Tao Xia , Rongxing Lu

This is Btech thesis report on detection and purification of adverserially attacked images. A deep learning model is trained on certain training examples for various tasks such as classification, regression etc. By training, weights are…

Machine Learning · Computer Science 2022-05-18 Dvij Kalaria

Data reconstruction attacks on machine learning models pose a substantial threat to privacy, potentially leaking sensitive information. Although defending against such attacks using differential privacy (DP) provides theoretical guarantees,…

Machine Learning · Computer Science 2025-03-11 Kristian Schwethelm , Johannes Kaiser , Moritz Knolle , Sarah Lockfisch , Daniel Rueckert , Alexander Ziller

Differentially private (DP) machine learning allows us to train models on private data while limiting data leakage. DP formalizes this data leakage through a cryptographic game, where an adversary must predict if a model was trained on a…

Machine Learning · Computer Science 2021-01-13 Milad Nasr , Shuang Song , Abhradeep Thakurta , Nicolas Papernot , Nicholas Carlini

Federated Learning enables entities to collaboratively learn a shared prediction model while keeping their training data locally. It prevents data collection and aggregation and, therefore, mitigates the associated privacy risks. However,…

Cryptography and Security · Computer Science 2020-10-16 Raouf Kerkouche , Gergely Ács , Claude Castelluccia

Adversarial training is a widely-applied approach to training deep neural networks to be robust against adversarial perturbation. However, although adversarial training has achieved empirical success in practice, it still remains unclear…

Machine Learning · Computer Science 2025-02-10 Binghui Li , Yuanzhi Li

Federated learning is a decentralized machine learning approach where clients train models locally and share model updates to develop a global model. This enables low-resource devices to collaboratively build a high-quality model without…

Cryptography and Security · Computer Science 2024-12-10 Li Bai , Haibo Hu , Qingqing Ye , Haoyang Li , Leixia Wang , Jianliang Xu